Perhaps...and to that point I go back to your original question and the answer is probably no. It's no because Raptors
fans are notoriously finicky and while they tend to overrate their players and team, deep down they are scared the team won't be good. It's no because historically we haven't been very good and therefore we need an easy schedule and luck with injuries to make noise.
Is it any tougher than other teams? I don't know because i haven't taken the time but does it matter? For the reasons i just mentioned Raps fans will always react this way...until the day comes when the team is good enough we want the challenge.