We all hate Duke. The problem is other teams lose too, and other teams have bad losses too. Pretty much once you get outside UConn and Purdue and Houston, everyone has a bad loss or two on their resume. They aren't special in that way.
They were ranked in the Top 10 because a 4 seed that was surging last year brought in the second ranked recruiting class to pair with a some very good players, so they started very high and were penalized just as harshly as any team not named Duke would be. Then they went on a win streak against mostly mediocre schools and rose like any non-Duke team would.
There's nothing special about them.
Also they suck.