Duke all comes down to Ngongba and if he can stay out of foul trouble. With him in their double bigs are a handful, where Tarris/Reibe have to stay on Ngongba and that leaves Karaban to defend Boozer, which is not ideal from a physicality standpoint. Less worried if Ngongba gets into foul trouble (as he is want to do) and they have Brown and Boozer in the game. They are better defensively bc Brown is a heck of a help defender, but I feel they would have to defend Tarris with Boozer at that point and Brown's big advantage gets pulled from the paint as he chases Karaban.
The POA defense by Sarr is impressive and they have height/length but I wouldn't call their other guards/wings particularly great defenders.
Realistically the top three teams all have matchup concerns for UConn because they all play double bigs who are big and physical and (Cadeau aside) have height/length everywhere on the court. All three have three solid bigs to keep that size on the court at all times.
Boozer, Johnson/Lendeborg, Peat/Awaka are the guys Karaban/Stewart will have to be able to defend if it comes down to a FF - NC and things go chalk.