We don't really get worked except against these two teams. I don't think the complexity level is a problem, I don't think it's as simple as you suggest. You also can't really prepare for our athleticism and defensive length/speed.
The defensive system has its virtues. It's main strength is limiting 3-point shots. We held Villanova to 11 3-point attempts. On the season, their next lowest attempts was 19. On paper, we should be able to hold our own in the paint against Nova in general and Dixon specifically. He's pretty good, but still a sophomore and we have Sanogo and Whaley. It didn't happen, obviously. He worked our guys 1v1 just like Justin Lewis and Richmond did. Guys play better at home and all 3 of those games were on the road, but teams with this offense profile are going to give us problems if they're able to utilize the spacing and finish in the paint 1v1 against us.
Nova runs the right system to beat us and also has smart players who are well drilled, strong, and can shoot. They have a top 5 coach AND a top 10 roster AND a roster that fits his scheme. Wright's been recruiting 4/5*s for the past 5 years. He's got top 100 guys on his bench (Njoku, Longino, Patterson, also Antoine but that's injury related) just learning and waiting (like Dixon did last year). It's clearly the roster model that Hurley is trying to emulate.