Honestly, I don’t think pollsters spend a lot of time before they vote each week looking at a team’s entire SOS. I believe they mail in their weekly votes without a lot of thought or analysis.
Their most recent impression is what counts. ND played well recently, so they’re #1. Louisville keeps winning but not by overwhelming margins so they’re #2. UConn lost at Baylor so they drop to #3. Baylor beat UConn at home so they move up to #4.
When March rolls around, the NCAA selection committee looks at the entire body of work for the top 70 or so teams, including AQ’s, spending far more time evaluating SOS, key wins, recent performance, etc. before seeding teams and setting up their brackets, and even they make mistakes.