RIP RPI

[Guapo]

 

[Rico444]

Division I Men’s Basketball Committee adopts new ranking system

The NCAA has developed a new ranking system to replace the RPI as the primary sorting tool for evaluating teams during the Division I men’s basketball season. The new ranking system was approved in late July after months of consultation with the Division I Men’s Basketball Committee, the National Association of Basketball Coaches, top basketball analytics experts and Google Cloud Professional Services.

The NCAA Evaluation Tool, which will be known as the NET, relies on game results, strength of schedule, game location, scoring margin, net offensive and defensive efficiency, and the quality of wins and losses. To make sense of team performance data, late-season games (including from the NCAA tournament) were used as test sets to develop a ranking model leveraging machine learning techniques. The model, which used team performance data to predict the outcome of games in test sets, was optimized until it was as accurate as possible. The resulting model is the one that will be used as the NET going forward.

 

[UConnTrumbull]

Good?

 

[BLUEDOGHOUSE]

Good?

It is better but there is a cap on scoring margin of 10 pts if not mitaken. That to me is a very low cap. Would prefer 20 pt cap. Games are nail bitters all the time until late game fouling which push the result to +10.

 

[Ts5034]

It is better but there is a cap on scoring margin of 10 pts if not mitaken. That to me is a very low cap. Would prefer 20 pt cap. Games are nail bitters all the time until late game fouling which push the result to +10.

This could mean that coaches will tend to keep their starters in longer just to ensure a 10+ point victory. If you think back to the National Championship game in 2004, its crazy to think the final margin was 9 points. I think at some points we were up by almost 30.

 

[CL82]

Scoring margin cap and the defensive efficiency metric helps us, I think. We aren't going to huge scoring team but I think we may be a very disruptive team on defense when I look at past Hurley teams and the tools he has to work with this year.

 

[Edward Sargent]

They don’t mention the embedded FOE algorithm Friends of Emmert

 

[gioff23]

Good?

I'll bet you a cold one that this turns out very well for the schools that were behind the change, that is the so-called P5

 

[uchuskies2009]

They don’t mention the embedded FOE algorithm Friends of Emmert

Based on that algorithm, we will never be eligible for the tournament as long as Emmert is president of the NCAA.

 

[storrsroars]

I'll bet you a cold one that this turns out very well for the schools that were behind the change, that is the so-called P5

In the SOS algorithm, all non-P5 schools are given a ranking of 300.

 

[UConnStats]

This could mean that coaches will tend to keep their starters in longer just to ensure a 10+ point victory. If you think back to the National Championship game in 2004, its crazy to think the final margin was 9 points. I think at some points we were up by almost 30.

IMO that’s much less of a problem than Pitino keeping his starters in the whole game against Weber St and winning by 50, then complaining in March that he’s under seeded when in reality, his team’s efficiency vs the top 100 teams was way worse than it was in November.

Or take UConn’s team last year. If we were down 10 in the second half, forget it. Their foot was off the gas and we’d lose by 20+. I’d rather have something in the 10-15 range than 20. If a team is losing by 15 with 5 minutes left, chances are they’re giving up. Should they? No, but the team they’re playing doesn’t have to benefit any further from it.

This is a cool tool IMO. Not an end all be all by any means, but it beats RPI for sure.

 

[AreBee1969]

I stopped reading at "The NCAA has developed..."

 

[CL82]

I stopped reading at "The NCAA has developed..."

Lol...

The scariest words in the English language are "I'm from the government and I'm here to help" but these are a close second.

 

[kobebeanbryant]

very interested to see how this turns out.

i had made a few attempts at developing a machine learning model based on team stats and kenpom to build my brackets in prior years.

the main issue i foresee with this is machine learning methods (neural networks in particular) are usually a black box in that it can be hard to explain why the model made a specific decision. so when this new model leaves your team out of the tournament it may not give you a clear reason why.

and for those that are always looking for the anti-uconn angle in ncaa decision making, perhaps they trained the model with a bias against uconn, to ensure lower rankings in the future.

 

[auror]

very interested to see how this turns out.

i had made a few attempts at developing a machine learning model based on team stats and kenpom to build my brackets in prior years.

the main issue i foresee with this is machine learning methods (neural networks in particular) are usually a black box in that it can be hard to explain why the model made a specific decision. so when this new model leaves your team out of the tournament it may not give you a clear reason why.

and for those that are always looking for the anti-uconn angle in ncaa decision making, perhaps they trained the model with a bias against uconn, to ensure lower rankings in the future.

Thankfully the committee will still exist. This will just be used to organize the teamsheets and give the number side context they use in their evaluations.

 

[pj]

Thanks NCAA, now ECU and Tulsa can continue to schedule the dregs of college basketball. - Mike Aresco

 

[Scrutineer]

Anytime you see "strength of schedule" and "quality of wins and losses", run for the hills.

Who, using what criteria, sets the baseline from which "strength of schedule" is determined at the beginning of the year? Is there some method by which it will be mitigated as the year goes on if teams' schedules are rated inappropriately at the start of the year?

How do you measure "quality of wins and losses"? Using what criteria? Will this system continually adjust the SOS and "quality" measures so early season biases are overcome by the final rating date?

Can't wait for "conspiracy kitty's" take on this, especially as to whether it is designed to benefit the Power Five and the NBE.

 

[freescooter]

Thanks NCAA, now ECU and Tulsa can continue to schedule the dregs of college basketball. - Mike Aresco

One might argue that at least ECU IS the dregs of college basketball! Oh, sorry DePaul...

 

[Purple Stein]

I feel stupidly sentimental toward the RPI — it’s like they’re getting rid of tan M&M’s all over again.

 

[auror]

Anytime you see "strength of schedule" and "quality of wins and losses", run for the hills.

Who, using what criteria, sets the baseline from which "strength of schedule" is determined at the beginning of the year? Is there some method by which it will be mitigated as the year goes on if teams' schedules are rated inappropriately at the start of the year?

How do you measure "quality of wins and losses"? Using what criteria? Will this system continually adjust the SOS and "quality" measures so early season biases are overcome by the final rating date?

Can't wait for "conspiracy kitty's" take on this, especially as to whether it is designed to benefit the Power Five and the NBE.

To confirm your answer to your own question: Most of that is derived from scoring margin throughout the season as games are played.

 

[pj]

One might argue that at least ECU IS the dregs of college basketball! Oh, sorry DePaul...

Thanks, Mike Aresco, for scheduling UConn with the dregs of college basketball every year.

 

[auror]

 

[auror]

 

[CL82]

 

[intlzncster]

NCAA won’t apply NET metric to previous yrs for comparison

Now THAT is ridiculous. No need to see if this is a quality metric via back testing. Just trust us...

They [NCAA] heavily outsourced the research.

Ahhhhhh there's the NCAA I know and love. Passing the buck like an old pro.