SEC and Efficiency Ratings (i.e. KenPom and NET) | The Boneyard

SEC and Efficiency Ratings (i.e. KenPom and NET)

nelsonmuntz

Point Center
Joined
Aug 27, 2011
Messages
46,629
Reaction Score
39,424

I started a thread three months ago about the interconference records compared to the power ratings, and questioned why the SEC was so highly rated when the actual game results would indicate a much less impressive conference.

KenPom had the SEC at +19.46 going into the tournament, making it the 5th best conference of all time for KenPom, going back to the late 90's.

Well, after the first weekend, the SEC only got 4 of 10 teams into the Sweet 16, but it is worse if you dig in.

Sweet 16 SEC teams:

Alabama - impressive win vs. Texas Tech, but they literally had a major drug dealer on their roster. If there was ever a reason for a team to be forfeited out of the tournament, this would be one. NL yet for next round.
Arkansas - Beat a 13 and 14 seed, and the High Point game was close. +8.5 in the next round.
Texas - Beat BYU and Gonzaga, who were both missing key players. +7.5 in the next round
Tennessee - beat one of the weakest 3 seeds in recent history. +4.5 in the next round.

There is a reasonably high chance that the SEC exits the tournament in the next round.

SEC Teams who didn't make it to the Sweet 16:

Florida - lost to a team 8 slots below it
Vanderbilt - respectable loss
Texas A&M - obliterated by Houston
Kentucky - needed a miracle to beat Santa Clara, and was easily handled by an Iowa State team missing one of its best players
Georgia - demolished by St. Louis in first round
Missouri - first round exit in game that wasn't close

The SEC is 3-6 against the major conferences in the tournament, with two of the wins close and 4 of the losses blowouts.

Does this look like the 5th best conference of all time? There were several homages to KenPom's brilliance as a predictive model. Did KenPom predict that the 5th best conference of all time would fall flat on its freaking face? My theory Is that the SEC was overrated in the efficiency ratings because it ran up the scores against the bad teams on its schedules. I am open to other explanations for how the efficiency ratings systematically overrated SEC teams.
 
I think it’s as simple as there being a lot of solid but not elite teams. I do agree that a lot of these analytical numbers are being jacked up but because teams have gotten better at smoking inferior competition.

Was never sold on Florida, their KenPom numbers were sky high but they never looked particularly extraordinary compared to other good teams in other years despite the metrics implying that.
 
Judge Judy Eye Roll GIF
 
.-.
Of the 10 teams from the conference that made the tournament, 8 met or exceeded their seed expectations, 2 were upset early. And that includes an 8 losing to a 9 as an "upset".

I forgot about the season ending injury to Toppin from Texas Tech until after I made the first post. Even Alabama‘s win over TTU came with a big asterisk.

The fifth best conference of all time needed 3 very friendly matchups against teams missing key players to even get 2 of its teams into the Seeet 16. It isn’t just losing based on seed, the SEC looked terrible doing it. I would argue that several of the surviving teams were helped by generous seeding due to high efficiency ratings that they did not deserve.

Why is it so hard for some people to admit that KenPom, which has an obvious flaw that teams are rewarded for running up the score, can be gamed by teams or a conference systematically running up the scores? Given that I pointed out this problem in December, one of two things must be true: 1) I am a genius who can see the future, or 2) this is an obvious problem with efficiency ratings and anyone refusing to acknowledge it is just being stubborn.
 
I’m just glad FL lost as they cost me money, trying to dunk the ball (leading to a fast break) up 60 with 30 seconds to go in their first game. I prefer Hurleys respectful let the shot clock expire approach. Golden is a tool.
 
My favorite part of this is how you're using open lines, which just mirror Kempom's point spreads, as evidence that Kempom is bad.
 
.-.

I started a thread three months ago about the interconference records compared to the power ratings, and questioned why the SEC was so highly rated when the actual game results would indicate a much less impressive conference.

KenPom had the SEC at +19.46 going into the tournament, making it the 5th best conference of all time for KenPom, going back to the late 90's.

Well, after the first weekend, the SEC only got 4 of 10 teams into the Sweet 16, but it is worse if you dig in.

Sweet 16 SEC teams:

Alabama - impressive win vs. Texas Tech, but they literally had a major drug dealer on their roster. If there was ever a reason for a team to be forfeited out of the tournament, this would be one. NL yet for next round.
Arkansas - Beat a 13 and 14 seed, and the High Point game was close. +8.5 in the next round.
Texas - Beat BYU and Gonzaga, who were both missing key players. +7.5 in the next round
Tennessee - beat one of the weakest 3 seeds in recent history. +4.5 in the next round.

There is a reasonably high chance that the SEC exits the tournament in the next round.

SEC Teams who didn't make it to the Sweet 16:

Florida - lost to a team 8 slots below it
Vanderbilt - respectable loss
Texas A&M - obliterated by Houston
Kentucky - needed a miracle to beat Santa Clara, and was easily handled by an Iowa State team missing one of its best players
Georgia - demolished by St. Louis in first round
Missouri - first round exit in game that wasn't close

The SEC is 3-6 against the major conferences in the tournament, with two of the wins close and 4 of the losses blowouts.

Does this look like the 5th best conference of all time? There were several homages to KenPom's brilliance as a predictive model. Did KenPom predict that the 5th best conference of all time would fall flat on its freaking face? My theory Is that the SEC was overrated in the efficiency ratings because it ran up the scores against the bad teams on its schedules. I am open to other explanations for how the efficiency ratings systematically overrated SEC teams.
You are weighing a small sample size over a large sample size to support your bias and desire to "prove" the SEC is overrated. When you use a small sample size like this it is much harder to weed out injuries, bad calls, crowd advantages, off-nights shooting the ball, bad match ups etc. When you take a large sample size you can start to apply the law of averages. If the tournament started again next week all these spreads would be the same. Florida would still be a 10-point favorite over Iowa.

Were the efficiency ratings wrong last year when the SEC dominated?
 
I forgot about the season ending injury to Toppin from Texas Tech until after I made the first post. Even Alabama‘s win over TTU came with a big asterisk.

The fifth best conference of all time needed 3 very friendly matchups against teams missing key players to even get 2 of its teams into the Seeet 16. It isn’t just losing based on seed, the SEC looked terrible doing it. I would argue that several of the surviving teams were helped by generous seeding due to high efficiency ratings that they did not deserve.

Why is it so hard for some people to admit that KenPom, which has an obvious flaw that teams are rewarded for running up the score, can be gamed by teams or a conference systematically running up the scores? Given that I pointed out this problem in December, one of two things must be true: 1) I am a genius who can see the future, or 2) this is an obvious problem with efficiency ratings and anyone refusing to acknowledge it is just being stubborn.
What is your suggestion to fixing the metrics then?
 
What is your suggestion to fixing the metrics then?

It would be pretty simple to flatten out the impact of 30+ and 40+ point wins in the efficiency ratings like KenPom and NET. Beating Wagner by 40 points should not be meaningfully different in a computer model from beating Wagner by 30 points. The problem with doing that is KenPom has figured out that gamblers are using his model, and may be the biggest customers. If you are using the models for betting, then the willingness of a low rent coach like Golden to run up the score is very relevant because you want to know if Florida will cover a big spread. But if a selection committee is using the model to seed and select the field, then those extreme margins should have a rapidly declining impact on a team's efficiency rating, and if they had done that this season, we would have seen that Florida was good, not great this season.

A simpler metric like RPI had all 5 major conferences fairly close to each other, whereas KenPom had huge differences, particularly with the SEC. The reality was that there was not a huge gap between the leagues and the teams in the leagues, just a huge perception gap because some leagues were systematically gaming the efficiency ratings.

I am fine using efficiency ratings for tournament field selection and seeding if they do not reward running up the score, because this year, those non-competitive games against non-competitive teams had a big impact on the final ratings.
 
It would be pretty simple to flatten out the impact of 30+ and 40+ point wins in the efficiency ratings like KenPom and NET. Beating Wagner by 40 points should not be meaningfully different in a computer model from beating Wagner by 30 points. The problem with doing that is KenPom has figured out that gamblers are using his model, and may be the biggest customers. If you are using the models for betting, then the willingness of a low rent coach like Golden to run up the score is very relevant because you want to know if Florida will cover a big spread. But if a selection committee is using the model to seed and select the field, then those extreme margins should have a rapidly declining impact on a team's efficiency rating, and if they had done that this season, we would have seen that Florida was good, not great this season.

A simpler metric like RPI had all 5 major conferences fairly close to each other, whereas KenPom had huge differences, particularly with the SEC. The reality was that there was not a huge gap between the leagues and the teams in the leagues, just a huge perception gap because some leagues were systematically gaming the efficiency ratings.

I am fine using efficiency ratings for tournament field selection and seeding if they do not reward running up the score, because this year, those non-competitive games against non-competitive teams had a big impact on the final ratings.
Isn’t the better answer to let the gamblers use their tools (Ken Pom) and have the Committee, which is the only rankings we care about, rely on resume tools (as well as detailed analysis of the records)? They seemed to be doing that this year. That’s why all the coverage and explanation of the WAB.
 
Isn’t the better answer to let the gamblers use their tools (Ken Pom) and have the Committee, which is the only rankings we care about, rely on resume tools (as well as detailed analysis of the records)? They seemed to be doing that this year. That’s why all the coverage and explanation of the WAB.

Scoring margin is capped in NET at 10 points, but net efficiency is not capped.
 
It would be pretty simple to flatten out the impact of 30+ and 40+ point wins in the efficiency ratings like KenPom and NET. Beating Wagner by 40 points should not be meaningfully different in a computer model from beating Wagner by 30 points. The problem with doing that is KenPom has figured out that gamblers are using his model, and may be the biggest customers. If you are using the models for betting, then the willingness of a low rent coach like Golden to run up the score is very relevant because you want to know if Florida will cover a big spread. But if a selection committee is using the model to seed and select the field, then those extreme margins should have a rapidly declining impact on a team's efficiency rating, and if they had done that this season, we would have seen that Florida was good, not great this season.
For the 10,000th time, he adjusts the impact of the games by the rating disparity of the teams, so gross mismatch games count for less.
 
.-.
For the 10,000th time, he adjusts the impact of the games by the rating disparity of the teams, so gross mismatch games count for less.

For the 10,001st time, a 40 point win over a 340 ranked team counts for a lot more than a 25 point win over a 339 ranked team. There is an easy solution and the only reason he doesn't do it is because his customer base is gamblers. I am fine with that, but then the same metrics should not be used for selection and seeding.

Also, the NET formula absolutely needs to be publicly available.
 
just in terms of the content of the games I've found SEC and ACC overrated. ACC sucks yea but they are still rated highly by the committee for whatever reason. SEC is mostly athletic teams that rely on that edge but are not very well coached.
 
Teams definitely know how to game the rankings. No secret there

I’d be down for more mid majors in the 8/9 games. Utah St and Saint Louis just won those games against high majors

High Point had a great run as a 12 beating a B10 school and coming close against an SEC school. VCU also knocked out an ACC school in round 1 as an 11

But at the same time..everyone’s favorite Miami OH got waxed by 20 to a solid-but-not-great SEC team. Common upset pick McNeese lost by double digits to another. 7 seed Saint Mary’s lost to a 10 seed decent SEC team. Santa Clara lost to a decent SEC team in another 7/10. 29 win Akron got killed by the same Texas Tech team you’re giving an asterisk to

Then 2 of those 4 mid majors that did move on got waxed by 20. Saint Louis and High Point put up good fights

If the goal is to have the best teams compete in the sweet 16 and beyond, I think that’s what we have right now with some big surprises (Iowa, Texas). I want more mid majors making deep runs, but not sure what other selections should have been made to get there
 
i mean the kind of weakish mid major team like miami(oh) are the exact kind of teams SEC athletes would beat up.
 
Teams definitely know how to game the rankings. No secret there

I’d be down for more mid majors in the 8/9 games. Utah St and Saint Louis just won those games against high majors

High Point had a great run as a 12 beating a B10 school and coming close against an SEC school. VCU also knocked out an ACC school in round 1 as an 11

But at the same time..everyone’s favorite Miami OH got waxed by 20 to a solid-but-not-great SEC team. Common upset pick McNeese lost by double digits to another. 7 seed Saint Mary’s lost to a 10 seed decent SEC team. Santa Clara lost to a decent SEC team in another 7/10. 29 win Akron got killed by the same Texas Tech team you’re giving an asterisk to

Then 2 of those 4 mid majors that did move on got waxed by 20. Saint Louis and High Point put up good fights

If the goal is to have the best teams compete in the sweet 16 and beyond, I think that’s what we have right now with some big surprises (Iowa, Texas). I want more mid majors making deep runs, but not sure what other selections should have been made to get there
Forget the mid majors - it's becoming boring. Get the best teams in there at this point, last thing we need is more blowouts.

Really don't know what this witch hunt to discredit the SEC is all about. The tourney has a finite amount of spots, the back end is going to be weak, get the best teams in there.
 
Forget the mid majors - it's becoming boring. Get the best teams in there at this point, last thing we need is more blowouts.

Really don't know what this witch hunt to discredit the SEC is all about. The tourney has a finite amount of spots, the back end is going to be weak, get the best teams in there.
There were huge blowouts P5 vs. P5. And one of the major blowouts was A10 v. SEC.

The tournament is better with the Santa Claras and Sienas. Last two years there weren't a ton of upsets, but no need to reward the P5 (really, P4...really B1G and SEC) in a panic here.
 
.-.
There were huge blowouts P5 vs. P5. And one of the major blowouts was A10 v. SEC.

The tournament is better with the Santa Claras and Sienas. Last two years there weren't a ton of upsets, but no need to reward the P5 (really, P4...really B1G and SEC) in a panic here.
I'm fine with how it's currently working, my expectations on the MM ever doing anything more than a first round win is limited.

If proof is needed regarding the ability of a low P4 making a dent vs a MM, look no further than Iowa & Texas. Both of those teams have pros on them - the Mid Majors have zero pros on them because they transfer up. If we lean one direction or the other, I'd rather have the best players in the tourney, not the nostalgia of the mid major as that model is done.
 

Forum statistics

Threads
167,856
Messages
4,542,442
Members
10,421
Latest member
Huskyball22


Top Bottom