Just a couple cents here. Of course everyone has an opinion. And it really depends on how one describes, thinks of "athleticism".
I don't find baseball or golf as overly athletic. Very high on skills, but don't really need a lot of athleticism. No endurance at all (per game, maybe some per season). But really for a baseball player, half the game they are sitting on the bench, half of the other half they are standing waiting for the pitcher/batter. Golf has to walk, but no running, jumping, throwing, catching. Very, very high on skills though. I would agree hitting a baseball is one of the toughest "skills" there is. Golf, high skills also, BUT, no distractions, the ball is stationary, and no one is trying to stop you from taking your shot. No quickness needed. No quick adjustments. You have all day to figure out your shot, set it up and attempt it.
Football has some great athletes in it, but again, most players don't play more than half the game. And then only 7 seconds at a time with a 30 sec rest. Plus commercials, timeouts. But it does involve, speed, strength, jumping, quickness, durability. I'd agree CB's WR's, probably even LB's can be very athletic minus endurance.
Comparing football to rugby for instance. Rugby still needs the speed, strength, jumping, quickness, durability, but also throws in lot's of endurance. Most play all 80+ minutes of a game.
Gymnastics involve speed, jumping, strength (compared to body weight), agility, flexibility. Not a lot of endurance though. Not a lot of adjustments. I mean if you are good, you are doing the same exact thing over and over. The less variation, the better.
I'd consider cyclists, soccer players, basketball players, decathlon athletes as some of the more athletic. Speed, jumping, endurance, quickness, quick reactions. Decathlons with more upper body strength than cyclists or soccer players though. Tennis also.
Looking into some of this, one that surprised me a bit were race car drivers (NASCAR, F1). They can lose 5-7 lbs during a race. Also their hearts rates average around 140+ bpm for 3-4 hours. Also need quick reactions. And the cognitive drain is incredible. And if they make a mistake, they don't get scored on, they can die.
Just some thoughts.