I'm far from the type of person who wants to promote hyper-masculinity at all costs, but I also think there comes a point where it's OK for things to be important because we say they're important, no matter how arbitrary you think they might be. IMO, the people who constantly trip over themselves to remind us that football is just a game and I'm too cool to care about anything superficial are missing the bigger picture.
I took the OP as somewhat tongue in cheek. Reasonable people should be able to differentiate between something that poses a safety risk and something that just causes discomfort. Playing football in the cold is the second thing. Watching football in the cold, provided you dress warm and are not elderly, is also the second thing. We're not talking about truly dangerous temperatures here. If you don't want to go to the game, don't go. Other people might actually, believe it or not, find a thrill in braving the elements. The cold is one of those harmless things that we like to overreact to. Then we act surprised when there is something we should actually be reacting to and nobody bothers to take action (s/o climate change!).
Things like this might seem progressive but they are not.