If you’re going to raise the “level of competition” argument, then we really should throw out the whole Mt Rushmore analogy. After all, when Washington took office there were only 13 states (16 when he left). Jefferson wasn’t much better, becoming president when there were 16 states and leaving with 17.
Lincoln started with 34 and left prematurely with 36, although for much of his presidency, 11 of those states were in rebellion. That must mean that Teddy Roosevelt was the best president on Mt Rushmore since he was president when there were 45 states, leaving with 46.