I don't think anybody is a "born natural" at this, but one well-established way to become better at it, already partly mentioned by MattPutnam, is to find a set of reference points.
Matt's example of famous march music as a reference for 120 is a good one because those marches are always played at the same tempo, and to experienced ears sound "wrong" if played faster or slower. That's the catch - if you don't hear famous marches all the time so that you can reproduce them in your mind and nail the tempo, they won't work for you. The trick is finding strongly-rhythmic pieces of music, some fast, some slow, some medium, that are already "burned into your brain", and using them. For example, if you were watching TV in the 1970s and the Hawaii Five-O theme is stuck in your head, then listen to the beat of the bass drum and you have 88. If you don't know Sousa's marches but you know "Thriller" by Michael Jackson, well, that too is at 120. It doesn't matter what kind of music you use - what matters is that you know it really well and it never changes.
Don't use, for example, a national anthem or a children's song, because different people sing those at different tempi and they all sound OK. It needs to be music that "just sounds wrong" if the tempo isn't perfect.
To check the tempo of a song you find, get a free metronome app for your phone, borrow a friend's metronome, or whatever. Many of the phone apps have a "tap" function that will tell you how fast you're tapping the screen.