I think it's a good idea to learn to not rely on burying the beater.
As already discussed, holding the beater against drum head dampens the drum. It is a different sound, and if you prefer it or the music you're playing requires it, there are many ways to dampen the bass drum. On the other hand, if you play double strokes on the bass drum, you need to bounce the beater from the head and if you normally bury the beater, you will get inconsistent sound.
The second thing is that if you don't really push the pedal so that the beater doesn't bounce at all, it is all too easy to play accidental ghost notes. It doesn't sound good at all, and not burying the pedal is a great way to avoid it.
Finally, you shouldn't completely release the pedal. If the beater is swinging freely, there's a good chance it is in the wrong place for the next stroke. Burying it is the easy way to avoid it, but it's better to catch the rebound and hold the pedal somewhere near the idle position.