Is it possible for baby teeth to recede prior to being lost?

My son is almost six (a few days away) and one of his front baby teeth seems to be receding. It gets visibly shorter on a daily basis. My older son had his baby teeth pushed out by his permanent teeth, but it didn't look anything like this. He says it isn't "wiggly" but he freaks out if we try to touch it.