I image that Riddle stopped feeling lonely when he stopped feeling in the whole. Voldemort experiences only the rashest of emotions, the extremes -- obsessive joy, anger, surprise -- his "feelings" are incredibly simple.

Loneliness, on the other hand, is far more insidious, lingering, complicated in that you can be lonely and still be surrounded by adoring peers.