From Muppet Wiki

REM is a group of celebrities recognized by Jon Stewart as one of the many stars who have shown up at Radio City Music Hall in New York City for Elmopalooza in celebration of Sesame Street’s 30th anniversary celebration. It consists of a letter R, a letter E, and a letter M.

REM is a spoof of rock band R.E.M.