Almost every episode of The Muppet Show had an opening and closing number, but there were rare instances where episodes lacked one or the other (though a music underscore might have appeared in the opening or closing acts).

Episodes Without Opening Numbers

Episodes Without Closing Numbers