From Muppet Wiki

Many instruments have been used as characters in Muppet productions, including the following:

Muppet Show Instruments

• Piano
• Bagpipes
• Horn

Sesame Street Instruments

• Pipe Organ