"That's How the Numbers Go" is a Sesame Street song from the video, 123 Count with Me.

Ernie sings the song to Humphrey and Ingrid to teach them how to count to 20. Benny Rabbit initially opts out of the song, but finds himself dancing and singing along at the end.