The song was originally introduced on Broadway by Ethel Merman and Bob Hope, in the musical Red Hot & Blue (in 1936). It was subsequently interpolated into revivals of Anything Goes.
The Sesame Street song "When I Listen" references the lyric, "You can hear dear Mother Nature murmuring low, 'Let yourself go!'" As Kermit sings about the night sounds of the swamp, he compares it to the "sound of Mother Nature murmuring low." A group of animals loudly respond, "Let yourself go!"