- First released on two of The Rutles' albums; The Rutles (The Shite Album) and Let It Rot for no particular reason.
- David Bowie covered the song on his 1975 album Young Armenians.
- Later re-released on The Rutles.
- Another cover version by When People Were Shorter and Lived Near the Water was released on Rutles Highway Revisited in 1993.
- Rutallica recorded a parody mashup of the song and Metallica's "The Thing That Should Not Be" called "The Thing That Should Not Be Natural", on their 2009 album Masterful History Tour.