It was designed to be an infinitely looping album, containing nine songs that all segue into each other, including the beginning and ending tracks - hence the title of the album.
In 2016, they released what many considered at the time to be their magnum opus: Nonagon Infinity. Later that year, they would release Paper Mâché Dream Balloon, which was a mostly acoustic album influenced by Folk Rock acts like The Byrds. In 2015, they started recording Quarters!, a Concept Album that has four songs - each of them lasting 10 minutes and 10 seconds - and containing influences from Jazz Fusion and Progressive Rock. They became rather popular in 2014, where they released Oddments and I'm In Your Mind Fuzz, where they would start to become more professional. In 2013, they recorded the Spaghetti Western-inspired Eyes Like the Sky, and the album Float Along - Fill Your Lungs, where they went full Psychedelic. The band has a lot of time on their hands, and since 2012, they have recorded twenty studio albums, five official live albums, and four EPS, each of which have different sounds, while still sticking to their roots and trademark songwriting motifs. They released it on Bandcamp, so people could stream the entire thing before they buy it. It was inspired by Surf Rock and Garage Rock, with King Gizzard giving those sounds a psychedelic flair. Around a year later, they would self-record their first full-length album, 12 Bar Bruise. The second Willoughby's Beach EP, was what got them noticed in Australia, and got them chosen to play at the Meredith Music Festival in December of that year. The three, whilst once unavailable publically, are now available on the Bandcamp-exclusive release: Teenage Gizzard.
One release from the following year, called Anglesea, was a four track EP released on CD. They started releasing material in 2010, with 2 singles.