Guerilla Toss were founded in Boston in 2010 by drummer Peter Negroponte, guitarist Arian Shafiee, and several other students of the contemporary improvisation department of the New England Conservatory of Music. This instrumental, free jazz-influenced iteration of the group released a handful of limited cassettes on labels like Digitalis and Sludgesicle Records. After playing a house show with hardcore band Western Syndrome, the group's vocalist, Kassie Carlson, joined Guerilla Toss in 2012. Her first releases with the band included the live cassette My Real Dad (Spooky Town Records) and studio LP Jeffrey Johnson (Feeding Tube Records), both of which were released in late 2012.
Guerilla Toss began attracting a following outside of their Boston home base, with Brooklyn magazine The Deli naming them the Best Emerging New England Band of 2012. In 2013, John Zorn's Tzadik label released Guerilla Toss' self-titled CD, and Kicked Back into the Crypt, a split LP with no wave revivalists Sediment Club, was co-released by Feeding Tube and Sophomore Lounge. Also appearing in 2013 was Gay Disco, an LP released by NNA Tapes, whose co-founder Toby Aronson would briefly join the group the following year. This album marked Guerilla Toss' shift toward a more danceable sound, which they further developed on the 2014 EPs 367 Equalizer and Smack the Brick.
In 2015, the members of Guerilla Toss relocated to Brooklyn. They signed with DFA Records, which issued the group's Flood Dosed EP near the end of the year. The full-length Eraser Stargazer followed in 2016, as did Live in Nashville and the remix EP Giant Claw vs. Guerilla Toss. GT Ultra, a much poppier, more focused Guerilla Toss full-length, appeared in 2017. Another remix EP, this time by experimental dub artist Jay Glass Dubs, followed later in the year. After bassist Stephe Cooper (of Cloud Becomes Your Hand) joined the group in early 2018, Guerilla Toss released Twisted Crystal, their most new wave-influenced album yet. The band returned to NNA in 2019 with the EP What Would the Odd Do? A 7" titled "Human Girl" was released as part of Sub Pop's singles club in 2020. In 2022, the label issued the band's next album, Famously Alive, an overtly optimistic set of noisy pop songs with Auto-Tuned vocals and radio-friendly melodies. ~ Paul Simpson, Rovi