Electric Six are a Detroit garage-rock-punk-disco band, even though they sound deliberately RP British in this tune. Well, British over a killer punk riff, I mean. Wikipedia tells us that the lead singer claims the song arose from a mondegreen of Devo's "Girl U Want" that he heard as "just a girl, just a girl at a gay bar" while the song was playing in a very loud nightclub. (The actual lyric is "She's just the girl, she's just the girl, the girl you want".)
Oddly enough, the lyrics "Let's start a war…start a nuclear war…" were censored in 2003 since the Iraq war had just begin, whereas the ultra-suggestive "I've got something to put in you" was left alone. Hey, I happen to think war is more obscene than sex, too.