"BUT" OF COURSE: This current pop duo took its name from a store that would sell almost any item