The first proper album that The Wedding Present recorded for their new label was released in the same year 1989 and reunited them with producer Chris Allison. "Bizarro"’s lyrical themes were largely the same as before and the songs featured the same three-chord structures, but its production values had increased due to a larger recording budget. The album was recorded at Jacobs Studios by Steve Lyon and mixed by him and Chris Allison. The album's companion single, "Kennedy", provided the band with their first British Top 40 hit. Seeing that they were growing more popular in the American college radio scene, the band turned towards America for their next project. The band decided to re-record "Bizarro" track "Brassneck" with the former Big Black frontman Steve Albini. It was the start of a two-year collaboration: the next single, "Corduroy" and album, "Seamonsters", were also recorded by Albini at Pachyderm Recording Studio in Cannon Falls, Minnesota.