In June 2006, Ullman and a few of his friends created parody hip-hop music videos under the name the Webee Boys. In December 2006, Ullman met actor Douglas Smith of "Big Love" fame and together they formed a band called Goodbye Ian. The group expanded to as many as seven people and later changed its name to His Orchestra. Ullman plays drums and glockenspiel in the band, which released its debut album, "Field Guide to the Wilds", on February 24, 2009.