Ullman is an accomplished musician and plays drums and guitar. He has worked as a touring musician, notably with Soko on her 2012 tour. Ullman was a member of the band Reputante, which released their 2013 debut on Julian Casablancas' record label Cult Records. He departed the band sometime in 2015. With Reputante members James Levy and Jimmy Giannopoulos, Ullman helped form the band Lolawolf with actress Zoë Kravitz. They released their self-titled debut EP on February 4, 2014. He left Lolawolf before the release of their first full-length record, "Come Down", in October 2014.