Baker began painting as a way to preserve his stories and culture. Because he was a "ngangkaṟi", he knew more about his country's sacred Dreaming stories than most. His paintings represent stories from the time of creation that dictate sacred law ("Tjukurpa") for Pitjantjatjara people. Although he began very late in life, his paintings quickly became well known. The first major exhibition to show his work was an annual group exhibition called "Desert Mob", in Alice Springs. It first featured his work in 2005, and again every year after that until 2009. In 2007, Baker was one of thirty artists featured in the first National Indigenous Art Triennial exhibition "Culture Warriors". It showed three of his paintings: "Katatjita" (2006), "Wanampi Kutjara" (2006) and "Piltati" (2007). He was interviewed on South Australian television, speaking through a translator.