In 1496, Stoss returned to Nuremberg with his wife and eight children. He reacquired his citizenship for three gulden and resumed his work there as a sculptor. Between 1500 and 1503 he carved an altar, now lost, for the parish church of Schwaz, Tyrol of the "Assumption of Mary". In 1503, he was arrested for forging the seal and signature of a fraudulent contractor and was sentenced to be branded on both of his cheeks and prohibited from leaving Nuremberg without the explicit permission of the city council. He was pardoned in 1506 by Emperor Maximilian and restored of his civil rights.