dammit why didn't I think of that! Thanks. If I wanted slower learning in some layers though what you have in the first comment would be the way right? technically I should be able to freeze as well. Basically just make the update be 'no update' in lower layers? 