Only after a shot from the opposing team, can you pass back to the keepers hands inside your third line.
You can only pass the ball back to the goalkeeper after a shot from the opposing team has been taken, and this occurs when the ball reaches your third defensive line.