Was Jesus speaking nonsense when he taught that whoever divorces his wife and marries another commits adultery as does anyone who marries a divorced woman?  Your problem isn't with infallibility, but with Jesus' teaching in the Gospel.