Two things are true of all immoral actions  First, if they are performed in public, they offend public sensibilities
Second, they are accompanied by feelings of guilt
Some actions that offend public sensibilities if they are performed in public are not accompanied by feelings of guilt.