The line expands on his character's comment to his daughter in the musical Poppy (1923): "Let me give you just one bit of fatherly advice: Never give a sucker an even break." (This is the title of a subsequent Fields film, made in 1941.)
The line, which appears in the musical "Poppy" (1923), serves as a foundation for a subsequent Fields film with the same title.