It is Labor Day, and everyone is preparing for a neighborhood picnic. Hal Carter, a drifter, arrives in town looking for work and visits his college friend Alan, who is dating Madge Owens with the intent to marry her. Hal does odd jobs for the welcoming Helen Potts. Her neighbor, Flo Owens, distrusts Hal, especially around her daughters, Madge and Millie. Since shy Millie does not have a date, neighbor Mrs. Potts suggests that Hal accompany her, much to the chagrin of Flo. Hal agrees, but he is much more interested in Madge. There is an undeniable attraction between the two, as much as they try to fight it. While getting ready for the picnic, the family and friends dance in Flo's backyard to music playing nearby. Hal grows on both Millie and Madge, and they both vie for his attention. Rosemary, an "old maid schoolteacher" who boards at the Owens house, notices, disapproves, and is attracted to the shirtless Hal as she waits for her Labor Day date, local shop proprietor Howard Bevans. As Madge and Hal dance passionately, and a drunken Rosemary later butts in so she can dance with Hal (and proceeds to rip his shirt when Howard pries her away from Hal), Millie gets sick from drinking too much whiskey while no one is paying attention. Rosemary blames Millie's drinking on her date with Hal, and says he'll never rise beyond the gutter, and Flo joins in criticizing him.