The aim of the study was to analyze the influence of mullein flower extract addition on the oxidative stability and antioxidant activity of cold-pressed oils with a high content of unsaturated fatty acids. The conducted research has shown that the addition of mullein flower extract increases the oxidative stability of oils, but its addition depends on the type of oil and should be selected experimentally. In rapeseed and linseed oil, the best stability was found for samples with 60 mg of extract/kg of oil, while in chia seed oil and hemp oil, it was found with 20 and 15 mg of extract/kg of oil, respectively. The hemp oil exhibited the highest antioxidant properties, as evidenced by an increase in the induction time at 90 °C from 12.11 h to 14.05 h. Additionally, the extract demonstrated a protective factor of 1.16. Oils (rapeseed, chia seed, linseed, and hempseed) without and with the addition of mullein extract (2–200 mg of extract/kg of oil) were analyzed for oxidative stability, phenolic compounds content, and antioxidant activity using DPPH•and ABTS•+radicals. After the addition of the extract, the oils had from 363.25 to 401.24 mg GAE/100 g for rapeseed oil and chia seed oil, respectively. The antioxidant activity of the oils after the addition of the extract ranged from 102.8 to 221.7 and from 324.9 to 888.8 µM Trolox/kg for the DPPH and ABTS methods, respectively. The kinetics parameters were calculated based on the oils’ oxidative stability results. The extract increased the activation energy (Ea) and decreased the constant oxidation rate (k).