The weak point of ionic liquids is their high viscosity, limiting the maximum polymer concentration in the forming solutions. A low-viscous co-solvent can reduce viscosity, but cellulose has none. This study demonstrates that dimethyl sulfoxide (DMSO), being non-solvent for cellulose, can act as a nominal co-solvent to improve its processing into a nanofiltration membrane by phase inversion. A study of the rheology of cellulose solutions in diluted ionic liquids ([EMIM]Ac, [EMIM]Cl, and [BMIM]Ac) containing up to 75% DMSO showed the possibility of decreasing the viscosity by up to 50 times while keeping the same cellulose concentration. Surprisingly, typical cellulose non-solvents (water, methanol, ethanol, and isopropanol) behave similarly, reducing the viscosity at low doses but causing structuring of the cellulose solution and its phase separation at high concentrations. According to laser interferometry, the nature of these non-solvents affects the mass transfer direction relative to the forming membrane and the substance interdiffusion rate, which increases by four-fold when passing from isopropanol to methanol or water. Examination of the nanofiltration characteristics of the obtained membranes showed that the dilution of ionic liquid enhances the rejection without changing the permeability, while the transition to alcohols increases the permeability while maintaining the rejection.