Agarose is known to form a homogeneous thermoreversible gel in an aqueous medium over a critical polymer concentration. The solid-liquid phase transitions are thermoreversible but depend on the molecular structure of the agarose sample tested. The literature has mentioned that agarose gels could remain stable in non-solvents such as acetone or ethanol. However, there has been no characterization of their behavior nor a comparison with the gels formed in a good solvent such as water. In the first step of this article, the structure was characterized using1H and13C NMR in both D2O and DMSO-d6solvents. DMSO is a solvent that dissolves agarose regardless of the temperature. First, we have determined a low yield of methyl substitution on the D-galactose unit. Then, the evolution of the1H NMR spectrum was monitored as a function of temperature during both increasing and decreasing temperature processes, ranging from 25 to 80 °C. A large thermal hysteresis was obtained and discussed, which aided in the interpretation of rheological behavior. The hysteresis of NMR signals is related to the mobility of the agarose chains, which follows the sol/gel transition depending on the chains’ association with H-bonds between water and the -OH groups of agarose for tightly bound water and agarose/agarose in chain packing. In the second step of the study, the water in the agarose gel was exchanged with ethanol, which is a non-solvent for agarose. The resulting gel was stable, and its properties were characterized using rheology and compared to its behavior in aqueous media. The bound water molecules that act as plasticizers were likely removed during the exchange process, resulting in a stronger and more brittle gel in ethanol, with higher thermal stability compared to the aqueous gel. It is the first time that such gel is characterized without phase transition when passing from a good solvent to a non-solvent. This extends the domains of application of agarose.