Multiple responsive hydrogels are usually constructed by the addition of many different functional groups. Generally, these groups have different responsive behaviors which lead to interleaved and complex modes of the multi-response system. It is difficult to get a practical application. In this study, we show that multi-response hydrogels can also be constructed using dynamic bonds as crosslinks. The multiple responsive hydrogel films with thicknesses on the sub-micrometer or micrometer scale can be fabricated from P(DMAA-3-AAPBA), a copolymer of N,N-dimethylacrylamide, 3-(acrylamido)phenylboronic acid, and poly(vinylalcohol) (PVA) though a simple layer-by-layer (LbL) technique. The driving force for the film build up is the in situ-formed phenylboronate ester bonds between the two polymers. The films exhibit Fabry–Perot fringes on their reflection spectra which can be used to calculate the equilibrium swelling degree (SDe) of the film so as to characterize its responsive behaviors. The results show that the films are responsive to temperature, glucose, and fructose with simple and practical linear response modes. More importantly, the speed of which the films respond to glucose or fructose is quite fast, with characteristic response times of 45 s and 7 s, respectively. These quick response films may have potential for real-time, continuous glucose or fructose monitoring. With the ability to bind with these biologically important molecules, one can expect that hydrogels may find more applications in biomedical areas in the future.