The discovery of bioactive compounds from medicinal plants has played a crucial role in drug discovery. In this study, a simple and efficient method utilizing affinity-based ultrafiltration (UF) coupled with high-performance liquid chromatography (HPLC) was developed for the rapid screening and targeted separation of α-glucosidase inhibitors fromSiraitia grosvenoriiroots. First, an active fraction ofS. grosvenoriiroots (SGR2) was prepared, and 17 potential α-glucosidase inhibitors were identified based on UF-HPLC analysis. Second, guided by UF-HPLC, a combination of MCI gel CHP-20P column chromatography, high-speed counter-current countercurrent chromatography, and preparative HPLC were conducted to isolate the compounds producing active peaks. Sixteen compounds were successfully isolated from SGR2, including two lignans and fourteen cucurbitane-type triterpenoids. The structures of the novel compounds (4,6,7,8,9, and11) were elucidated using spectroscopic methods, including one- and two-dimensional nuclear magnetic resonance spectroscopy and high-resolution electrospray ionization mass spectrometry. Finally, the α-glucosidase inhibitory activities of the isolated compounds were verified via enzyme inhibition assays and molecular docking analysis, all of which were found to exhibit certain inhibitory activity. Compound14exhibited the strongest inhibitory activity, with an IC50value of 430.13 ± 13.33 μM, which was superior to that of acarbose (1332.50 ± 58.53 μM). The relationships between the structures of the compounds and their inhibitory activities were also investigated. Molecular docking showed that the highly active inhibitors interacted with α-glucosidase through hydrogen bonds and hydrophobic interactions. Our results demonstrate the beneficial effects ofS. grosvenoriiroots and their constituents on α-glucosidase inhibition.