Diabetes mellitus (DM) has become the world’s third major disease after tumors and cardiovascular disease. With the exploitation of marine biological resources, the efficacy of using polysaccharides isolated from marine organisms in blood glucose regulation has received widespread attention. Some marine polysaccharides can reduce blood glucose by inhibiting digestive enzyme activity, eliminating insulin resistance, and regulating gut microbiota. These polysaccharides are mainly fucose-containing sulphated polysaccharides from algae and sea cucumbers. It follows that the hypoglycemic activity of marine fucosyl-polysaccharides is closely related to their structure, such as their sulfate group, monosaccharide composition, molecular weight and glycosidic bond type. However, the structure of marine fucosyl-polysaccharides and the mechanism of their hypoglycemic activity are not yet clear. Therefore, this review comprehensively covers the effects of marine fucosyl-polysaccharides sources, mechanisms and the structure–activity relationship on hypoglycemic activity. Moreover, the potential regulatory effects of fucosyl-polysaccharides on vascular complications caused by hyperglycemia are also summarized in this review. This review provides rationales for the activity study of marine fucosyl-polysaccharides and new insights into the high-value utilization of marine biological resources.