Tau aggregation is central to the pathogenesis of a large group of neurodegenerative diseases termed tauopathies, but it is still unclear in which way neurons respond to tau pathology and how tau accumulation leads to neurodegeneration. A striking neuron-specific response to tau pathology is presented by granulovacuolar degeneration bodies (GVBs), lysosomal structures that accumulate specific cargo in a dense core. Here we employed different tau aggregation models in primary neurons to investigate which properties of pathological tau assemblies affect GVB accumulation using a combination of confocal microscopy, transmission electron microscopy, and quantitative automated high-content microscopy. Employing GFP-tagged and untagged tau variants that spontaneously form intraneuronal aggregates, we induced pathological tau assemblies with a distinct subcellular localization, morphology, and ultrastructure depending on the presence or absence of the GFP tag. The quantification of the GVB load in the different models showed that an increased GVB accumulation is associated with the untagged tau aggregation model, characterized by shorter and more randomly distributed tau filaments in the neuronal soma. Our data indicate that tau aggregate structure and/or subcellular localization may be key determinants of GVB accumulation.