After the seed pods form, wait for them to develop and eventually dry out and turn brown. That's when they're ready to be harvested.
[header] How to grow rosemary from seed [title] Watch for the seed pods to form and dry out. [step] A rosemary plant will produce flowers in spring or summer. When the flowers die back, seed pods will grow in their place.