(1) Background: Ongoing symptoms after mild or moderate acute coronavirus disease 19 (COVID-19) substantially affect health-related quality of life (HRQoL). However, follow-up data on HRQoL are scarce. We characterized the change in HRQoL over time in post-COVID-19 patients who initially suffered from mild or moderate acute COVID-19 without hospitalization. (2) Methods: Outpatients who visited an interdisciplinary post-COVID-19 consultation at the University Hospital Zurich and suffered from ongoing symptoms after acute COVID-19 were included in this observational study. HRQoL was assessed using established questionnaires. Six months after baseline, the same questionnaires and a self-constructed questionnaire about the COVID-19 vaccination were distributed. (3) Results: In total, 69 patients completed the follow-up, of whom 55 (80%) were female. The mean (SD) age was 44 (12) years and the median (IQR) time from symptom onset to completing the follow-up was 326 (300, 391) days. The majority of patients significantly improved in EQ-5D-5L health dimensions of mobility, usual activities, pain and anxiety. Furthermore, according to the SF-36, patients showed clinically relevant improvements in physical health, whereas no significant change was found regarding mental health. (4) Conclusions: Physical aspects of HRQoL in post-COVID-19 patients relevantly improved over 6 months. Future studies are needed to focus on potential predictors that allow for establishing individual care and early interventions.