Fidelity and Quality
Fidelity and quality were collected via two methods: (1) independent observations and (2) facilitator self-assessments. For peer group lessons, observations were conducted in person. Lessons were randomly selected to be observed with each classroom being observed at least once during the 8-lesson program. To observe lessons, a study staff member or student sat in on the class and, utilizing a written copy of the curriculum, completed a program observation form. For parent-youth lessons, lessons were randomly chosen to be audio recorded or directly observed. It was determined that in-person observations were sometimes inappropriate given the sensitive nature of the 9th lesson and the intimate environment in which it was delivered (participant’s home with youth and trusted adult); thus, the participant was given the option of in-person observation vs. audio. Audio recordings were uploaded to a secure webserver and listened to by an observer who completed an observation form. All observation forms were lesson specific and included information about the completion of each activity (was it completed and was it completed as intended or adapted) as well as the quality of program delivery. All observers completed a 2-h training in use of the observation form and the program manager reviewed all observation forms for completeness. Once reviewed, the data coordinator entered information from the observation forms into an Excel file. Data was aggregated and summarized to establish average fidelity and quality across all observations.Facilitators completed a self-assessment immediately after completing each peer group lesson. To reduce staff burden, self-assessments were only completed for the first three parent-youth lessons completed. The facilitator self-assessment asked facilitators to provide information about quality and fidelity of the delivery of the program. All assessments were collected by the data coordinator who entered the information into an Excel file. Data was aggregated and summarized to establish average fidelity and quality across all observations.