2.3.2. Sentiment Coding Training and Procedures
For the purposes of this study, coders manually read through each participant’s statement and assigned ratings indicating if the sentiments written by the participant described a positive, negative, mixed, or neutral (i.e., no change) impact from COVID-19. Two independent coders were trained to conduct sentiment rating. Training continued until coders reached a reliability of at least 80% over five practice trials. Any discrepancies during training were brought back to the investigators for clarification. Coders then began assigning independent ratings of each statement using the following sequence: First, each statement was coded for an Overall Impact sentiment rating. Next, each statement was reviewed again to evaluate the presence of each theme and the specific sentiment attributed to each theme. In this way, coders determined if the theme was present in the statement. Then, if present, coders identified the sentiment in the specific statement(s) associated with the individual theme. Finally, any rating discrepancy between coders was reviewed by a third independent coder to determine the final rating decision. This sequential process assured standardization and reliability among coders.