Impact of a medical journal club on house-staff reading habits, knowledge, and critical appraisal skills. A randomized control trial. Teaching practicing surgeons critical appraisal skills with an Internet-based journal club: A randomized, controlled trial.
The journal club is an established teaching modality in many house-staff training programs. To determine if a journal club improves house-staff reading habits, knowledge of epidemiology and biostatistics, and critical appraisal skills, we randomized 44 medical interns to receive either a journal club or a control seminar series. A test instrument developed by the Delphi method was administered before and after the interventions (mean, five journal club sessions). By self-report, 86% of the house staff in the journal club group improved their reading habits vs 0% in the control group. Knowledge scores increased more in the journal club group than in the control group, and a trend was found toward more knowledge gained as more sessions were attended. Ability to appraise critically a test article increased slightly in each group, but there was no significant difference between the groups. We conclude that a journal club is a powerful motivator of critical house-staff reading behavior and can help teach epidemiology and biostatistics to physicians-in-training. The effectiveness of interventions for developing critical appraisal skills in practicing physicians has not been studied, despite the documented importance of reading the literature in caring for patients and in continuing professional development. The objective of this study was to evaluate whether an Internet-based intervention would lead to enhanced critical appraisal skills in practicing surgeons.
                General surgeons who agreed to participate were randomized into 2 groups. The intervention was a curriculum in critical appraisal skills that included a clinical and methodologic article, a listserve discussion, and clinical and methodologic critiques. The control group received only the clinical articles. The primary outcome measure was a previously validated 2-hour test of critical appraisal.
                Of the 55 surgeons who completed the examination, subjects in the intervention group performed better on the test of critical appraisal skills than those in the control group (mean score: intervention group, 58% +/- 8 vs control group, 50% +/- 8), with a large effect size of 1.06 standard deviation units (t+3.92, P <.0001). Training conditions accounted for 22% of the variance in total scores.
                A multifaceted, Internet-based intervention resulted in improved critical appraisal skills of practicing general surgeons.
Low-intensity critical appraisal teaching interventions in healthcare populations may result in modest gains. Improvements to research examining the effectiveness of interventions in healthcare populations are required; specifically rigorous randomised trials employing interventions using appropriate adult learning theories.