the effect of the usb syllabus on resident education was assessed in a prospective observational cohort pilot study .
the institutional review board approved the study and informed consent was obtained from study participants .
the residency program in internal medicine at the jhbmc is an accreditation council for graduate medical education ( acgme ) accredited university - based training program that had 53 house officers during the academic year 20062007 ( table 1 ) .
the stated goal of the residency program is  to develop healers and leaders in medicine. all 53 residents of the jhbmc internal medicine residency program received a 256 mb usb drive with a hyperlinked electronic syllabus . 
 
characteristics of the study population ( n = 53 ) the usb syllabus contained links to 187 primary scientific research articles .
the links to the full - text articles were organized on the usb drive using an html webpage with a table of contents with 14 headings according to medical subspecialties ( e.g. , cardiology , endocrinology , etc . ) .
the headings of the table of content were hyperlinked to specific heading locations on the html webpage , where each medical subspecialty was then divided into 212 context - related subheadings ( e.g. , cardiology had the subheadings atrial fibrillation , congestive heart failure , etc . ) .
the titles of the individual articles were organized under the subheadings on the html webpage and provided the hyperlink to the full - text article in pdf format in the medical school 's digital library .
the individual user could download the full - text article in pdf format using a structured folder system on the usb drive , resembling the headings and subheadings of the html webpage , to organize the downloaded primary and secondary scientific research articles . to comply with copyright regulations , the full - text pdf documents
once the article was downloaded and stored in the pre - organized folder system , it could be used on any computer ( e.g. , at home ) and its use was not dependent on internet access .
one author ( m.e . ) surveyed local experts , senior faculty members in the department of medicine at the johns hopkins university school of medicine .
the experts were asked to recommend the most influential and commonly cited primary and secondary research articles related to their field of specific expertise .
the usb drives were usable at every usb port of any computer at jhbmc and the syllabus could be expanded and edited by the individual learner .
the structured folder system was constructed in a way to allow for both expansion of the literature collection and for keeping track of reading progress .
trainees were also encouraged to save other important information related to the acquisition of clinical competence on the  my portfolio section of the usb including : ( a ) interesting patients seen , ( b ) presentations given , and ( c ) procedures performed .
housestaff filled out a brief baseline survey before receiving the usb drive in september 2006 .
the baseline survey included questions pertaining to the following areas : ( a ) four demographic questions , ( b ) two questions about their reading of primary medical literature , and ( c ) seven questions related to the use of computers , usb drives , and use of educational resources .
most questions had likert scale response options . at the conclusion of the study period in may 2007 ,
the end - of - study survey primarily asked participants about ( a ) their reading of primary medical literature , ( b ) their use of and experiences with the usb syllabus , and ( c ) suggestions about ways to improve the usb syllabus . for each variable , we examined frequency of responses to look for irregularities in the distribution of responses . for the continuous variables , distributions and
descriptive statistics were examined for evidence of skewness , outliers , and non - normality to ensure the appropriate use of parametric statistical tests .
comparisons of the data from before and after the  usb syllabus intervention were examined using t - tests and the wilcoxon signed - rank test .
data were analyzed using stata 8.0 ( stata corp . , college station , tx , usa ) .
the effect of the usb syllabus on resident education was assessed in a prospective observational cohort pilot study .
the institutional review board approved the study and informed consent was obtained from study participants .
the residency program in internal medicine at the jhbmc is an accreditation council for graduate medical education ( acgme ) accredited university - based training program that had 53 house officers during the academic year 20062007 ( table 1 ) .
the stated goal of the residency program is  to develop healers and leaders in medicine. all 53 residents of the jhbmc internal medicine residency program received a 256 mb usb drive with a hyperlinked electronic syllabus . 
 
the usb syllabus contained links to 187 primary scientific research articles . the links to the full - text articles
were organized on the usb drive using an html webpage with a table of contents with 14 headings according to medical subspecialties ( e.g. , cardiology , endocrinology , etc . ) .
the headings of the table of content were hyperlinked to specific heading locations on the html webpage , where each medical subspecialty was then divided into 212 context - related subheadings ( e.g. , cardiology had the subheadings atrial fibrillation , congestive heart failure , etc . ) .
the titles of the individual articles were organized under the subheadings on the html webpage and provided the hyperlink to the full - text article in pdf format in the medical school 's digital library .
the individual user could download the full - text article in pdf format using a structured folder system on the usb drive , resembling the headings and subheadings of the html webpage , to organize the downloaded primary and secondary scientific research articles . to comply with copyright regulations , the full - text pdf documents
once the article was downloaded and stored in the pre - organized folder system , it could be used on any computer ( e.g. , at home ) and its use was not dependent on internet access .
one author ( m.e . ) surveyed local experts , senior faculty members in the department of medicine at the johns hopkins university school of medicine .
the experts were asked to recommend the most influential and commonly cited primary and secondary research articles related to their field of specific expertise .
the usb drives were usable at every usb port of any computer at jhbmc and the syllabus could be expanded and edited by the individual learner .
the structured folder system was constructed in a way to allow for both expansion of the literature collection and for keeping track of reading progress .
trainees were also encouraged to save other important information related to the acquisition of clinical competence on the  my portfolio section of the usb including : ( a ) interesting patients seen , ( b ) presentations given , and ( c ) procedures performed .
housestaff filled out a brief baseline survey before receiving the usb drive in september 2006 .
the baseline survey included questions pertaining to the following areas : ( a ) four demographic questions , ( b ) two questions about their reading of primary medical literature , and ( c ) seven questions related to the use of computers , usb drives , and use of educational resources .
most questions had likert scale response options . at the conclusion of the study period in may 2007 ,
the end - of - study survey primarily asked participants about ( a ) their reading of primary medical literature , ( b ) their use of and experiences with the usb syllabus , and ( c ) suggestions about ways to improve the usb syllabus .
for each variable , we examined frequency of responses to look for irregularities in the distribution of responses . for the continuous variables , distributions and descriptive statistics
were examined for evidence of skewness , outliers , and non - normality to ensure the appropriate use of parametric statistical tests .
comparisons of the data from before and after the  usb syllabus intervention were examined using t - tests and the wilcoxon signed - rank test .
data were analyzed using stata 8.0 ( stata corp . , college station , tx , usa ) .
forty - five of the 53 ( 85% ) house officers at jhbmc completed the baseline survey .
the majority of internal medicine house officers at jhbmc are planning a career in academic medicine ( 80% ) , most as clinical investigators ( 69% ) ( table 2 ) . 
 
baseline characteristics of the 45 respondents almost all house officers ( 89% ) had been using usb drives , and most ( 95% ) affirmed that computer - based learning is valuable in medical education . with respect to the perceived  educational value of resources at their disposal , at baseline ( prior to the intervention ) house officers rated electronic resources like  uptodate as most valuable ( mean 4.7 , sd 0.8 , on a five - point likert scale with 1 = useless and 5 = excellent ) .
good ( mean 3.6 , sd 0.8 ) and textbooks were rated the least favorable ( mean 3.1 , sd 1.2 ) . at the conclusion of the nine - month study period , 50 of 53 ( 94% )
two of the 50 house officers ( 4% ) lost their usb syllabus during the study period and both were given a replacement . in characterizing their experience , 45 of 50 house officers ( 90% ) strongly agreed with the following : 
i liked the idea that i was given the usb syllabus. when asked , if their time using the usb syllabus was well spent , 80% agreed or strongly agreed .
forty - nine of 50 house officers ( 98% ) disagreed or strongly disagreed that there were technical difficulties using the usb syllabus .
most house officers ( 86% ) agreed or strongly agreed that the usb syllabus met their educational needs . similarly ,
90% agreed or strongly agreed that the usb syllabus stimulated them to read more primary literature . when asked whether the usb syllabus helped them to take better care of patients , 88% agreed or strongly agreed .
as 45 residents had filled out the baseline survey and 50 residents the post - intervention survey , we were able to compare pre- and post - surveys for 45 residents .
self - reported original articles read by housestaff increased from 3.4 per month at baseline to 4.5 per month by the end of the nine - month study period , p < 0.005 ( table 3 ) . 
 
number of original articles read ( n=45 ) note : number of original articles read by trainee per month according to level of training .
the comparison between baseline survey and post - intervention survey was available for 45 residents .
sixteen of the 45 ( 45% ) increased their self - reported reading of original medical papers by more than three articles per month .
post - graduate year 1 ( pgy-1 ) level trainees showed the greatest self - reported increase in original articles read per month , from 2.0 to 3.2 per month , p = 0.01 .
housestaff rated original articles as being more valuable to them for the acquisition of knowledge after being exposed to this intervention as compared to baseline ( p < 0.005 ) ( fig .
rating of the value of specific educational resources with respect to the trainees ' acquisition of knowledge at baseline and at the end of the study period ( mean values ) .
the comparison between baseline survey and post - intervention survey was available for 45 residents .
review articles also were rated higher ( p = 0.02 ) , whereas the perceived value of other educational resources ( electronic media like  uptodate ( p = 0.09 ) and textbooks ( p=0.18 ) ) did not change significantly . selected comments to an open - ended question are presented below .
all comments were positive and spoke to the usefulness and merit of the usb syllabus.this is an awesome resource ! 

i do n't think i can do without this tool , now that i have it .
! often referred to it to find useful articles on common topics for my own benefit and for teaching medical students . 

i wish someone had thought of this sooner ! 
 the introduction of the usb syllabus was a fantastic idea that should definitely be perpetuated . 
 
i do n't think i can do without this tool , now that i have it .
! often referred to it to find useful articles on common topics for my own benefit and for teaching medical students .
i wish someone had thought of this sooner ! the introduction of the usb syllabus was a fantastic idea that should definitely be perpetuated .
at the conclusion of the nine - month study period , 50 of 53 ( 94% ) house officers completed the end of study survey . all 50 respondents ( 100% ) reported using the usb syllabus .
two of the 50 house officers ( 4% ) lost their usb syllabus during the study period and both were given a replacement . in characterizing their experience , 45 of 50 house officers ( 90% ) strongly agreed with the following : 
i liked the idea that i was given the usb syllabus. when asked , if their time using the usb syllabus was well spent , 80% agreed or strongly agreed .
forty - nine of 50 house officers ( 98% ) disagreed or strongly disagreed that there were technical difficulties using the usb syllabus .
most house officers ( 86% ) agreed or strongly agreed that the usb syllabus met their educational needs . similarly ,
90% agreed or strongly agreed that the usb syllabus stimulated them to read more primary literature . when asked whether the usb syllabus helped them to take better care of patients , 88% agreed or strongly agreed .
as 45 residents had filled out the baseline survey and 50 residents the post - intervention survey , we were able to compare pre- and post - surveys for 45 residents .
self - reported original articles read by housestaff increased from 3.4 per month at baseline to 4.5 per month by the end of the nine - month study period , p < 0.005 ( table 3 ) . 
 
number of original articles read ( n=45 ) note : number of original articles read by trainee per month according to level of training .
the comparison between baseline survey and post - intervention survey was available for 45 residents .
sixteen of the 45 ( 45% ) increased their self - reported reading of original medical papers by more than three articles per month .
post - graduate year 1 ( pgy-1 ) level trainees showed the greatest self - reported increase in original articles read per month , from 2.0 to 3.2 per month , p = 0.01 .
housestaff rated original articles as being more valuable to them for the acquisition of knowledge after being exposed to this intervention as compared to baseline ( p < 0.005 ) ( fig .
rating of the value of specific educational resources with respect to the trainees ' acquisition of knowledge at baseline and at the end of the study period ( mean values ) .
the comparison between baseline survey and post - intervention survey was available for 45 residents .
review articles also were rated higher ( p = 0.02 ) , whereas the perceived value of other educational resources ( electronic media like  uptodate ( p = 0.09 ) and textbooks ( p=0.18 ) ) did not change significantly . selected comments to an open - ended question are presented below .
all comments were positive and spoke to the usefulness and merit of the usb syllabus.this is an awesome resource ! 

i do n't think i can do without this tool , now that i have it .
! often referred to it to find useful articles on common topics for my own benefit and for teaching medical students . 

i wish someone had thought of this sooner ! 
 the introduction of the usb syllabus was a fantastic idea that should definitely be perpetuated . 
 
i do n't think i can do without this tool , now that i have it .
! often referred to it to find useful articles on common topics for my own benefit and for teaching medical students .
the introduction of the usb syllabus was a fantastic idea that should definitely be perpetuated .
in this pilot study of internal medicine house officers who were given a usb syllabus with pertinent research articles , it appears as if the intervention may have stimulated trainees to read more original articles .
in addition to reading more landmark studies that had been chosen by senior clinicians because of their clinical relevance , house officers developed a newfound appreciation of the educational value of original research articles .
all respondents were using the usb syllabus making it , percentage - wise , a highly accepted electronic medical education resource , comparing favorably to the use of electronic educational resources reported in the literature .
kabrhel and colleagues reported on an online collection of emergency medicine literature for their trainees and showed that one month after its installation , 34% of residents were actively using the web - based electronic syllabus ( 6 ) . using a similar approach , tannery et al .
reported on an educational website developed as an adjunct education resource for a community and ambulatory medicine clerkship that included links to influential full - text journal articles and web resources ( 7 ) .
in contrast to these web - based educational interventions , the usb drive has several advantages : ( a ) favorite articles can be saved and read even without internet and server access , ( b ) the collection can be expanded and edited by the individual learner , and ( c ) other clinically relevant materials and information can be saved on it .
the cohort of house officers in our study was comfortable with and frequently used electronic resources for their learning needs .
this is in line with the reports by others and speaks to the technological sophistication of contemporary trainees ( 8 , 9 ) .
lai studied reading habits in primary care internal medicine residents and noted that electronic materials were the most commonly used educational media : 98% reported using resources like  uptodate regularly ( 8) . resources like  uptodate or emedicine , while wonderfully valuable and superb for finding answers or guidance efficiently , do not involve critical appraisal and do not challenge house officers to extract the relevant clinical messages .
studies have shown that trainees primarily go to these authoritative resources , rather than original research articles , to answer their clinical questions ( 8 , 10 ) and that time constraint is the primary obstacle related to evidence - based practice ( 11 , 12 ) .
the usb syllabus described herein may have affected the concerns about efficiency , possibly because of its organization and the effort that went into article selection .
if these factors were responsible for the residents ' increased reading of the primary medical literature , the syllabus has realized its primary goal .
the usb syllabus was organized by specialty around common clinical questions in an easy to use format .
the prepared format also provided trainees with an information management framework that allowed them to systematically keep track of their reading and learning .
the house officers in our study felt that their time using the usb syllabus was well spent .
developing effective reading habits during residency may very well continue throughout these physicians ' professional lives .
the usb syllabus has the potential to have a positive influence on their approach to lifelong learning and information management ( 3 ) .
first , this study relied exclusively on self - report and we were unable to actually observe the trainees ' reading practices and patterns .
second , our study design was observational and thus the findings in this paper represent associations rather than causality .
as all residents received the usb syllabus , we can not test the educational effect against a control group . while some comments to the investigators during the study period make us believe that the increased reading of original research articles was because of the usb syllabus
it is not possible to differentiate the effect of nine months of clinical training ( study period ) on reading habits of the housestaff from the educational impact of the usb syllabus .
the curricula of the pgy-1 , pgy-2 , and pgy-3 year in the residency program at jhbmc differ significantly ( pgy  post - graduate year ) .
the pgy-1 year in general has the longest working hours and least amount of elective time . in the pgy-2 and
more so in the pgy-3 year the elective time increases and average working hours decrease .
this difference in available time to read literature could explain why the post - intervention pgy-1 group was found to read fewer articles than the pre - intervention pgy-2 group ( the baseline reading assessment was performed three months after the start of the academic year ) .
third , reading more original medical literature by itself may not necessarily translate into practicing evidence - based medicine .
windish and colleagues have found that some residents lack knowledge in biostatistics that may be needed to interpret published clinical research ( 13 ) .
although residents felt that the usb syllabus helped them in taking care of their patients , this study design did not allow us to test such hypotheses and we do not know if this resource translated into improved patient care and patient outcomes .
fourth , it is unclear how the usb syllabus would compare to other electronic resources , e.g. , web - based only formats .
fifth , this pilot study was performed at an academic medical center , where the majority of residents reported planning a scientific career and the majority of graduates pursue academic careers . thus , the external validity and generalizibility of our findings to other residency programs remains unclear .
finally , a limitation of the usb syllabus is that a structured mechanism to update the most recent best evidence is not included .
however , one could envision a system of a web - based syllabus that includes regular updates combined with a personalized usb syllabus handed to house officers at the beginning of their training to capitalize on the benefit of each technology .
first , this study relied exclusively on self - report and we were unable to actually observe the trainees ' reading practices and patterns .
second , our study design was observational and thus the findings in this paper represent associations rather than causality . as all residents received the usb syllabus , we can not test the educational effect against a control group . while some comments to the investigators during the study period make us believe that the increased reading of original research articles was because of the usb syllabus
it is not possible to differentiate the effect of nine months of clinical training ( study period ) on reading habits of the housestaff from the educational impact of the usb syllabus .
the curricula of the pgy-1 , pgy-2 , and pgy-3 year in the residency program at jhbmc differ significantly ( pgy  post - graduate year ) .
the pgy-1 year in general has the longest working hours and least amount of elective time . in the pgy-2 and
more so in the pgy-3 year the elective time increases and average working hours decrease .
this difference in available time to read literature could explain why the post - intervention pgy-1 group was found to read fewer articles than the pre - intervention pgy-2 group ( the baseline reading assessment was performed three months after the start of the academic year ) .
third , reading more original medical literature by itself may not necessarily translate into practicing evidence - based medicine .
windish and colleagues have found that some residents lack knowledge in biostatistics that may be needed to interpret published clinical research ( 13 ) .
although residents felt that the usb syllabus helped them in taking care of their patients , this study design did not allow us to test such hypotheses and we do not know if this resource translated into improved patient care and patient outcomes .
fourth , it is unclear how the usb syllabus would compare to other electronic resources , e.g. , web - based only formats .
fifth , this pilot study was performed at an academic medical center , where the majority of residents reported planning a scientific career and the majority of graduates pursue academic careers .
thus , the external validity and generalizibility of our findings to other residency programs remains unclear .
finally , a limitation of the usb syllabus is that a structured mechanism to update the most recent best evidence is not included .
however , one could envision a system of a web - based syllabus that includes regular updates combined with a personalized usb syllabus handed to house officers at the beginning of their training to capitalize on the benefit of each technology .
in conclusion , this usb drive - based electronic syllabus seems to have had a positive effect on resident education .
importantly , this intervention eliminated the haphazard way in which trainees are exposed to the medical education .
all three authors can recall points in their training when they were thrilled that they had been given a particular article by an attending physician and even felt somewhat covetous when seeing colleagues being given articles by role models .
additional research may help to more accurately quantify the effect of a usb syllabus on residents ' reading practices and patient care , or how this intervention might influence the acquisition of the six acgme core competencies .
creative solutions using computers and technology will allow us to more effectively educate the physicians of tomorrow in innovative ways .
the authors have not received any funding or benefits from industry to conduct this study .
 backgroundthe acquisition of new knowledge is a primary goal of residency training . retrieving and retaining influential primary and secondary medical literature can be challenging for house officers . 
 we set out to investigate the effect of a universal serial bus ( usb ) drive loaded with landmark scientific articles on housestaff education in a pilot study.methodswe created a usb syllabus that contains 187 primary scientific research articles . 
 the electronic syllabus had links to the full - text articles and was organized using an html webpage with a table of contents according to medical subspecialties . 
 we performed a prospective cohort study of 53 house officers in the internal medicine residency program who received the usb syllabus . 
 we evaluated the impact of the usb syllabus on resident education with surveys at the beginning and conclusion of the nine - month study period.resultsall 50 respondents ( 100% ) reported to have used the usb syllabus . 
 the self - reported number of original articles read each month was higher at the end of the nine - month study period compared to baseline . 
 housestaff rated original articles as being a more valuable educational resource after the intervention.conclusionsan electronic syllabus with landmark scientific articles placed on a usb drive was widely utilized by housestaff , increased the self - reported reading of original scientific articles and seemed to have positively influenced residents ' attitude toward original medical literature . 
Methods
Study design
Study population
USB syllabus
Data collection and evaluation
Data analysis
Results
Characterization of usage and impact of the USB syllabus
Discussion
Limitations
Conclusions
Conflict of interest and funding