Comic strip says government study shows Head Start 'has little or no impact on the children it's supposed to help.
The self-described 'right-leaning duck' who appears on funny pages nationwide provoked PolitiFact Texas readers earlier this month. Several asked us to look into the 'Mallard Fillmore' comic strip's statements about Head Start, such as this from the Feb. 9, 2013, cartoon: 'A government study has found that the vaunted 'Head Start' program actually has little or no impact on the children it's supposed to help.' All is not lost, though: The 'Fillmore Foundation' found the program makes Head Start supporters 'feel really really good about themselves,' joked the strip. It includes a footnote citing the U.S. Department of Health and Human Services; other 'Mallard' Head Start comics between Feb. 6 and Feb. 13 do the same or cite the conservative Heritage Foundation's website. The federal Head Start program was launched by Congress in the mid-1960s to help preschool-age children from low-income families. With an annual budget of $8 billion, it offers such children educational activities, medical/dental care, meals and safe playtime. Government's six-year study King Features Syndicate spokeswoman Claudia Smith told us by email that 'Mallard' cartoonist Bruce Tinsley was speaking about a new report that Health and Human Services issued on its 2002-08 study of Head Start's effects, which Congress mandated in 1998 when it continued the program. To determine how the program affected school readiness and when or how it was most effective, the department tracked 4,667 students in 23 states whose families applied to get them into Head Start. The children, all aged 3 or 4, were randomly assigned to a Head Start program or a control group. Data were gathered on measures of cognitive and social-emotional development, health and parenting practices. An earlier, Jan. 15, 2010, report covered results from fall 2002 through the end of the students' first-grade years. The 3-year-olds could have logged as much as two years in Head Start, the 4-year-olds only one; children not initially assigned to Head Start might have participated in other preschool programs or reapplied. At the end of preschool, the Head Start 3-year-olds showed advantages, mainly in language and literacy categories such as naming letters and oral comprehension, over non-Head Start 3-year-olds. Fewer positive outcomes were recorded for the 4-year-olds, and both age groups' advantages had faded by the end of first grade, according to the report. Results updated in late 2012 The department's October 2012 report, released Dec. 21, 2012, updated study results through the end of third grade. And like the first-grade results, the 2012 report said that 'there were initial positive impacts from having access to Head Start, but by the end of 3rd grade there were very few impacts found. ...The few impacts that were found did not show a clear pattern of favorable or unfavorable impacts for children.' We tallied the results for children assigned to Head Start as compared to the control group: The 3-year-olds, who had the chance to stay in Head Start for two years: At the end of Head Start, they had 15 positive results out of 33 categories for which data was gathered (45 percent positive). By the end of third grade, they showed two positive results and one negative result out of 48 categories (4 percent positive, 2 percent negative). There was no significant change in most categories. The 4-year-olds, who would only have been able to attend Head Start for one year: At the end of Head Start, they showed nine positive results out of 33 categories (27 percent positive). By the end of third grade, they showed three positive and four negative results out of 48 categories (6 percent positive, 8 percent negative). Most measures showed no statistically significant change. To sum that up: The Head Start age groups were doing 45 percent (the 3-year-olds) or 27 percent (the 4-year-olds) better than their peers at the end of Head Start. By the end of third grade, though, the results were only a few percentage points apart and the Head Start children had fallen behind in several categories. Among the negative results at the end of third grade, the 3-year-olds showed a drop in 'school promotion' (advancing to the next grade) and the 4-year-olds showed increased 'emotional symptoms' and declines in relationships with teachers and peers. Evaluating the research We checked to see if the study was considered solid and how it fit into other research on the topic. Harvard University's Center on the Developing Child interpreted the 2010 findings in an undated 'brief' that said in part, 'Overall, the study was sound scientifically, but there has been considerable debate over what its findings mean.' The fact that Head Start advantages disappeared by the end of first grade, it said, apparently meant that 'the comparison children were able to catch up to their peers in the Head Start treatment group during the first two years of school.' Two experts took issue with one aspect of the study's results: Even if children exited or entered Head Start after the study began, they were still counted as part of the group to which they were first assigned. The 2012 report said 15 percent to 20 percent of the children assigned to the Head Start group exited the program, while 14 percent to 17 percent of children who started in the control group were later admitted to Head Start. Retired early-education researcher John Love, who directed a 1995-2002 study on Early Head Start (the federal program for low-income children up to age 3), told us by email, 'This isn't so much a criticism of the researchers ... but a fact that those who want to make sense of the findings should be aware of.' The report included estimates that were adjusted to account for this issue, he said. According to the report, that adjustment made 'no change in the statistical significance of the estimates' or 'the overall patterns found in the main analysis.' Steve Barnett, director of the National Institute for Early Education Research at Rutgers University, raised the same concern. By email, he told us that in his view, it means 'the results of the study are somewhat misinterpreted' and the effects of Head Start are underestimated. Did 'Mallard' get it right?
Overall, Love said, the comic strip's description of the study was close but oversimplified. 'That is a fair summary of what they found, as far as it goes,' he said, but it's an inadequate description because there were some significant results within subgroups; for example, black 4-year-olds showed more improvement than their peers, with effects lasting until the end of third grade. Such findings, Love said, could help determine 'what works for whom under what conditions.' Barnett said other research has yielded varied results. 'Some find that other studies are persuasive that Head Start has larger impacts, and there certainly are other studies that find these,' he said. 'On the other side are people who would be closer to the duck.' He emailed us his review of major U.S. and other studies on early educational intervention for children in poverty that appeared in the Aug. 19, 2011, issue of the international journal Science. There, Barnett considered decades of research showing that the Head Start study and three others all showed declining benefits to children as they got older. In the Head Start study and Love's Early Head Start study, Barnett wrote, effects 'start small and disappear shortly after school entry.' Two smaller and older studies showed effects that were 'relatively large and long-lasting,' the review said: a mid-1960s look at Perry Preschool in Michigan and a late-'70s/early '80s examination of a North Carolina preschool program. Barnett told us, however, that the longer-lasting benefits indicated by the older studies might reflect the fact that fewer children then had access to quality preschool or health insurance. Our ruling 'Mallard Fillmore' said a government study shows Head Start 'has little or no impact on the children it's supposed to help.' That could be an accurate description of the longer-term results -- relatively few positive outcomes and some negative ones -- measured at the end of first and third grades. Still, the Head Start children had significant advantages over their peers when they exited preschool and started kindergarten. We rate the duck's proclamation as Mostly True.