After school matters

Jun 14, 2011
The study of After School Matters apprenticeships found that youth in the program engaged in fewer problem behaviors, particularly gang activity and selling drugs.

( -- A three-year evaluation of After School Matters -- a Chicago after-school program that serves more than 17,000 students and is a model for high school after-school programs in cities around the country -- suggests that well implemented, apprenticeship-style programs help reduce problem behavior in high school aged youth.

“Our study of selected After School Matters apprenticeships found that youth in the program engaged in fewer problem behaviors, particularly gang activity and selling drugs,” said Barton Hirsch, the Northwestern University professor of education and social policy who led the evaluation.

In addition, the study found youth in After School Matters demonstrated more of what psychologists call “self-regulation,” considered a key component of positive youth development. Self-regulation involves the ability to stay focused on achieving goals despite emotional and other distractions, said Hirsch.

The large-scale study followed 535 Chicago high school students from 10 Chicago public high schools. All of them had applied to participate in After School Matters internships although only half won a lottery allowing their participation. Ninety-one percent of the control group -- those students who lost the After School Matters lottery and did not participate in After School Matters apprenticeships -- participated in organized after-school activities, community-based programs or paid work.

The study is the first randomized controlled study -- the gold standard in evaluation research -- of a after-school program since the 1980s. Hirsch conducted it with Northwestern statistics professor and Institute for Policy Research fellow Larry Hedges and University of Wisconsin-Extension professor JulieAnn Stawicki.

The researchers found no statistically significant difference between students in After School Matters and the control group in the areas of job skills and academic performance. Ninety-two percent of all the students studied came from low-income households and almost all were minority students.

“It’s a ‘yes but’ message,” said Hirsch, who nonetheless called the results “promising.” “The After School Matters apprenticeships were more oriented toward skill development, creating a product and looking toward the future -- and this seems to have paid off,” he added.

At the same time, Hirsch said the findings make the researchers cautious. “Because the 13 apprenticeships that we studied were among the best After School Matters offered, we still don’t know how the average After School Matters apprenticeship compares with the average alternative after-school program,” he noted.

The researchers purposefully chose to study After School Matters’ better apprenticeship programs to determine what happens when a program is implemented well. The apprenticeships in graphic design, computer repair, culinary arts, songwriting and producing, and other areas were chosen on the basis of recommendations and preliminary evaluations.

After School Matters executive director David Sinski emphasized the value of the study, saying “It’s important for us to have this validation of what we do well and ensure we apply the findings to all After School Matters programs.” He noted that After School Matters recently formed a Program Quality Division focusing on continual improvement of the program model.

“That division includes training instructors on evidence-based program quality methods,” said Sinski. He anticipates that better preparing instructors and other enhancements “will result in even greater outcomes for teens in our programs.”

After School Matters, which has programs throughout the City of Chicago, seeks to provide out-of-school opportunities that expose teens to career areas and help them develop skills. Ten-week sessions in fall and spring meet for three hours three times weekly. Two instructors with expertise in the area direct each apprenticeship.

At the time of the study, students were paid the equivalent of $5 per hour.

Based on their findings, the researchers have made suggestions for strengthening After School Matters programs. “They need to do better in getting across to teens that the skills they learn in After School Matters will help them get jobs,” said Northwestern’s Hirsch. “And apprenticeship instructors need to insist on high-quality work and keep young people focused on the task at hand.”

An innovative outgrowth of the study is a curriculum for teaching job interview skills. With the help of human resources professionals, the researchers designed a mock job interview to assess marketable job skills.

Before the teens were given interview training, human resources experts found many teens had experiences and skills that employers value but in interviews the youth often failed to convey those experiences or communicate their credentials.

“That changed when they received our brief interview curriculum,” Hirsch said. “In several Chicago Public Schools classrooms where students went through interview training, the mock interviews nearly tripled the would-be hiring rate.”

After School Matters executive director Sinski expects the study to have repercussions beyond Chicago.

“Organizations in New York, Boston and other cities have replicated our apprenticeship model,” Sinski said. “This study helps us all recognize the key components that make the apprenticeship experience so valuable for young people, as we work collectively to provide important out-of-school time opportunities for teens nationwide.”

Explore further: New 'Surveyman' software promises to revolutionize survey design and accuracy

More information: Copies of the complete After School Matters evaluation are available online at… ?p=42&/BartonHirsch/

add to favorites email to friend print save as pdf

Related Stories

The kids are alright

May 26, 2011

Children should be seen and not heard... who says? A Philosophy academic at The University of Nottingham is challenging the adage by teaching primary school children to argue properly.

The secret lives of boys

Apr 20, 2011

Harvard alumna Niobe Way sharpened the debate around the emotional capacities of boys and girls with an intimate look at teen relationships during a Harvard discussion on April 14.

Study finds sick kids have fewer friends

Dec 07, 2010

A new study reveals that sick teens are more isolated than other kids, but they do not necessarily realize it and often think their friendships are stronger than they actually are.

Recommended for you

World population likely to peak by 2070

Oct 23, 2014

World population will likely peak at around 9.4 billion around 2070 and then decline to around 9 billion by 2100, according to new population projections from IIASA researchers, published in a new book, World Population and ...

Bullying in schools is still prevalent, national report says

Oct 23, 2014

Despite a dramatic increase in public awareness and anti-bullying legislation nationwide, the prevalence of bullying is still one of the most pressing issues facing our nation's youth, according to a report by researchers ...

Study examines effects of credentialing, personalization

Oct 23, 2014

Chris Gamrat, a doctoral student in learning, design and technology, recently had his study—completed alongside Heather Zimmerman, associate professor of education; Jaclyn Dudek, a doctoral student studying learning, design ...

User comments : 0