The Evaluation Exchange
Volume IX, No. 1, Spring 2003
Issue Topic: Evaluating Out-of-School Time

This is the third issue of The Evaluation Exchange (Harvard Family Research Project's quarterly evaluation periodical) devoted to exploring the challenges and solutions associated with evaluating out-of-school (OST) programs. This issue includes articles on what we know from existing research and evaluation about the results that are possible from OST programming, expert commentary on what the future OST research and evaluation agenda should look like, and information about hands-on research and evaluation tools and resources. It is also includes a special report with expert commentary on the implications of the first year findings in Mathematica's evaluation of the national 21st Century Community Learning Centers program. To read the previous issues on out-of-school time, go to our issue archive.

Download the entire issue as an PDF file or click on the links in the table of contents to read the individual articles on our website:

320KB PDF file

Help for PDF file

Table of Contents

From the Director's Desk
An introduction to the issue by HFRP's Founder & Director, Heather B. Weiss, Ed.D.

Theory & Practice

• Does Youth Participation in Out-of-School Time Activities Make a Difference?
  Sandra Simpkins of HFRP integrates findings from academic research and program evaluation to provide a comprehensive look at the relationship between participation in OST activities and positive youth outcomes.

Ask the Expert

• How can research and evaluation improve practice regarding access and equity in out-of-school time programs?
  We posed this question to five experts in the field of youth development and OST programming: Yolanda George of the American Association for the Advancement of Science, Laurie Olsen of California Tomorrow, Jane Quinn of the Children's Aid Society, Liz Reisner of Policy Studies Associates, and Donna Walker James of American Youth Policy Forum.

Evaluations to Watch

• Evaluating the 21st Century Community Learning Centers Program—A View From the States
  Erin Harris and Priscilla Little of HFRP describe the implementation of the new 21st Century Community Learning Centers program's evaluation requirements in the context of the No Child Left Behind Act.
• Improving Bradenton's After School Programs Through Utilization-Focused Evaluation
  Katherine Loflin of the Knight Foundation describes the utilization-focused evaluation efforts in one community in Knight's Community Partners Program.

Questions & Answers

• A Conversation With Michelle Gambone
  Dr. Michelle Gambone is president of Youth Development Strategic, Inc., a youth policy and research consulting firm. She spoke with HFRP about her new research on the relationship between supports and opportunities and long-term developmental outcomes for youth.

Special Report

• The Evaluation Exchange Special Report on the 21st Century Community Learning Centers Program National Evaluation
  This special report offers expert commentary on the implication of When School Stay Open Late: The National Evaluation of the 21st Century Community Learning Centers Program, First Year Findings for future evaluation and research.

Beyond Basic Training

• Doing What Works: Scientifically Based Research in Education
  Suzanne Bouffard of HFRP examines the new science-based research standards brought in by the No Child Left Behind Act.
• Understanding Family Strengthening to Promote Youth Development
  Dr. Geri Lynn Peak, a consultant and formerly the Managing Director of the Center for Applied Research and Technical Assistance, describes the evolution, practice, and potential assessment of a family strengthening approach to promote positive youth development.

Promising Practices

• The Challenges and Strategies of Evaluating Community-Wide After School Programs
  Mark Ouellette and Audrey Hutchinson of the National League of Cities describes strategies to meet the challenges of evaluating citywide after school programs.
• Learning From Evaluation: Lessons From After School Evaluation in Texas
  Dr. Peter Witt, the Bradberry Recreation and Youth Development Chair at Texas A&M University, reflects on seven years of evaluating city after school programs in Texas.
• NSACA Accreditation: Building Capacity for Continuous Improvement in After School Programs
  Mark Carter, Executive Director of the National School-Age Care Alliance (NSACA), describes how the NSACA accreditation process helps after school programs build evaluation capacity.

Spotlight

• Logic Models in Out-of-School Time
  Julia Coffman of HFRP describes one approach OST programs can take to develop a logic model.

HFRP Resources

• The Out-of-School Time Program Evaluation Database
  Erin Harris of HFRP outlines the what information the HFRP Out-of-School Time Evaluation Database includes, how it is organized, and its practical applications.

New & Noteworthy
A list of new resources on evaluation of out-of-school time.

This issue of The Evaluation Exchange was published by Harvard Family Research Project. All rights reserved. This periodical may not be reproduced whole or in part without written permission from the publisher. To request reprint permission or multiple hard copies of the issue email hfrp_pubs@gse.harvard.edu.

Harvard Family Research Project gratefully acknowledges the support of the Charles Stewart Mott Foundation, the John S. and James L. Knight Foundation, the Annie E. Casey Foundation, and the W. K. Kellogg Foundation. The contents of this publication are solely the responsibility of Harvard Family Research Project and do not necessarily reflect the view of our funders.

All rights reserved. Information on this site may not be reproduced in whole or in part without written permission from Harvard Family Research Project.

© 2006 President and Fellows of Harvard College
Published by Harvard Family Research Project
3 Garden Street
Cambridge, MA 02138
Tel: 617-495-9108
Fax: 617-495-8594
Email: hfrp@gse.harvard.edu