A PART Tragedy: The Case of Upward Bound Correcting for Study Error in the Random Assignment 1992-2004 National Evaluation of Upward Bound
BibTeX
@MISC{Cahalan_apart,
author = {Margaret Cahalan},
title = {A PART Tragedy: The Case of Upward Bound Correcting for Study Error in the Random Assignment 1992-2004 National Evaluation of Upward Bound},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
serving as the project director for national evaluations of Student Support Services and Talent Search, and the UB performance reporting contracts. She also served as survey director for the Third Follow- up and initiation of the Fourth Follow-up data collections for the study that is the subject of this article. Abstract: The paper takes a critical look at study error relative to findings from the National Evaluation of Upward Bound (UB) and explores policy and methodological lessons learned. The nationally representative random assignment study followed a multi-grade cohort from 1992-93 to 2003-04. Following published reports of lack of overall positive effects, OMB gave UB an ineffectual Performance Assessment Rating Tool (PART) rating and Bush Administration budget recommendations in FY05 and FY06 called for zero funding. Efforts were also made to reform the program, by requiring projects to serve more academically at-risk students. Major technical issues discussed include: 1) extreme unequal weighting; 2) treatment-control group non-equivalency; 3) survey non-response bias; 4) lack of standardization for expected high school graduation year (EHSGY) in outcome measurement; and 5) service substitution and dropout issues. Our major finding is that when administrative records are used to supplement survey data and outcomes standardized by EHSGY, contrary to previously published reports, the UB program demonstrated statistically significant positive effects on the major goals of the program; postsecondary entrance, application for financial aid; and attainment of postsecondary
Keyphrases
upward bound study error part tragedy random assignment 1992-2004 national evaluation upward bound correcting national evaluation service substitution significant positive effect treatment-control group non-equivalency project director major technical issue at-risk student ub performance reporting contract student support service zero funding administrative record survey director outcome measurement methodological lesson ineffectual performance assessment rating tool overall positive effect talent search critical look bush administration budget recommendation fourth follow-up data collection extreme unequal weighting third follow postsecondary entrance major finding multi-grade cohort ub program financial aid survey data high school graduation year major goal survey non-response bias dropout issue representative random assignment study
