Study Details

Citation

Herrling, S. (2015). "Evaluation of the Children's Aid Society (CAS)-Carrera Adolescent Pregnancy Prevention Program in Chicago, IL: Findings from the Replication of an Evidence-Based Teen Pregnancy Prevention Program." Accord, NY: Philliber Research Evaluation.

Program or Component Study?
Program
Program or Component Name

Children's Aid Society (CAS)-Carrera Program

Show Evidence of Effectiveness
No
Study Rating and Explanation
High —

Random assignment study that met all criteria for a high rating; findings show no positive, statistically significant impact on a relevant behavioral outcome measure for either the full sample or key subgroups

Program Information

Program Type
Positive youth development
Program Length
More than 20 sessions

Evaluation Setting

Evaluation Setting
After school

Study Sample

Average Age Group
13 or younger
Majority Racial/Ethnic Group
African American or Black
Gender
Youth of any gender

Research Design

Assignment Method
Randomized controlled trial
Sample Size

338

Number of Follow-Ups

1

Length of Last Follow-Up

42 from BL

Year of Last Data Collection
2015

Study Findings

Result Sexual Activity
Indeterminate evidence
Result Contraceptive
Indeterminate evidence
Reviewed Studies
High-Quality Randomized Trial
Protocol Version
Version 5.0
Details

A separate recent study conducted by another researcher evaluated the program using a randomized controlled trial that involved 338 students attending 4th through 7th grades in elementary and middle schools in Chicago. The study randomly assigned youth to either a treatment group that received the CAS-Carrera program after school hours or a control group that received academic and health support services and enrichment activities. Surveys were administered before the program started (baseline) and again every six months after the baseline for four years.

For the last follow-up, conducted about four years after the baseline, the study found no evidence of statistically significant program impacts on sexual initiation or on having sexual intercourse without using any effective method of birth control in the last three months.

The study also examined outcomes related to the implementation of the program, such as number of sessions that were scheduled and attended. Findings for these outcomes were not considered for the review because they fell outside the scope of the review.

Effect Sizes
{"0": {"ProgramName":"Children's Aid Society (CAS)-Carrera Program","StudyID":"PPRER016004","ManuscriptID":"PPRER016004","sid":"35","Rating":"High","OutcomeName":"Had sex without effective use of contraception in past 3 months","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"42","FUReference":"Baseline","MeanTreat":"0.04","MeanComp":"0.02","TpperES":"0.400","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"1": {"ProgramName":"Children's Aid Society (CAS)-Carrera Program","StudyID":"PPRER016004","ManuscriptID":"PPRER016004","sid":"35","Rating":"High","OutcomeName":"Had sex without effective use of contraception in past 3 months","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup--women","FUTimingMonths":"42","FUReference":"Baseline","MeanTreat":"0.06","MeanComp":"0.01","TpperES":"0.889","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"2": {"ProgramName":"Children's Aid Society (CAS)-Carrera Program","StudyID":"PPRER016004","ManuscriptID":"PPRER016004","sid":"35","Rating":"High","OutcomeName":"Had sex without effective use of contraception in past 3 months","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup--men","FUTimingMonths":"42","FUReference":"Baseline","MeanTreat":"0.07","MeanComp":"0.09","TpperES":"-0.199","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"3": {"ProgramName":"Children's Aid Society (CAS)-Carrera Program","StudyID":"PPRER016004","ManuscriptID":"PPRER016004","sid":"35","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup--men","FUTimingMonths":"42","FUReference":"Baseline","MeanTreat":"0.41","MeanComp":"0.39","TpperES":"0.063","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"4": {"ProgramName":"Children's Aid Society (CAS)-Carrera Program","StudyID":"PPRER016004","ManuscriptID":"PPRER016004","sid":"35","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup--women","FUTimingMonths":"42","FUReference":"Baseline","MeanTreat":"0.20","MeanComp":"0.14","TpperES":"0.281","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"5": {"ProgramName":"Children's Aid Society (CAS)-Carrera Program","StudyID":"PPRER016004","ManuscriptID":"PPRER016004","sid":"35","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"42","FUReference":"Baseline","MeanTreat":"0.32","MeanComp":"0.26","TpperES":"0.189","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"}}

NA = Not available. This means the authors did not report the information in the manuscripts associated with the studies we reviewed.

a This information was not available whenever authors did not report information for the treatment and comparison groups separately on outcome means, standard deviations, and/or sample sizes.

b Authors reported that the program effect (impact) estimate is statistically significant with a p-value of less than 0.05 based on a two-tailed test.

c For some outcomes, having less of that outcome is favorable. In those cases, an effect with a negative sign is favorable to the treatment group (that is, the treatment group had a more favorable outcome than the comparison group, on average).

d An effect shows credibly estimated, statistically significant evidence whenever it has a p-value of less than 0.05 based on a two-tailed test, includes the appropriate adjustment for clustering (if applicable), and it is not based on an endogenous subgroup.