Study Details

Citation

Francis, K., Woodford, M., and Kelsey, M. (2015). “Evaluation of the Teen Outreach Program in Hennepin County, MN: Findings from the Replication of an Evidence-Based Teen Pregnancy Prevention Program.” Cambridge, MA: Abt Associates Inc.

Program Name

Teen Outreach Program (TOP)

Show Evidence of Effectiveness
No
Study Rating and Explanation
High —

Random assignment study that met all criteria for a high rating; findings show no positive, statistically significant impact on a relevant behavioral outcome measure for either the full sample or key subgroups

Program Information

Program Type
Positive youth development
Program Length
More than 20 sessions

Evaluation Setting

Evaluation Setting
In school: Middle school

Study Sample

Average Age Group
13 or younger
Majority Racial/Ethnic Group
African American or Black
Gender
Youth of any gender

Research Design

Assignment Method
Cluster randomized controlled trial
Sample Size

1196

Number of Follow-Ups

2

Length of Last Follow-Up

15

Year of Last Data Collection
2014

Study Findings

Result Sexual Activity
Indeterminate evidence
Result Contraceptive
Indeterminate evidence
Reviewed Studies
High-Quality Randomized Trial
Protocol Version
Version 5.0
Effect Sizes
{"0": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recent unprotected sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.04","MeanComp":"0.07","TpperES":"-0.361","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"1": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recent unprotected sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.06","MeanComp":"0.07","TpperES":"-0.030","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"2": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recent unprotected sex boys ","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-males","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.05","MeanComp":"0.08","TpperES":"-0.221","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"3": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recent unprotected sex boys ","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-males","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.05","MeanComp":"0.08","TpperES":"-0.263","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"4": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recent unprotected sex girls","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-females","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.04","MeanComp":"0.08","TpperES":"-0.487","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"5": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recent unprotected sex girls","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-females","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.08","MeanComp":"0.06","TpperES":"0.139","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"6": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-other","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.10","MeanComp":"0.08","TpperES":"0.174","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"7": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-other","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.20","MeanComp":"0.15","TpperES":"0.225","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"8": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recently sexually active","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.14","MeanComp":"0.15","TpperES":"-0.048","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"9": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recently sexually active","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.17","MeanComp":"0.19","TpperES":"-0.095","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"10": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recently sexually active boys","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-males","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.15","MeanComp":"0.17","TpperES":"-0.063","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"11": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recently sexually active boys","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-males","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.16","MeanComp":"0.19","TpperES":"-0.092","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"12": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recently sexually active girls","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-females","FUTimingMonths":"3","FUReference":"End of Program","MeanTreat":"0.17","MeanComp":"0.17","TpperES":"-0.039","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"13": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014003","ManuscriptID":"PPRER014003","sid":"237","Rating":"High","OutcomeName":"Recently sexually active girls","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-females","FUTimingMonths":"15","FUReference":"End of Program","MeanTreat":"0.17","MeanComp":"0.21","TpperES":"-0.165","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"}}

NA = Not available. This means the authors did not report the information in the manuscripts associated with the studies we reviewed.

a This information was not available whenever authors did not report information for the treatment and comparison groups separately on outcome means, standard deviations, and/or sample sizes.

b Authors reported that the program effect (impact) estimate is statistically significant with a p-value of less than 0.05 based on a two-tailed test.

c For some outcomes, having less of that outcome is favorable. In those cases, an effect with a negative sign is favorable to the treatment group (that is, the treatment group had a more favorable outcome than the comparison group, on average).

d An effect shows credibly estimated, statistically significant evidence whenever it has a p-value of less than 0.05 based on a two-tailed test, includes the appropriate adjustment for clustering (if applicable), and it is not based on an endogenous subgroup.

Details

A separate recent study evaluated the program among a younger sample of middle- and high-school students in Hennepin County, Minnesota. The study used a cluster randomized controlled trial involving 61 middle and high schools. In each participating school, students were randomly assigned by teacher to either a treatment group that received the program or a control group that provided the regular school instruction. Surveys were administered before the program started (baseline), and again three and 15 months after the program ended.

The study findings failed to replicate the favorable impact on sexual activity rates found in the separate study by Daley et al. (2015). In particular, the study found that students in the treatment group were no less likely than students in the control group to report ever having had sex (odds ratio = 1.33 for the 3-month follow-up survey, odds ratio = 3.14 for the 15-month follow-up survey). The study also examined program impacts on measures of recent sexual activity and recent unprotected sexual activity. The study found no statistically significant impacts on these outcomes for either follow-up survey. The study did not measure program impacts on pregnancy.