Study Details

Citation

Robinson, W.T., Kaufman, R. Cahill, L. (2016a). Evaluation of the Teen Outreach Program in Louisiana. New Orleans, LA. Louisiana State University Health Sciences Center at New Orleans, School of Public Health, Initiative for Evaluation and Capacity Building.

Robinson, W. T., Seibold-Simpson, S., Crean, H. F., Spruille-White, B. (2016b). Randomized Trials of the Teen Outreach Program in Louisiana and Rochester, New York. American Journal of Public Health, 106, S39-S44. doi:10.2105/AJPH.2016.303403

Program Name

Teen Outreach Program (TOP)

Show Evidence of Effectiveness
No
Study Rating and Explanation
Moderate

Random assignment study with high attrition that that did not meet the criteria for a high rating but met all criteria for a moderate rating; findings show no positive, statistically significant impact on a relevant behavioral outcome measure for either the full sample or key subgroups

Program Information

Program Type
Positive youth development
Program Length
More than 20 sessions

Evaluation Setting

Evaluation Setting
After school

Study Sample

Average Age Group
13 or younger
Majority Racial/Ethnic Group
African American or Black
Gender
Youth of any gender

Research Design

Assignment Method
Randomized controlled trial
Sample Size

4769

Number of Follow-Ups

2

Length of Last Follow-Up

12

Year of Last Data Collection
2015

Study Findings

Result Sexual Activity
Indeterminate evidence
Result Contraceptive
Indeterminate evidence
Result Pregnancy
Indeterminate evidence
Reviewed Studies
Moderate-Quality Randomized Trial
Protocol Version
Version 5.0
Effect Sizes
{"0": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER016011","ManuscriptID":"PPRER016011","sid":"237","Rating":"Moderate","OutcomeName":"Recent sex no birth control","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"0","FUReference":"End of Program","MeanTreat":"0.04","MeanComp":"0.04","TpperES":"0.097","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"1": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER016011","ManuscriptID":"PPRER016011","sid":"237","Rating":"Moderate","OutcomeName":"Recent sex no birth control","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"0","FUReference":"End of Program","MeanTreat":"0.04","MeanComp":"0.04","TpperES":"0.097","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"2": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER016011","ManuscriptID":"PPRER016011","sid":"237","Rating":"Moderate","OutcomeName":"Recent sex no birth control","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"12","FUReference":"End of Program","MeanTreat":"0.04","MeanComp":"0.04","TpperES":"-0.049","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"3": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER016011","ManuscriptID":"PPRER016011","sid":"237","Rating":"Moderate","OutcomeName":"Pregnancy since baseline","OutcomeDomain":"Pregnancy","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"12","FUReference":"End of Program","MeanTreat":"0.02","MeanComp":"0.02","TpperES":"-0.023","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"4": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER016011","ManuscriptID":"PPRER016011","sid":"237","Rating":"Moderate","OutcomeName":"Delay of sexual onset","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"No","SampleType":"Subgroup--BL sexually experienced","FUTimingMonths":"0","FUReference":"End of Program","MeanTreat":"134.00","MeanComp":"160.00","TpperES":"-0.135","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"}}

NA = Not available. This means the authors did not report the information in the manuscripts associated with the studies we reviewed.

a This information was not available whenever authors did not report information for the treatment and comparison groups separately on outcome means, standard deviations, and/or sample sizes.

b Authors reported that the program effect (impact) estimate is statistically significant with a p-value of less than 0.05 based on a two-tailed test.

c For some outcomes, having less of that outcome is favorable. In those cases, an effect with a negative sign is favorable to the treatment group (that is, the treatment group had a more favorable outcome than the comparison group, on average).

d An effect shows credibly estimated, statistically significant evidence whenever it has a p-value of less than 0.05 based on a two-tailed test, includes the appropriate adjustment for clustering (if applicable), and it is not based on an endogenous subgroup.

Details

A separate recent study evaluated the program using a randomized controlled trial that involved 4,769 adolescents recruited from Community Based Organizations in Louisiana. Adolescents were randomly assigned to either a treatment group that received TOP or a control group that did not receive TOP or any other teen pregnancy prevention program. The study administered surveys before conducting random assignment (baseline), and again immediately and 12 months after the end of the program.

The study findings failed to replicate the favorable impacts on sexual activity rates and pregnancy found in the earlier studies by Daley et al. (2015) and Allen et al. (1997), respectively. In particular, the study found that immediately after the end of the program, the subgroup of adolescents in the group receiving TOP who were sexually inexperienced at baseline were no less likely than their counterparts in the control group to report they have had become sexually active (odds ratio = 1.25). Twelve months after the end of the program, the study found that adolescents in the group receiving TOP were no less likely than adolescents in the control group to report ever being pregnant (odds ratio = 0.96). Immediately and 12 months after the end of the program, the study also found no evidence of statistically significant program impacts on having sex without using an effective method of birth control in the last three months.