Study Details

Citation

Daley, E.M., Buhi, E.R., Wang, W., Singleton, A., Debate, R., Marhefka, S., et al. Evaluation of Wyman's Teen Outreach Program in Florida: Final Impact Report for Florida Department of Health. Findings from the Replication of an Evidence-Based Teen Pregnancy Prevention Program. 2015.

Walsh-Buhi, E. R., Marhefka, S. L., Wang, W., Debate, R., Perrin, K., Singleton, A., Noble, C. A., Rahman, S., Maness, S. B., Mahony, H., Ziemba, R., Malmi, M., Marwah, E., Hall, K., Turner, D., Blunt-Vinti, H., Noble, S. M., Daley, E. M. (2016). The impact of the teen outreach program on sexual intentions and behaviors. The Journal of Adolescent Health : Official Publication of the Society for Adolescent Medicine, 59(3), 283-290. doi:10.1016/j.jadohealth.2016.05.007 [doi]

Program Name

Teen Outreach Program (TOP)

Show Evidence of Effectiveness
Yes
Study Rating and Explanation
High

Random assignment study that met all criteria for a high rating; findings show a positive, statistically significant impact for at least one behavioral outcome

Program Information

Program Type
Positive youth development
Program Length
More than 20 sessions

Evaluation Setting

Evaluation Setting
In school: High school

Study Sample

Average Age Group
14 to 17
Majority Racial/Ethnic Group
White
Gender
Youth of any gender

Research Design

Assignment Method
Cluster randomized controlled trial
Sample Size

2058

Number of Follow-Ups

2

Length of Last Follow-Up

10

Year of Last Data Collection
2015

Study Findings

Result Sexual Activity
Potentially favorable evidence
Result Pregnancy
Favorable evidence
Reviewed Studies
High-Quality Randomized Trial
Protocol Version
Version 5.0
Effect Sizes
{"0": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER014011","sid":"237","Rating":"High","OutcomeName":"Ever been pregnant or gotten someone pregnant","OutcomeDomain":"Pregnancy","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"0.02","MeanComp":"0.03","TpperES":"-0.333","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"1": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER014011","sid":"237","Rating":"High","OutcomeName":"Ever been pregnant or gotten someone pregnant","OutcomeDomain":"Pregnancy","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"10","FUReference":"End of program","MeanTreat":"0.03","MeanComp":"0.05","TpperES":"-0.405","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"2": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER014011","sid":"237","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"0.28","MeanComp":"0.32","TpperES":"-0.106","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"3": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER014011","sid":"237","Rating":"High","OutcomeName":"Ever had sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"10","FUReference":"End of program","MeanTreat":"0.38","MeanComp":"0.40","TpperES":"-0.052","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"4": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Risky sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-BL sexual exp.","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.208","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"5": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Risky sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-males","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.051","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"6": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Risky sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-BL sexual exp.","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.191","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"7": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Risky sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.208","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"8": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Risky sex","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Subgroup-females","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.385","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"9": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Ever preg","OutcomeDomain":"Pregnancy","OutcomeDichotomous":"Yes","SampleType":"Subgroup-BL sexual exp.","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.113","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"10": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Ever sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-BL sexual exp.","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.208","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"11": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Recent sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-males","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.174","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"12": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Recent sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-BL sexual exp.","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.071","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"13": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Recent sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full Sample","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.208","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"14": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Recent sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-females","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.225","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"},"15": {"ProgramName":"Teen Outreach Program (TOP)","StudyID":"PPRER014011","ManuscriptID":"PPRER017476","sid":"237","Rating":"High","OutcomeName":"Recent sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup-BL sexual exp.","FUTimingMonths":"0","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"-0.290","StatSigRepEffect":"Yes","RepEffectFavorable":"Yes","RepEffectMeet":"Yes"}}

NA = Not available. This means the authors did not report the information in the manuscripts associated with the studies we reviewed.

a This information was not available whenever authors did not report information for the treatment and comparison groups separately on outcome means, standard deviations, and/or sample sizes.

b Authors reported that the program effect (impact) estimate is statistically significant with a p-value of less than 0.05 based on a two-tailed test.

c For some outcomes, having less of that outcome is favorable. In those cases, an effect with a negative sign is favorable to the treatment group (that is, the treatment group had a more favorable outcome than the comparison group, on average).

d An effect shows credibly estimated, statistically significant evidence whenever it has a p-value of less than 0.05 based on a two-tailed test, includes the appropriate adjustment for clustering (if applicable), and it is not based on an endogenous subgroup.

Details

A more recent study conducted by a separate group of researchers evaluated the program among a sample of 26 Florida high schools. The study randomly assigned schools in matched pairs to either a treatment group that offered the program during the regular school day or a control group that provided the regular school instruction. Surveys were administered before the program started (baseline), immediately after the program ended, and 10 months after the program ended.

Using data for the full sample of male and female adolescents, the study successfully replicated the favorable program impact on pregnancy reported in the earlier study by Allen et al. (1997). In particular, for the follow-up conducted at the end of the program, the study found that students in the treatment group were less likely to report ever having been pregnant (females) or gotten someone pregnant (males)(odds ratio = 0.58). The study found a similar pattern of results for the longer-term follow-up survey conducted 10 months after the program ended (odds ratio = 0.51).

The study also found a statistically significant program impact on sexual activity rates. In particular, for the follow-up conducted at the end of the program, the study found that students in the treatment group were statistically significantly less likely to report ever having had sex (odds ratio = 0.84, confidence internal = 0.78 to 0.90). The study found no statistically significant program impact on this outcome for the longer-term follow-up survey conducted 10 months after the program ended.