Study Details

Citation

Coyle, Karin, K., Susan C. Potter, Jill R. Glassman, and Liz McDade-Montez. Process and Impact Evaluation of Keep It Real South Carolina: Reducing Teen Pregnancy Among Middle School Youth. ETR, Report prepared for the Office of Adolescent Health, U.S. Department of Health Human Services, August 2015a.

Potter, S. C., Coyle, K. K., Glassman, J. R., Kershner, S., Prince, M. S. (2016). It's your game. . .keep it real in south carolina: A group randomized trial evaluating the replication of an evidence-based adolescent pregnancy and sexually transmitted infection prevention program. American Journal of Public Health, 106, S60-S69. doi:10.2105/AJPH.2016.303419

Program or Component Study?
Program
Program or Component Name

It's Your Game: Keep it Real (IYG)

Show Evidence of Effectiveness
No
Study Rating and Explanation
Moderate

Random assignment study that did not meet the criteria for a high rating but met the criteria for a moderate rating; findings show no positive, statistically significant impact on a relevant behavioral outcome measure for either the full sample or key subgroup.

Program Information

Program Type
Sexual health education
Program Length
10 to 20 sessions

Evaluation Setting

Evaluation Setting
In school: Middle school

Study Sample

Average Age Group
13 or younger
Majority Racial/Ethnic Group
White
Gender
Youth of any gender

Research Design

Assignment Method
Cluster randomized controlled trial
Sample Size

2487

Number of Follow-Ups

2

Length of Last Follow-Up

12-18 months

Year of Last Data Collection
2014

Study Findings

Result Sexual Activity
Potentially unfavorable evidence
Result Contraceptive
Indeterminate evidence
Reviewed Studies
Moderate-Quality Randomized Trial
Protocol Version
Version 5.0
Details

In a more recent study conducted by a separate group of researchers, the program was evaluated in a cluster randomized controlled trial involving students from 24 rural middle schools in South Carolina. Twelve schools were randomly selected to deliver the two-year program in 7th and 8th grades. Twelve other schools were randomly selected for a control group that continued implementing their usual health and sex education program.The study findings failed to replicate the favorable program effects found in the earlier studies by Tortolero et al. (2009) and Markham et al. (2012, 2014). For the 9th grade follow-up, students in the treatment schools were more likely than those in the control schools to report having initiated sexual activity, and the reported effect size for this estimate (odds ratio is 1.27) falls outside of the confidence interval of the impact estimate reported in the initial study (0.61 to 0.98). The study also examined program impacts at the time of the 9th grade follow-up on measures of sexual activity in the past three months and sexual activity without use of effective contraception or a condom in the past three months. The study did not find statistically significant program impacts on those outcomes.

Effect Sizes
{"0": {"ProgramName":"It's Your Game: Keep it Real (IYG)","StudyID":"PPRER014012","ManuscriptID":"PPRER014012","Rating":"Moderate","OutcomeName":"Had sex without effective birth control in the past 3 months","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"12","FUReference":"End of program","MeanTreat":"0.07","MeanComp":"0.06","TpperES":"0.061","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"1": {"ProgramName":"It's Your Game: Keep it Real (IYG)","StudyID":"PPRER014012","ManuscriptID":"PPRER014012","Rating":"Moderate","OutcomeName":"Had sex in the past 3 months","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"12","FUReference":"End of program","MeanTreat":"0.16","MeanComp":"0.14","TpperES":"0.129","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"2": {"ProgramName":"It's Your Game: Keep it Real (IYG)","StudyID":"PPRER014012","ManuscriptID":"PPRER014012","Rating":"Moderate","OutcomeName":"Initiation of sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup--BL sexually experienced","FUTimingMonths":"6","FUReference":"End of program","MeanTreat":"0.15","MeanComp":"0.13","TpperES":"0.101","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"},"3": {"ProgramName":"It's Your Game: Keep it Real (IYG)","StudyID":"PPRER014012","ManuscriptID":"PPRER014012","Rating":"Moderate","OutcomeName":"Initiation of sex","OutcomeDomain":"Sexual Activity","OutcomeDichotomous":"Yes","SampleType":"Subgroup--BL sexually experienced","FUTimingMonths":"12","FUReference":"End of program","MeanTreat":"0.25","MeanComp":"0.21","TpperES":"0.146","StatSigRepEffect":"Yes","RepEffectFavorable":"No","RepEffectMeet":"Yes"},"4": {"ProgramName":"It's Your Game: Keep it Real (IYG)","StudyID":"PPRER014012","ManuscriptID":"PPRER014820","Rating":"Moderate","OutcomeName":"Had sex without a condom in past 3 months","OutcomeDomain":"Contraceptive Use","OutcomeDichotomous":"Yes","SampleType":"Full sample","FUTimingMonths":"12","FUReference":"End of program","MeanTreat":"NA","MeanComp":"NA","TpperES":"0.159","StatSigRepEffect":"No","RepEffectFavorable":"Not significant","RepEffectMeet":"No"}}

NA = Not available. This means the authors did not report the information in the manuscripts associated with the studies we reviewed.

a This information was not available whenever authors did not report information for the treatment and comparison groups separately on outcome means, standard deviations, and/or sample sizes.

b Authors reported that the program effect (impact) estimate is statistically significant with a p-value of less than 0.05 based on a two-tailed test.

c For some outcomes, having less of that outcome is favorable. In those cases, an effect with a negative sign is favorable to the treatment group (that is, the treatment group had a more favorable outcome than the comparison group, on average).

d An effect shows credibly estimated, statistically significant evidence whenever it has a p-value of less than 0.05 based on a two-tailed test, includes the appropriate adjustment for clustering (if applicable), and it is not based on an endogenous subgroup.