Implementing a National Evaluation to Demonstrate Reach and Impact of the National Network of STD Clinical Prevention Training Centers

Background:  In 2014 the Centers for Disease Control and Prevention (CDC) funded a national evaluation of the National Network of STD Clinical Prevention Training Centers (NNPTC) with two important goals: (1) to measure the reach of the NNPTC’s training activities with an emphasis on expanding reach to primary care providers in high STD morbidity areas and (2) to measure the impact of training on practice patterns to screen for, diagnose, and treat STDs.

Methods:  Qualitative methods and the funding logic model informed common evaluation measures. The national electronic registration system launched April 1, 2015; the national evaluation system launched mid-July, 2015.  Trainees are invited to complete an online evaluation of training satisfaction, applicability to practice, and intention to change practices immediately post-training and to self-report practice changes 90 days post-training.  We created an algorithm for measuring reach based on trainees’ functional role, practice setting, characteristics of patients served, and county incidence of CT, GC, syphilis, HIV, and/or AIDS greater than CDC’s Atlas national rate. We conducted descriptive analysis of reach, satisfaction, use of the CDC’s 2015 STD Treatment Guidelines, and intended and self-reported changes in STD clinical practices over time.

Results:  Registration data for 3 quarters show that 63.5% of trainees (1,771/2,791) fall into the one of four target audiences, all in high morbidity counties. Evaluation data from 2 quarters show that 61.1% of evaluation respondents in the target audiences (610/999) intend to change at least one STD clinical practice.  Data from trainees 90 days post-training to measure actual changes is just starting to come in. [Data will be updated to include 2 additional quarters of data, plus 9 months of follow-up data, before submission if accepted].

Conclusions:  A national evaluation can measure reach to target audiences and impact of training on clinical practice to inform allocation of limited resources.