Leveraging Evaluation Data in the Development of an Implementation Fidelity Instrument to Support Program Expansion

Abstract Information: In this presentation, evaluators will share their journey of crafting an implementation fidelity instrument tailored for CarolinaTIP, a university-based induction program dedicated to increasing teacher retention by supporting novice teachers. The evaluation team has been engaged with the program since its inception in 2017. The instrument, which is crafted to gauge the implementation of the program's coaching model, acts as a data collection tool for evaluators and aids in program development. While the coaching approach had been well-defined by the program team and its effectiveness had been established by evaluators, the absence of official documentation hindered its replicability beyond its current geographical footprint. The presentation will unveil the evaluators' efforts to codify the program’s coaching model by drawing insights from six years of evaluation data. Evaluators will share the process of developing and refining this detailed instrument and will discuss the methodologies and analyses employed. Presenters will also highlight the importance of embracing a variety of perspectives on an evaluation team, demonstrating how the inclusion of both veteran and novice team members offers mentorship for newcomers while bringing new viewpoints and valuable insights to seasoned evaluation practitioners. The presentation will underscore the role of the instrument in enhancing CarolinaTIP from both an evaluative and programmatic perspective, ultimately advancing teacher support and educational outcomes. In addition, the presenters will lead a discussion about the relevant takeaways for evaluators crafting an implementation fidelity instrument. Attendees will be encouraged to actively engage with the content, offering valuable insights and fostering collaborative dialogue to further enrich implementation fidelity assessment in the evaluation field.