104 - Benefits, challenges, and lessons learned from a coordinated umbrella approach to High Impact Program Evaluation Projects at CDC’s Division of HIV Prevention

Abstract Information: We propose to initiate this session by sharing an overview of our coordinated umbrella approach to evaluation projects and information on our current processes. We then plan on co-facilitating peer-to-peer learning by posing questions to session participants and engaging in reflective discussion. OVERVIEW The Translation and Evaluation Branch in CDC’s Division of HIV Prevention leads the coordination of High Impact Program Evaluation Projects (HIPEPs). Evaluation projects under this umbrella program seek to increase CDC’s knowledge about HIV prevention service delivery with collection of qualitative data from funded recipients to complement quantitative efforts in monitoring CDC-funded programs. HIPEPs involve collaboration among multidisciplinary staff across different teams and organizational units and are designed to: -Identify challenges and areas for improvement in HIV prevention service delivery; -Improve performance measures, data collection and tools for CDC Notice of Funding Opportunities in HIV Prevention; and -Translate evaluation findings to inform guidelines, programs, and future research. Current HIPEP processes include the following elements: -Contract support in designing evaluation instruments, collecting and analyzing data, and generating reports; -Project management (e.g., standardizing the roles of the evaluation project lead and team members); -Call for proposals solicitation in generating new evaluation concepts; and -Coordinating through a workgroup in monitoring evaluation project progress and disseminating findings, best practices, and lessons learned. Current projects under HIPEP address the following evaluation questions: -How are CDC-funded health departments reducing HIV-related health disparities? -How have state and local Health Departments’ HIV prevention programs evolved in response to national HIV strategies, COVID-19, and mpox? -What factors are associated with successful implementation of an evidence-based intervention to link those with HIV to care and treatment? PEER-TO-PEER LEARNING After presenting an overview, we then propose facilitating peer-to-peer learning by posing questions (see below) to session participants. Potential Benefits of Coordinating Evaluation Projects -Does anyone have a similar program like the HIPEPs within your organization? If so, have you seen any benefits from your coordinated approach to evaluation? -If you don’t have such a program, what benefits do you think you might encounter in using a coordinated approach, such as HIPEP, within your organization? Potential Challenges -What challenges might be experienced in using a coordinated approach to evaluation projects? -What coordination tools would be helpful in addressing challenges? Methods -What methods can be used to evaluate if and how a coordinated approach to evaluation projects yields benefits beyond what would have been experienced without such coordination? -How would Best Practices and Lessons Learned be identified? GOAL FOR THE SESSION Our goal is to collaboratively engage evaluators of all backgrounds in exploring new ideas and approaches. We will foster inclusivity, valuing all perspectives and points of view as we facilitate mutual learning about coordinated approaches to evaluation projects including the benefits, challenges, and lessons learned. We additionally hope this session will inform our plans for further evaluating the HIPEP process, assist in distilling methods and measurement strategies, and contribute to incorporating diverse prospectives from evaluators at all stages of their careers into our work.