Advancing Internal Program Evaluation: Practical Insights from CHW Hub's Integrated Approach

Abstract Information: The field of internal program evaluation is pivotal for program success, necessitating methodologies that are both effective and adaptable to evolving contexts and stakeholder needs. The City of San Antonio Metropolitan Health District established the Community Health Workers Hub (CHW Hub) to empower community health workers, aiming to enhance resilience in vulnerable and underrepresented communities facing health challenges, notably COVID-19. This presentation introduces a pioneering framework from the CHW Hub, designed to advance internal evaluation practices through an integrated, multifaceted approach, emphasizing inclusivity and empowerment. The CHW Hub's internal evaluation framework uniquely combines tools and strategies, including staff education, Lean Six Sigma, and Agile methodologies. It prioritizes engaging the community impacted by the program, which is crucial for enhancing program outcomes, fostering a culture of continuous improvement, enabling adaptive management across various initiatives, and ensuring the evaluation process itself becomes a tool for empowerment and inclusivity. Key Aspects of Our Framework Include: Education and Development: We ensure that both our team and stakeholders' teams are equipped with essential evaluation skills and comprehensive evaluation plans, making them active participants and beneficiaries of the evaluation process. Two examples will be showcased at both the organizational and community health workers' levels, highlighting our emphasis on mentorship and leadership opportunities. Application of Lean Six Sigma Principles: examples from the program of how Lean Six Sigma principles (Define, Measure, Analyze, Improve, and Control) streamline evaluation processes, reduce inefficiencies, and enhance quality, thereby delivering greater value to stakeholders and improving program outcomes. Incorporating Agile Methodologies: Our adaptation of Agile's flexible, iterative approach to internal evaluation promotes responsiveness to change, emphasizes the voice of the community, and fosters a culture of continuous learning and improvement. This methodology ensures our evaluations are dynamic and inclusive, effectively capturing the diverse needs and voices of our stakeholders. A Comprehensive Methodological Toolkit: Featuring a mix of qualitative and quantitative methods, participatory approaches, audience-based data visualization, and digital analytics, our toolkit enriches our evaluation practices. It enables us to uncover deeper insights and drive effective program improvements informed by a broad spectrum of perspectives. In this presentation, we will explore the development, implementation, and impact of the CHW Hub's integrated internal evaluation framework, highlighting both the gains achieved and the challenges encountered. Attendees will gain a comprehensive understanding of how our innovative approach has transformed internal program evaluation and serves as a model for prioritizing diverse perspectives, empowering community voices, and fostering leadership within the field of program evaluation.