Building Skills in AI Integration for Culturally Responsive and Equitable Evaluation: A Cross-Disciplinary Approach

Abstract Information: This interactive session explores the integration of Artificial Intelligence (AI) into program evaluation as a means to promote culturally responsive and equitable evaluation (CREE) practices, aligning with AEA's Guiding Principles of respect for people, responsibilities for general and public welfare, and integrity/honesty. Drawing from multiple disciplines, including public health, education, organizational leadership, psychology, and legal, the session provides a cross-disciplinary perspective on leveraging AI to enhance evaluation methodologies. Through engaging discussions and case study analyses, participants will examine the potential of AI techniques such as Natural Language Processing (NLP) and predictive analytics in qualitative and quantitative evaluations. Specifically, the session will demonstrate how NLP can facilitate the analysis of complex qualitative data while predictive analytics can anticipate trends and inform data-driven decision-making, enabling more culturally sensitive program adjustments. The session will critically explore the ethical and legal frameworks necessary for employing AI in evaluation, addressing issues such as algorithmic bias, privacy concerns, transparency, and stakeholder engagement. Participants will engage in interactive exercises to develop strategies for mitigating risks, adhering to ethical standards, and ensuring compliance with relevant laws and regulations, thereby protecting and respecting all participants in the evaluation process. Through collaborative activities and knowledge-sharing, attendees will gain practical insights and strategies for incorporating AI into their evaluation practices, tailoring evaluation frameworks to reflect the cultural specificities of diverse communities. The session will foster an environment where participants can learn from each other's experiences across various disciplines, collectively contributing to the advancement of CREE principles. By the end of the session, attendees will have a comprehensive understanding of how AI can be thoughtfully and ethically integrated into program evaluation, enhancing their ability to promote equity, inclusivity, and respect across diverse evaluation contexts. The session contributes to AEA members' professional development and learning, equipping them with the knowledge and skills to harness technology in advancing CREE principles and addressing the unique needs of diverse communities.