Summarizing Evaluation Reports with ChatGPT: A New Tool in Program Analysis

Abstract Information: The advent of AI and machine learning technologies offers unprecedented opportunities for analyzing and disseminating the results of program evaluations. This session, titled "Summarizing Evaluation Reports with ChatGPT: A New Tool in Program Analysis" aims to demonstrate and explore the integration of ChatGPT in summarizing and disseminating evaluation results by enhancing our ability to synthesize data, generate insights, and communicate findings more effectively. The session will include a live demonstration of ChatGPT 4.0 to explore evaluations located within the USAID Development Experience Clearinghouse, and generate one-pagers that summarize methodology, key findings, and recommendations, among others. The last half of this session will engage participants directly and explore the quantitative and qualitative analytical power of ChatGPT 4.0 through a live polling exercise. Audience members will be asked to respond to a series of questions. Data collected will be analyzed in real-time to explore how ChatGPT can performing analysis, create summaries, or answer specific questions based on audience provided content. This session will demonstrate how ChatGPT can facilitate real-time, interactive discussions on evaluation findings, allowing participants to explore data in a group setting, and stimulate a collective discussion around data analysis, ethical considerations, and the future of evaluations in the digital age.