How engaging an AI “stakeholder at the table” can help expand and amplify collective knowledge
Stream: Evaluation Foundations and Methodology
Wednesday, October 23, 2024
4:15 PM - 5:15 PM PST
Location: Portland Ballroom 252
Abstract Information: Ready or not, artificial intelligence (AI) is becoming part of the practice of evaluation and systems change. For many AI is being used primarily as an efficiency tool; yet it can be so much more. This session will explore how to engage AI as a thought partner at the table with other voices when evaluations are seeking to understand how, why and under what conditions change is happening in complex, dynamic systems. We will build on the participatory, inclusive approaches highlighted by the Causal Pathways Initiative and explore how AI is a tool for collectively strengthening contextual and causal knowledge. The demonstration will include examples from projects where ChatGPT and Petal AI was “at the table” with systems conveners, evaluators, and other stakeholders. Each case example focuses on advancing equity, ranging from addressing slavery and forced labor to advancing equitable and liberatory education. The presenter and audience will engage the AI platforms in a discussion in real time. Participants can join on their own laptops (and are encourged to have their ChatGPT free accounts set up in advance) or through the presenter's projected screen. Participants will leave the session having explored how different AI platforms respond in real time, learn about how to approach the prompts during the conversation, explore how to identify and manage bias, and ultimately consider how AI can be a stakeholder alongside other voices in their evaluations.