282 - Using A Values-Engaged Educative Approach to Evaluate the GEMS Project: Critical Friendship To Support Project Improvement

Abstract Information: Evaluation is best used not just as a measurement tool, but as a transformative process that can empower stakeholders and drive positive change (Hooks-Singletary, Boyce, & Reid, 2023). The Values-Engaged Educative (VEE) approach to evaluation emphasizes the importance of evaluator intentionality in fostering high-quality STEM education that integrates advanced scientific content, effective pedagogy, and a commitment to diversity and equity (Reid, 2020; Boyce, 2017; Greene, Boyce, & Ahn, 2011). The VEE approach also seeks to educate interest holders about their program while also engaging the perspectives, concerns, and values of all legitimate stakeholders, including those traditionally unheard and underrepresented in the evaluation context (Boyce, 2017).

Funded by the NSF through the Biology Integration Institute (BII), the Genomics and Eco-evolution of Multi-Scale Symbiosis (GEMS) project is an educational initiative that focuses on the interactions between clover and honeybee pollinators, using a multidisciplinary approach to understand the complexities of nested genomes and their ecosystem impacts. The evaluation uses mixed methods to capture a comprehensive view of the program, addressing questions related to program theory, implementation, equity, effectiveness, communication, outcomes, and sustainability.

The purpose of this poster is to share our use of the VEE approach in the context of the evaluation of GEMS, highlighting our reflections about how this method improves collaborative relationships, critical reflection, and helps to incorporate diverse stakeholder values. Central to our work is the concept of critical friendship, where we intentionally position ourselves in a role where we can provide constructive feedback in an effective and welcome manner. We will share reflections regarding how critical friendship (Fetterman, 2019) has supported project improvement and practical strategies for building and maintaining mutually beneficial relationships. We aim to inspire evaluators, especially those evaluating similar NSF funded STEM education projects, by sharing a practical real-world application of the VEE approach, and how they can incorporate values, equity and social justice considerations into their evaluations (Boyce, 2017; Greene, Boyce, & Ahn, 2011).