15 - Developmental Evaluation as an approach to balance multiple voices

Abstract Information: This session examines how evaluators can be intentional about amending evaluation practice to balance multiple voices - especially previously excluded voices. Catholic Relief Service’s (CRS) ‘Nabadoon Reconciliation Activity’ in Somalia has an in-built developmental evaluation (DE). This approach to evaluation ensures systematic elevation of diverse voices across different contexts, within Somalia. The Developmental Evaluation approach includes opportunities to hear voices that have not been traditionally part of the evaluation design process. For example, the acculturation workshop invites a diverse group of individuals to refine research questions that the evaluation will explore. Individuals include district authorities, civil society members, community leaders, representatives from youth and women groups and other peace and natural resource management committees. The Developmental Evaluator facilitates the workshop, advocating for moving from findings to action, working collaboratively with key diverse stakeholders, and relying on the three key driving questions: “What?”, “So What?”, and “Now What?”. Incorporating evidence from two acculturation workshops, the session lead will speak to how they’ve used this as an opportunity to elevate different voices. They will speak to how the workshop ensures interactive engagement and empowerment of local leadership in the program. They will provide examples of how the developmental evaluation has given space for the project to include diverse voices in its theory of change and/or expected outcomes; Nabadoon has modified the initial ‘Theory of Change’ over time based on stakeholder voices and evidence. The Nabadoon Developmental Evaluator has worked collaboratively to conceptualize, design, and intentionally test new approaches to expanding the types of voices engaged in conversations on activity results. They have also consistently gathered information about the context and situation dynamics, so that the practices and lessons around what worked well and what did not work well are meaningful and context based. Finally, they have shared the findings/learning via means and mediums that best meet the needs of the program's diverse stakeholders, the different types of products include ‘Options Memo’, ‘2-5 pagers, and recommendation trackers. Active participation of diverse stakeholders in designing and implementing developmental evaluation enables project teams to tolerate some ambiguity and uncertainty along the way. This is because the processes built into developmental evaluations provide timely evidence for the team to be able to decide and act with confidence. Ultimately, one of the most important outcomes of a Developmental Evaluation is that it builds ownership amongst all stakeholders around whether and to what extent the project succeeds and improves people’s lives. This session will discuss additions or amendments they've made to evaluation practice in multicultural contexts to balance multiple voices.