Democratizing Community Engagement and Empowering Voices in Evaluation: Lessons from India

Abstract Information: In India, the COVID-19 pandemic has caused widespread human suffering through outbreaks and economic disruptions, leading to significant loss of lives and livelihoods. These challenges have hit socially and economically disadvantaged communities the hardest, exacerbating their existing vulnerabilities. The situation has highlighted the need for evaluators to adapt and innovate in the face of uncertain and dynamic circumstances. Concurrently, ongoing debates about transforming evaluation practices have underscored the importance of democratizing evaluation within a decolonizing framework. By empowering communities with agency, enabling them to set priorities, define success, and actively participate in designing their evaluations, evaluation practices can be transformed. The decolonization of evaluation involves rethinking traditional methodologies that are rooted in colonial perspectives, embracing local knowledge, values, voices, and ways of knowing, and respecting diverse cultures.

Drawing from our experiences conducting evaluations in India during the COVID-19 pandemic, this paper advocates for positioning communities at the core of evaluation practices to focus on their needs, perspectives, and voices. This approach requires engaging community members at every step of the evaluation process—from defining evaluation questions to collecting data, analyzing findings, and making informed decisions. Through three specific case studies, this paper underscores vital lessons learned from evaluating in the midst of the COVID-19 crisis and explores how these insights could inform the process of democratizing community engagement and empowering voices in evaluation.

Furthermore, the paper examines the approaches evaluators took to conduct research and evaluation activities during the pandemic, with a focus on the essential competencies for fostering a space where marginalized community members can participate equally in the design and implementation of evaluations. It addresses adaptability, communication, ethical considerations, and the influence of community involvement on evaluation outcomes. Recent experiences have alerted evaluators to ethical dilemmas, raising questions about the evaluator's role in the evaluation process, both in terms of the methods to be adopted and the questions to be asked.

Collaborating with grassroots organizations and communities was crucial for evaluations conducted both during the pandemic and after its intensity had begun to subside. Although this is not new, COVID-19 highlighted the dire need to genuinely understand community contexts and also be aware of the deep differences in the diversities of contexts. The pandemic highlighted the critical imperative to involve communities in both the planning and the implementation of the study. While such an imperative has always been known to evaluators, the pandemic highlighted with urgency the need to start our work by understanding community perspectives.

The paper finally argues that strategic thinking and emotional intelligence are crucial skills that enable evaluators to collaborate effectively with grassroots organizations and co-design evaluations with community members. Such partnerships allow evaluators to go beyond the limitations of project interventions and contribute to broader objectives.