Advancing the Use of Social Network Analysis in Program Evaluation: An Introduction to SNA-Evaluation Conceptual Framework

In recent years, the complexity of social programs has necessitated collaborative efforts across organizational, sectoral, and geographical boundaries to effectively address societal challenges (Benjamin & Greene, 2009). These collaborative efforts often form intricate networks of actors, posing methodological challenges for evaluators seeking to understand network structures and relationships within programs (Durland & Fredericks, 2005).

Despite mounting interest in employing Social Network Analysis (SNA) to explore and evaluate these complex networks, evaluators encounter several barriers. These include a dearth of empirical evidence substantiating the effectiveness of SNA in program evaluation, limited practical guidance on when and how to apply SNA methodologies, and a tendency to provide superficial descriptions rather than rigorous analyses of network dynamics. Moreover, existing literature often fails to comprehensively address the specific needs and practices of program evaluation, resulting in disparate approaches across the field.

Given the need to structure the use of SNA in program evaluation, this study developed an SNA-Evaluation Conceptual Framework to facilitate the use of SNA in program evaluation. More importantly, it demonstrated the systematic approach used to create the conceptual framework by addressing three assumptions: (1) the nature of reality, (2) the justifications of knowledge, and (3) the methods used for this knowledge (Shadish et al., 1991, p. 42). In addition, this study offered SNA-Evaluation Screening Tools with an integrated checklist of fundamental elements to support evaluators. As such, this session will summarize and share the work within the framework of the 2024 Theme: Amplifying and Empowering Voices in Evaluation by empowering evaluators with innovative instruments noted above to (a) understand why SNA matters in program evaluation, (b) determine when and how to apply the SNA method, and (c) advance the evaluation methodology for better learning, understanding, decision-making, and judging.