Using Photovoice in Mixed Methods Evaluation of a School-based Equity Program: Navigating Logistics and Ethics

Abstract Information: The roundtable investigates the conceptualization and implementation of photovoice as a data collection method, specifically, within a multi-year evaluation design for a school-based equity program. Photovoice is a participatory inquiry approach combining photography and narratives. We incorporated photovoice as part of the evaluation design to facilitate students’ expression of their experiences and perspectives through their own words and aligned with their individual preferences, ranging from how they felt about self-disclosure to their sense of aesthetics.

The evaluated program is a four-day summer camp for underrepresented incoming students at a public selective-admissions secondary school. The camp is in its third year of evaluation. Our mixed methods evaluation design used field observations, interviews (with teachers and students), facilitated debriefs and listening sessions, and surveys (of teachers, students, mentors, and parents) alongside photovoice activities to produce valuable qualitative and quantitative data that can illuminate several aspects of the program. Evaluation questions probed the camp’s purpose, eligibility criteria, and benefits and experience for students. Our findings from the photovoice data emphasized its uniqueness as a form of incorporating student voices in program development and decision-making. The data indicated that photovoice enabled students to visually and narratively express their thoughts and aspirations about joining their new school. Our challenges with conducting the photovoice component included time constraints and orchestrating logistical and technical steps: photo organization and sharing, narrative writing, implementing norms for photo taking and sharing, and facilitating a layered informed consent process. Our experience highlights the importance of a) clear guidance and teaching about photovoice, b) transparent discussion of its broad ethical considerations across different stakeholders, and c) ample space for interpreting the photovoice data with students and deliberating on its appropriate use with other audiences (e.g., parents).

During the roundtable, this evaluation case is used to foster a broader discussion about the affordances and issues with photovoice methodology. We provide data examples to support collective analysis on how photovoice data can be interpreted alongside other qualitative and quantitative data. Additionally, we discuss photovoice’s presumed benefits (e.g., fostering students’ sense of agency and bolstering their active participation). Finally, based on our evaluation, we offer insights on the logistics and ethics of utilizing photovoice methodology, especially in schools with young people.

Sample Roundtable Questions:
1. For what kinds of evaluation questions and under what types of circumstances, do you think photovoice is an appropriate and ethical methodology to employ?
2. What are creative ways to engage specific populations (who you work with) in photovoice? How can you make the photo taking and narrative capturing process engaging for participants?
3. How can evaluators balance the need for quality data collection with the time-intensive nature of photovoice?
4. How can evaluators improve communication and instruction to participants about the photovoice process?
5. What are some strategies for addressing the ethical concerns related to photovoice?
6. How can we ensure participants' comfort in sharing their photos and narratives? For example, how can we assess (and address) student comfort levels in presenting their photos and narratives to parents?