Skip to main content
Evaluation 2024 Main banner
Icon Legend
Presentation Icons
Birds of a Feather
Birds of a Feather
Pres Strand
Pres Strand
Extra Cost
Extra Cost
Ignite
Ignite
TIG Multipaper
TIG Multipaper
General/Social
General/Social

Birds of a Feather

Mixed Methods Evaluation

Session: Birds of a Feather

45 - Small but mighty: Creatively navigating evaluation constraints to build trust and amplify authentic voices

Stream: Evaluation Foundations and Methodology

Friday, October 25, 2024
12:45 PM - 1:15 PM PST
Location: Exhibit Hall A
Birds of a Feather
Abstract Information: The Centers for Disease Control and Prevention (CDC) has had to identify nontraditional ways to evaluate some of its public health leadership training programs. One program is the Future Leaders in Infections and Global Health Threats (FLIGHT) fellowship. FLIGHT has small cohorts consisting of two or three participants each; the limited sample size makes collecting and interpreting qualitative and quantitative evaluation data a substantial challenge. One key consideration is that participants might hesitate to share candid feedback because of concern about inadvertent disclosure of their identity during the evaluation. In this session, evaluators and advisors involved with FLIGHT will lead a discussion to explore challenges and possible solutions associated with navigating small, potentially identifiable participant pools with an emphasis on amplifying authentic participant voices. The authors will share what we have learned based on our research and experience about potential ethical, methodological, contextual, and interpersonal considerations, and will facilitate a discussion to learn from other AEA evaluators. Possible questions to explore during this session include the following: How can we increase opportunities to hear a participant’s fullest voice when working with small sample sizes? How do evaluators navigate confidentiality concerns and limitations? What implications might confidentiality have on the utility, accuracy, and depth of data? How can we ensure that our methods and analysis build a culture of trust around evaluation? What experiences can other AEA evaluators share where they navigated similar challenges?