How do we know what we don’t know about the Program Evaluation Standards (PES)? Critical Review of PES to Understand Constructs and Navigate Pain Points

Abstract Information: The Program Evaluation Standards (PES) produced by the Joint Committee on Standards for Educational Evaluation (JCSEE) are the official source for evaluation standards in the United States and Canada and a foundational document of the American Evaluation Association. Last updated in 2010, the third edition of the PES is still widely used across many types of program evaluation but is now due for an update. As such, the JCSEE has undertaken a critical review of the PES to identify core constructs, pain points, and navigational strategies. During this demonstration session, JCSEE members will draw on their assessment to (1) identify primary and secondary constructs embedded in each standard; (2) demonstrate how less prominent (e.g., implicit) constructs in the standards can be crucial to everyday practice; (3) articulate pain points in interpretation and use of standards; and (4) demonstrate how practitioners navigate seen and unseen pain points to incorporate the standards in evaluation to meet diverse aims. Throughout the session, all attendees will be engaged in a real-time, interactive exercise to validate the constructs and pain points presented based on their experience. The participation of a diverse group of evaluation practitioners and theorists in this process is critical for providing input and feedback on the revision of this most important set of standards for evaluators in North America.