Thursday, July 18, 2019
Hello Evaluators! I’m
Tom Grayson, former member of the AEA Board of Directors, retired as Director of Evaluation in Student Affairs at the University of Illinois in Champaign-Urbana. Currently, I am an evaluation practitioner, consultant and facilitator.
The jazz singer and song writer, Benard Ighner, composed, “Everything must change”. The opening
lyrics are, “Everything must change, Nothing stays the same, Everyone must change, No one
stays the same.” So be it with the field of evaluation.
As evaluation methods change from a focus on “context-input-process-product” and “goals-based” models, we must create new ways of designing and conducting evaluations regarding innovations in partnerships, businesses, education, social services, the private sector, development agencies and donors, academia and society.
The primary theme in the book,
Getting to Maybe (2006), is that there is no road map for social innovation. This implies a change in evaluation methods to capture and articulate the raison d’être of non-profits, i.e., “changed lives.” For social innovators, the raison d’être is “changed systems that can change lives” (pages 51 – 52). The authors provide real-life examples of social change through complex systems and relationships and they tease out rules of engagement between volunteers, leaders, organizations and circumstances and between culturally diverse individuals.
Evaluators need to assist innovators in articulating their values, passions, commitments and challenges, then guide them into thinking evaluatively.
Another example of evaluation in times of change is highlighted in a
Blue Marble (2019) webinar conducted by Michael Q. Patton and Jerry Hage. They talk about social service evaluators as being guided by principles. The unit of analysis is the evaluand (not just programs or projects, which are fundamentally closed systems). Guided principles are primarily used in complex systems, innovations, and social systems.
An important point when evaluating social innovations is that we cannot control outcomes. As is stated by Zimmerman & Patton, “…getting comfortable with acting in the face of uncertainty is part of being an [evaluator]”. Remember, “Everything must change”.
Rad Resources: https://www.utilization-focusedevaluation.org/blue-marble-evaluation-resources.
Westley, F., Zimmerman, B., & Patton, M.Q. (2007).
Getting to Maybe. Random House of Canada, Toronto.
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. 
About AEA
The American Evaluation Association is an international professional association and the largest in its field. Evaluation involves assessing the strengths and weaknesses of programs, policies, personnel, products and organizations to improve their effectiveness. AEA’s mission is to improve evaluation practices and methods worldwide, to increase evaluation use, promote evaluation as a profession and support the contribution of evaluation to the generation of theory and knowledge about effective human action. For more information about AEA, visit www.eval.org.