Judgment, flourishing, and the composting of evaluation through Reflective Dialogue
Main Article Content
Abstract
In an era of ecological collapse, deliberate assaults on knowledge, and deepening inequities, the field of evaluation is still shaped by dominance logics, including positivist, colonial, technocratic, and patriarchal ways of seeing. These harmful frames are present, persistent as toxins in the soil. They distort what counts as knowledge, whose voice is heard, and what forms of flourishing are possible. We call for composting these logics through Reflective Dialogue (RD), a living, relational stance that re-grounds evaluation as an interpretive act of judgment accountable to equity and justice. Drawing on justice-oriented lineages, Indigenous and feminist epistemologies, and traditions of practical wisdom, we position RD as the living soil that sustains evaluative practice.
Through critique, metaphor, and practice-based vignettes, we show how RD interrupts the illusion of neutrality, redistributes epistemic power, and turns denial into nourishment for new possibilities. We contrast old ways of evaluation that collapse judgment into siloed, tidy narratives with new ways that co-create meaning, break the frame, and hold space for discomfort, uncertainty, and transformation. We include an appendix that translates RD into concrete evaluator actions, observable shifts in behavior, and survival strategies for working inside harmful systems and enacting an RD-orientation.
Article Details
References
Alkin, M. C & Christie, C.A (Eds.) 2019. Evaluation roots: Theory influencing practice (3rd ed.). SAGE Publications.
Boyce, A. S, Reid, A, Avent, C, Adetogun, A, Moller, J. R & Hooks Singletary, B 2023 ‘Social justice as ontology: The intersection of Black evaluators’ identity, role, and practice.’ American Journal of Evaluation, 44(3) pp. 528–548. https://doi.org/10.1177/10982140221108664
Brown, M.J 2020 Science and moral imagination: A new ideal for values in science. University of Pittsburgh Press.
Chouinard, J.A & Milley, P 2018 ‘Uncovering the mysteries of inclusion: Empirical and methodological possibilities in participatory evaluation in an international context.’ Evaluation and Program Planning, 67 pp. 70–78. https://doi.org/10.1016/j.evalprogplan.2017.12.001
Cousins, J.B & Whitmore, E 1998 ‘Framing participatory evaluation.’ New Directions for Evaluation, 1998, 5–23. https://doi.org/10.1002/ev.1114
Cram, F 2016 ‘Lessons on decolonizing evaluation from Kaupapa Māori evaluation.’ Canadian Journal of Program Evaluation, 30(3), 296–312.
Cram, F 2018 ‘Conclusion: Lessons about indigenous evaluation.’ New Directions for Evaluation, 2018(159), 121–133.
Dahler-Larsen, P 2012 The Evaluation Society (1st ed.). Stanford University Press. https://doi.org/10.2307/j.ctvqsdq12
Greene, J. C 2006 ‘Evaluation, democracy, and social change.’ The Sage Handbook of Evaluation, pp. 118–140.
Harro, B 2000 ‘The Cycle of Socialization.’ In M. Adams, W. Blumenfeld, R. Castaneda,H. Hackman, M. Peters. & X. Zuniga (Eds.), Readings for diversity and social justice, pp. 16–21. Routledge.
Hirschman, A. O. 1991 The rhetoric of reaction: Perversity, futility, jeopardy. Harvard University Press. https://doi.org/10.2307/j.ctvjnrs9q
House, E. R 1993 Professional evaluation: Social impact and political consequences. Sage Publications.
Huff, S. R 2025 Between Empathy and Exhaustion: Exploring Compassion Fatigue in Program Evaluation. Doctoral Dissertation.
Kirkhart, K.E 1995 ‘Seeking multicultural validity: A postcard from the road.’ Evaluation Practice, 16(1) pp. 1–12.
Kirkhart, K.E. 2005 ‘Through a cultural lens: Reflections on validity and theory in evaluation.’ In S. Hood, R. Hopson, & H. Frierson (Eds.), The role of culture and cultural context: A mandate for inclusion, the discovery of truth, and understanding in evaluative theory and practice (pp. 21-39). Greenwich, Connecticut: Information Age Publishing.
Kuhn, T. S 1962 The structure of scientific revolutions. University of Chicago Press: Chicago
LaFrance, J & Nichols, R 2008 ‘Indigenous Evaluation Framework: Telling our story in our place and time.’ Alexandria, VA: American Indian Higher Education Consortium (AIHEC).
LaFrance, J & Nichols, R 2010 ‘Reframing evaluation: Defining an Indigenous Evaluation Framework.’ Canadian Journal of Evaluation, 23, pp. 13–31.
Linnell, D. J & Montrosse-Moorhead, B 2023 ‘Navigating the boundaries between evaluators and similar applied professionals.’ Evaluation, 30(1), pp. 138–161. https://doi.org/10.1177/13563890231213643
Mertens, D. M 2009 Transformative research and evaluation. New York, NY: Guildford Press
Montrosse-Moorhead, B, Schröter, D & Becho, L. W 2024 ‘The garden of evaluation approaches.’ American Journal of Evaluation, 45(2) pp. 166–185. https://doi.org/10.1177/10982140231216667
Picciotto R 2016 ‘Evaluator anxiety in an inequitable world.’ In M. M. Anthony & M. B. Stein (Eds.), Evaluation for an equitable society (pp. 217–235). Information Age Publishing.
Picciotto R 2022 ‘The psychology of evaluation.’ Evaluation and Program Planning, 94, 102120. https://doi.org/10.1016/j.evalprogplan.2022.102120
Reid, A. M, Boyce, A. S, Adetogun, A, Moller, J. R & Avent, C 2020 ‘If not us, then who?: Evaluators of color and social change.’ New Directions for Evaluation, 166 pp. 23–36.
Schwandt, T. A 2002 Evaluation practice reconsidered. Peter Lang Publishing.
Schwandt, T. A & Gates, E. F 2021 Evaluating and valuing in social research. The Guilford Press.
Scriven, M 1967 The methodology of evaluation. In R. W. Tyler, R. M. Gagné, & M. Scriven (Eds.), Perspectives of curriculum evaluation (pp. 39–83). Rand McNally.
Scriven, M 1991 Evaluation thesaurus (4th ed.). Sage Publications.
Scriven, M 2013 ‘The foundation and future of evaluation.’ In S. I. Donaldson & M. Scriven (Eds.), The future of evaluation in society: A tribute to Michael Scriven (pp. 11–44). Information Age Publishing.
Shadish, W. R., Jr., Cook, T. D & Leviton, L. C 1991 Foundations of program evaluation: Theories of practice. Sage Publications.
Symonette, H 2004 ‘Walking pathways toward becoming a culturally competent evaluator: Boundaries, borderlands, and border crossings.’ New Directions for Evaluation, 102 pp. 95–109.
Tovey, T.L.S & Archibald, T 2023 ‘The relationship between reflective practice, evaluative thinking, and practical wisdom.’ In S. Donaldson & M. Hurteau (Eds.), Practical wisdom for an ethical evaluation practice. Information Age Publishing.
Tovey, T.L & Onwuka du Bruyn, O.O 2025 ‘Our frame is everything: Insights from a Reflective Dialogue on positionality in evaluation.’ American Journal of Evaluation, 10982140251392821.
Waapalaneexkweew (Bowman, N, Mohican/Lunaape) & Dodge-Francis, C 2018 ‘Culturally responsive indigenous evaluation and tribal governments: Understanding the relationship.’ In F. Cram, K. A. Tibbetts, & J. LaFrance (Eds.), Indigenous Evaluation. New Directions for Evaluation, 159, pp. 17–31.
Wehipeihana, N 2019 ‘Increasing cultural competence in support of Indigenous-led evaluation: A necessary step toward Indigenous-led evaluation.’ Canadian Journal of Program Evaluation, 34(2) pp. 368–384.
Wittgenstein, L 1953 Philosophical investigations (G. E. M. Anscombe, Ed.). Wiley-Blackwell.