What counts? Who counts? Ethical evaluation in access and participation

Main Article Content

Ruth Squire

Abstract

In England, evaluation of access and participation work has become a regulatory expectation in higher education (HE), with the goal of producing ‘learning’ to influence practice. As demand for the product of evaluation has grown, guidance for evaluators has focused on methods, with limited reference to evaluation ethics. This is despite research pointing to the importance for who is included in evaluation and for how evidence, knowledge and different values are distributed. Where ethics guidance exists, it focuses on defining ethical evaluation practices and securing ethical approval in an HE context. There is little space for the everyday ethics in navigating the power structures of institutions, the pressures of marketized HE, or the sense of responsibility that can come from inviting people’s stories.  


This paper explores the co-researched experiences of thirteen evaluators working in this context and how they navigate ethical challenges, looking beyond individuals determining ethical conduct to considering the powers that enable or constrain it. We argue for evaluation ethics that considers evaluation as a process, not product, and situates the evaluator in a network of responsible parties. We also point to the value of relationships in creating space for ethical considerations that can support evaluation for social justice.

Article Details

How to Cite
Squire, R. (2025). What counts? Who counts? : Ethical evaluation in access and participation. Access: Critical Explorations of Equity in Higher Education, 13(1), 77–91. Retrieved from https://novaojs.newcastle.edu.au/ceehe/index.php/iswp/article/view/236
Section
Article

References

Alexander, L. B & Richman, K.A 2017 ‘Ethical Dilemmas in Evaluations Using Indigenous Research Workers.’ American Journal of Evaluation, 29(1), 73–85. https://doi.org/10.1177/1098214007313023

Anderson, O & Nelson, M 2021 Post-16 education and labour market activities, pathways and outcomes (LEO). Department for Education. https://www.gov.uk/government/publications/ post-16-education-and-labour-market-activities-pathways-and-outcomes-leo

Bowl, M, McCaig, C & Hughes, J 2018 ‘Equality and differentiation in marketised higher education: A new level playing field?’ Palgrave studies in excellence and equity in global education. Palgrave.

Braun, V & Clarke, V 2019 ‘Reflecting on reflexive thematic analysis.’ Qualitative Research in Sport, Exercise and Health, 11 (4) pp. 589–597. DOI:10.1080/2159676X.2019.1628806.

Gordon, R.B, Lumb, M., Bunn, M. & Burke, P. J 2022 ‘Evaluation for equity: reclaiming evaluation by striving towards counter-hegemonic democratic practices.’ Journal of Educational Administration and History, 54:3, pp. 277–290.

Greene J.C 2005 ‘Evaluators as stewards of the public good.’ In Hood S, Frierson H, Hopson R (Eds.), The role of culture and cultural context (pp. 7–20). Charlotte, NC: Information Age Publishing.

Keightley, E, Pickering, M & Allett, N 2012 ‘The self-interview: a new method in social science research.’ International Journal of Social Research Methodology. 15(6) pp. 507–521. DOI: 10.1080/13645579.2011.632155

Kelly, C.G 2022 Exploring the influences of evaluation on widening participation practice and strategy decision-making in English Higher Education providers. PhD Thesis. University of Bristol.

Leone, L, Stame, N & Tagle, L 2016 ‘Exploring ethical issues and conditions for institutionalizing evaluation in the public sector.’ Evaluation, 22(2), pp. 149–167. https://doi. org/10.1177/1356389016640626

Masvaure, S, Fish, T, Chirau, T, Mzhike, S, Morkel, C (Eds.) 2024 Evaluation as a mechanism to foster an equitable society in the Global South. AOSIS.

Moores, E, Summers, R. J, Horton, M, Woodfield, L, Austen, L & Crockford, J 2023 ‘Evaluation of access and participation plans: Understanding what works.’ Frontiers in Education (Lausanne), 8. https://doi.org/10.3389/feduc.2023.1002934

Office for Students 2024 Higher Education Evaluation Library. Accessed at https://www.officeforstudents.org.uk/for-providers/equality-of-opportunity/centre-for-transforming-access-and-student-outcomes-in-higher-education/higher-education-evaluation-library/

Onyura, B, Main, E, Barned, C, Wong, A, Vo, T. D, Chandran, N, Torabi, N & Hamza, D. M 2023 ‘The “What” and “Why” of (Un)Ethical Evaluation Practice: A Meta-Narrative Review and Ethical Awareness Framework.’ Canadian Journal of Program Evaluation, 38(2) pp. 265–312. https://doi.org/10.3138/cjpe-2023-0023

Picciotto, R 2017 ‘Evaluation: Discursive practice or communicative action?’ Evaluation, 23(3) pp. 312–322.

Picciotto, R 2018 ‘Accountability and learning in development evaluation: A commentary on Lauren Kogen’s thesis.’ Evaluation, 24(3) pp. 363–371. https://doi.org/10.1177/1356389018781361

Picciotto, R 2021 ‘Evaluation as a social practice: Disenchantment, rationalities and ethics.’ Evaluation and Program Planning, 87. https://doi.org/10.1016/j.evalprogplan.2021.101927

Rainford, J 2019 Equal practices? A comparative study of widening participation practices in pre and post-92 higher education institutions. Doctoral thesis, Staffordshire University. Accessed at https://eprints.staffs.ac.uk/5610/

Rogers, P 2016 ‘Understanding and supporting equity: Implications of methodological and procedural choices in equity-focused evaluations.’ In Donaldson S and Picciotto R (eds) Evaluation for an Equitable Society. Charlotte, NC: Information Age Publishing

Schwandt, T. A 2017 ‘Professionalization, Ethics, and Fidelity to an Evaluation Ethos.’ American Journal of Evaluation, 38(4) pp. 546–553. https://doi.org/10.1177/1098214017728578

Schwandt, T. A 2018 ‘The Concerted Effort to Professionalize Evaluation Practice. Whither Are We Bound?’ In Furubo J.E & Stame N, The Evaluation Enterprise. New York: Routledge.

Schwandt, T. A 2018b ‘Acting together in determining value: A professional ethical responsibility of evaluators.’ Evaluation, 24(3) pp. 306–317. https://doi.org/10.1177/1356389018781362

Schwandt, T. A & Gates, E. F 2016 ‘What can evaluation do? An Agenda for Evaluation in Service of an Equitable Society.’ In Donaldson S and Picciotto R (eds) Evaluation for an Equitable Society. Charlotte, NC: Information Age Publishing

Social Mobility Commission. State of the Nation 2024. Social Mobility Commission. https://socialmobility.independent-commission.uk/app/uploads/2024/09/State-of-the-Nation-2024.pdf

Stame, N 2006 ‘Governance, Democracy and Evaluation.’ Evaluation, 12(1) pp. 7–16. https://doi.org/10.1177/1356389006064173

Stame, N. 2018 ‘Strengthening the ethical expertise of evaluators.’ Evaluation, 24(4) pp. 438–451. https://doi.org/10.1177/1356389018804942

Squire. R 2022 ‘Third sector organisations: multi-level enactors of widening participation.’ In McCaig, C, Rainford, J, & Squire, R (2022). The Business of Widening Participation: Policy, Practice and Culture. Emerald Publishing.

Squire, R 2022 ‘Third Sector Organisations in Widening Participation Policy: Authority, Order and Expertise.’ Doctoral dissertation, Sheffield Hallam University. Accessed at https://shura.shu.ac.uk/30604/1/Squire_2022_PhD_ThirdSectorOrganisations.pdf

TASO 2022 Research Ethics Guidance. Accessed at: https://taso.org.uk/libraryitem/research-ethics-guidance/

TASO 2024 What we do. Accessed at: https://taso.org.uk/about/what-we-do/