Critical Evaluation through the lens of Indigenous Data Sovereignty

Main Article Content

Lien Pham

Abstract

This paper advances a critical evaluation approach to student equity in higher education, framed through the lens of Indigenous Data Sovereignty (IDS). Rooted in emancipatory foundations, IDS provides a paradigmatic and practice-based model for transforming extractive data practices to community-led, ethically grounded evaluation. The IDS CARE Principles—Collective Benefit, Authority to Control, Responsibility, and Ethics—offers a concrete framework for participatory, culturally accountable, and justice-oriented evaluation. The paper offers an illustrative application of how these principles can be operationalised in evaluating university initiatives that support students from refugee backgrounds. While IDS offers valuable guidance, it is grounded in the specific rights, histories, and self-determination of Indigenous peoples. These principles must not be appropriated or used to replace Indigenous-led evaluation by non-Indigenous actors. Rather, this paper draws on IDS for evaluation in broader equity contexts to promote relational accountability and evaluator reflexivity. It centres evaluation on the lived experiences of those most affected and calls for a redistribution of power as a pathway to systemic change—advancing justice for the very communities that student equity policies and programs are intended to support.

Article Details

How to Cite
Pham, L. (2025). Critical Evaluation through the lens of Indigenous Data Sovereignty. Access: Critical Explorations of Equity in Higher Education, 13(1), 92–114. Retrieved from https://novaojs.newcastle.edu.au/ceehe/index.php/iswp/article/view/237
Section
Article

References

AIATSIS 2020 AIATSIS Code of Ethics for Aboriginal and Torres Strait Islander Research. Accessed on June 24, 2025 from https://aiatsis.gov.au/research/ethical-research/code-ethics

Behrendt, L, Larkin, S, Griew, R, & Kelly, P 2012 Review of Higher Education Access and Outcomes for Aboriginal and Torres Strait Islander People: Final Report. Department of Industry, Innovation, Science, Research and Tertiary Education. Accessed on July 1 from https://nla.gov.au/nla.obj-2817044867/view

Bradley, D, Noonan, P, Nugent, H & Scales, B 2008 Review of Australian Higher Education: Final Report. Department of Education, Employment and Workplace Relations. Accessed on July 10, 2025, from https://apo.org.au/sites/default/files/resource-files/2008-12/apo-nid15776.pdf

Calzada, I 2021 ‘Data co-operatives through data sovereignty’, Smart Cities, 4(3) pp. 1158–1172.

Carroll, S. R, Garba, I, Figueroa-Rodríguez, O. L, Holbrook, J, Lovett, R, Materechera, S, Parsons, M, Raseroka, K, Rodriguez-Lonebear, D, Rowe, R, Sara, R, Walker, J. D, Anderson, J & Hudson, M 2020 ‘The CARE Principles for Indigenous Data Governance. Data Science Journal’, 19(1) pp. 1–12.

Carroll, S. R, Garba, I, Plevel, R, Small-Rodriguez, D, Hiratsuka, V. Y, Hudson, M & Garrison, N. A 2022 Using Indigenous standards to implement the CARE Principles: Setting expectations through tribal research codes. Frontiers in Genetics, 13, Article 823309. https://doi.org/10.3389/fgene.2022.823309

Commonwealth of Australia 2023 Higher Education Support Amendment (Response to the Australian Universities Accord Interim Report) Bill 2023: Explanatory Memorandum. https://www.education.gov.au/new-requirements-support-students

Carroll, S. R, Duarte, M & Liboiron, M 2024 ‘Indigenous Data Sovereignty’, in J. Burrell, R. Singh & P. Davison (Eds.), Keywords of the Datafied State. Data & Society, pp. 206–223.

Connell, R 2019 The good university: What universities actually do and why it’s time for radical change. Monash University Publishing.

Coram, S. 2009 Encountering disregard in Australian academe: The subjective perspective of a disaffiliated racial “other”. British Journal of Sociology of Education, 30(3) pp. 259–27.

Department of Employment, Education and Training (DEET) 1990 A fair chance for all: Higher education that’s within everyone’s reach. Canberra, Australian Capital Territory, Australian Government Publishing Service.

Department of Education (Cth) 2024 Australian Universities Accord Final Report. Accessed on June 25, 2025 from https://www.education.gov.au/australian-universities-accord/resources/final-report

Détourbe, M.A & Goastellec, G 2018 Revisiting access to higher education and stratification through the lens of refugees: A comparative study of England, France, and Switzerland, International Journal of Lifelong Education, 37(6) pp. 663–675.

Elias, B, O’Neil, J & Sanderson, D 2004 ‘The politics of trust and participation: A case study in developing First Nations and university capacity to build health information systems in a First Nations context’, Journal of Aboriginal Health, 1(1), pp. 68–78.

Ernstberger, J, Lauinger, J, Elsheimy, F, Zhou, L, Steinhorst, S, Canetti, R, Miller, A, Gervais, A, & Song, D 2022 SoK: Data sovereignty. Accessed on 1 July, 2025 from https://eprint.iacr.org/2023/967.pdf

Ferrero, L, Maffei, S, Villari, B & Arquilla, V 2020 Participatory design in refugee camps: Comparing tools, methods, and levels of engagement, The Design Journal, 23(3) pp. 431–452.

First Nations Information Governance Centre (FNIGC) 2014 The fundamentals of OCAP®. Accessed on July 10, 2025, from https://fnigc.ca/ocap-training/.

Freire, P 1970 Pedagogy of the oppressed. New York: Continuum.

Funnell, S, Tanuseputro, P, Letendre, A, Bourque Bearskin, L & Walker, J 2020 “Nothing about us, without us”: How community-based participatory research methods were adapted in an Indigenous end-of-life study using previously collected data, Canadian Journal on Aging / La Revue canadienne du vieillissement, 39(2) pp. 145–155.

Gale, T & Parker, S 2013 Widening participation in Australian higher education. Report submitted to the Higher Education Funding Council for England (HEFCE) and the Office for Fair Access (OFFA).

Greene, J. C 2005 Evaluating for the public good: Reflections on the past and future of evaluation, American Journal of Evaluation, 26(2) pp. 208–214.

Harris, A, Spark, C & Burnett, L 2015 Critical multiculturalism and education, Review of Education, Pedagogy, and Cultural Studies, 37(4) pp. 299–302.

Harris, A, Marlowe, J & Nyuon, N 2015 Rejecting Ahmed’s “melancholy migrant”: South Sudanese Australians in higher education, Studies in Higher Education, 40(7) pp. 1246–1258.

Harris, M. F, Smith, J & Waller, S 2021 Co-designing health interventions with refugee communities: A scoping review, International Journal of Environmental Research and Public Health, 18(18) p. 9771.

Hellmeier, M, Pampus, J, Qarawlus, H & Howar, F 2023 Implementing data sovereignty: Requirements & challenges from practice, ARES 2023: Proceedings of the 18th International Conference on Availability, Reliability and Security, Article No. 143, 1-9. Accessed on December 2, 2025, from https://dl.acm.org/doi/10.1145/3600160.3604995

Hummel, P, Braun, M, Tretter, M & Dabrock, P 2021 Data sovereignty: A review, Big Data & Society, 8(1) pp. 1–17.

Kukutai, T & Taylor, J 2016 Indigenous data sovereignty: Toward an agenda. Canberra: ANU Press.

Kukutai, T & Walter, M 2015 Indigenous data sovereignty: Retooling institutions of power. In J. Taylor & T. Kukutai (Eds.), Indigenous data sovereignty: Toward an agenda. ANU Press.

Lenette, C 2016 University students from refugee backgrounds: Why should we care?, Higher Education Research & Development, 35(6), pp. 1311–1315.

Lenette, C 2019 ‘Always the ideal? Exploring the risks of refugee participation in research’, Refuge: Canada’s Journal on Refugees, 35(1) pp. 102–114.

Lowitja Institute 2023 ‘Indigenous Data Sovereignty – Policy Brief’, Lowitja Institute. Accessed on December 2, 2025, from https://www.lowitja.org.au/wp-content/uploads/2023/07/Indigenous-Data-Sovereignty-Policy-Brief.pdf.

Maiam nayri Wingara 2018 Indigenous Data Sovereignty Communique. Accessed on June 15, 2025 from https://www.maiamnayriwingara.org/

Mertens, D. M 2009 Transformative research and evaluation. New York: Guilford Press.

Mestan, K 2022 ‘Career guidance for culturally and linguistically diverse migrants and refugees: Findings from the first Australia-wide study’, International Journal of Educational Research, 115, 102046.

Molla, T 2021 ‘Refugees and equity policy in Australian higher education’, Journal of Education Policy, 36(1) pp.41–61.

Molla, T. and Brook, L. (2019). ‘Refugee higher education in Australia: Expanding educational capabilities’, International Journal of Educational Development, 70, 102083.

Mulder, C, Debassige, D, Gustafson, M, Slater, M, Eshkawkogan, E & Walker, JD 2022 ‘Research, Sovereignty and Action: Lessons from a First Nations-Led Study on Aging in Ontario’, Healthc Q. 24(SP) pp. 93-97.

Murray, R & Gray, H 2021 Forced migrants in higher education: ‘Sanctuary scholarships’ in a hostile environment, Journal of Ethnic and Migration Studies, 49(3) pp. 795–812.

Patton, M. Q 1997 Utilization-focused evaluation: The new century text. Thousand Oaks, CA: Sage.

Patton, M. Q 2011 Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press.

Rainie, SC, Kukutai, T, Walter, M, Figueroa-Rodriguez, OL, Walker, J & Axelsson, P 2019 Issues in Open Data: Indigenous Data Sovereignty. In: Davies, T, Walker, S, Rubinstein, M and Perini, F (Eds.), The State of Open Data: Histories and Horizons. Cape Town and Ottawa: African Minds and International Development Research Centre. pp. 300–319.

Ramsay, G, Baker, S, Miles, L & Irwin, E 2016 Reimagining support models for students from refugee backgrounds: Understandings, spaces and empowerment, in Davis, M. and Goody, A. (Eds.) Research and Development in Higher Education: The Shape of Higher Education. Fremantle: HERDSA, pp. 279–288.

Schwandt, T. A 2015 Evaluation foundations revisited: Cultivating a life of the mind for practice. Stanford, CA: Stanford University Press.

Sellar, S, Gale, T & Parker, S 2011 Conceptualising equity in higher education: Mapping the discourses, Australian Educational Researcher, 38(1) pp. 23–43.

Sparke, C & McMillan, F 2022 Indigenous research sovereignties: Sparking pedagogical and epistemological disobedience, Journal of Intercultural Studies, 43(2) pp. 134–150.

Sen, A 1999 Development as freedom. Oxford: Oxford University Press.

Walker, J, Lovett, R, Kukutai, T, Jones, C & Henry, D 2017 Indigenous health data and the path to healing, The Lancet, 390(10107), pp. 2022–2023.

Walter, M 2021 Data politics and Indigenous representation in Australian statistics, Statistical Journal of the IAOS, 37(1), pp. 1–9.

Walter, M, Lovett, R, Maher, B, Williamson, B, Prehn, J, Bodkin Andrews, G & Lee, V 2020 Indigenous data sovereignty in the era of big data and open data, Australian Journal of Social Issues, 56(2), pp. 143–156.

Walter, M & Suina, M 2019 Indigenous data, Indigenous methodologies and Indigenous data sovereignty, International Journal of Social Research Methodology, 22(3) pp. 233–243.

White, J 2017 The banality of exclusion in Australian universities, International Journal of Inclusive Education, 21(11) pp. 1119–1127.

Williamson, B, Provost, S & Price, C 2022 Operationalising Indigenous data sovereignty in environmental research and governance, Environment and Planning F 2(1–2) pp. 281–304.