Asking the right questions: Opportunities and challenges of survey methods in widening participation research

Article Sidebar

PDF
Published: Dec 31, 2018
Keywords:
survey design questionnaire development pilot testing widening participation higher education student equity

Main Article Content

Bethan Collins
Clive Hunt
Alex Wardrop
Lizzie Gauntlett
Vanessa Heaslip
Maggie Hutchings
Colin Pritchard

Abstract

The development of an institution-wide survey at one English university raised questions for the researchers in relation to how to ask students about their background. The survey was to focus future widening participation (WP) practice. A detailed iterative process was undertaken to design the institution-wide survey, which included pilot testing and qualitative focus groups with students, from which the results of this paper are drawn. We highlight two areas for consideration: the first, consists of issues of survey design and deployment in an education context generally, and the second, of specific issues relating to survey methods in widening participation research and practice. Students willingly participate in a survey when its aims are clear, when it is easy to complete and when it is perceived to be of ultimate benefit to them. Students in this study did not mind responding to questions about their widening participation status but needed the reason for these questions to be overt and the question to be phrased in a manner that is straightforward and easy to understand. A key learning point from developing the survey was that, in our attempts to use what we thought was more positive, politically correct language, we used euphemistic terms which had the unwanted effect of causing confusion amongst the students. We question whether the use of euphemism clouds the potential reality of inequality and that to uncover and act upon this inequality – surely the aim of WP practice – we need to directly ask students about their experience of disadvantage. Our reluctance to ask direct questions was to avoid offending students and based, problematically, on our underlying assumptions about the shame and stigma attached to disadvantage. These unconscious beliefs about shame and stigma need to be brought into conscious awareness and challenged if we are to address inequality in higher education.

Article Details

How to Cite
Collins, B., Hunt, C., Wardrop, A., Gauntlett, L., Heaslip, V., Hutchings, M., & Pritchard, C. (2018). Asking the right questions: Opportunities and challenges of survey methods in widening participation research. Access: Critical Explorations of Equity in Higher Education, 5(2), 55–69. Retrieved from https://novaojs.newcastle.edu.au/ceehe/index.php/iswp/article/view/105
Issue
Vol. 5 No. 2 (2018)
Section
Research Paper
Copyright is retained by the author.

References

BIS. (2014). National strategy for access and student success in higher education (BIS/14/516). London: Department for Business, Innovation & Skills.

Bowes, L. (2015). Student opportunity outcomes framework research: In-depth study report to HEFCE by CFE research. Bristol: HEFCE.

Burke, P., & Hayton, A. (2012). Is widening participation still ethical? Widening Participation and Lifelong Learning, 13(1), 8-26.

Burke, P.J., Hayton, A., & Stevenson, J. (2018). Evaluating Equity and Widening Participation in Higher Education. London: Trentham Books.

Callender, C., Griggs, J., & Ramsden, P. (2014). Review of the National Student Survey: Report to the UK Higher Education Funding Bodies by NatCen Social Research, the Institute of Education, University of London and the Institute for Employment Studies. Bristol: HEFCE.

Cheng, J.H.S., & Marsh, H. W. (2010). National Student Survey: Are differences between universities and courses reliable and meaningful? Oxford Review of Education, 36(6), 693-712.

Crawford, C., Dytham, S., & Naylor, R. (2017). Improving the evaluation of outreach:

Interview report. Bristol: OFFA.

Crenshaw, K. (1989). Demarginalizing the intersection of race and sex: A black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum, 1(8), 139-167.

Dillman, D.A. (2011). Mail and Internet Surveys: The Tailored Design Method - 2007 Update with New Internet, Visual, and Mixed-Mode Guide. New Jersey: Wiley & Sons.

Ellis, S.J. (2009). Diversity and inclusivity at university: A survey of the experiences of lesbian, gay, bisexual and trans (LGBT) students in the UK. Higher Education, 57(6), 723-739.

Equality Act 2010. London: The Stationery Office.

European Commission/EACEA/Eurydice. (2014). Modernisation of Higher Education in Europe: Access, retention and employability 2014: Eurydice Report. Luxembourg: Publications Office of the European Union.

Glaser, B., & Strauss, A. (1967). The discovery of grounded theory. Chicago: Aldine.

Greenbank, P. (2003). The role of values in educational research: The case for reflexivity. British Educational Research Journal, 29(6), 791-801.

Hagyard, A. (2009). Student intelligence: Challenging received wisdom in student surveys. In L. Bell, H. Stevenson & M. Neary (Eds.), The future of higher education: Policy, pedagogy and the student experience (pp. 112-125). London: Continuum.

Harrison, N., & McCaig, C. (2015). An ecological fallacy in higher education policy: The use, overuse and misuse of low participation neighbourhoods. Journal of Further and Higher Education, 39(6), 793-817.

HEFCE. (2015). Differences in degree outcomes: The effect of subject and student characteristics. Bristol: Higher Education Funding Council for England. Retrieved from www.hefce.ac.uk/media/HEFCE,2014/Content/Pubs/2015/201521/

HEFCE2015_21.pdf

HEFCE. (2017). POLAR4 classification: A local geography classification for young participation in higher education.

Higher Education and Research Act 2017. Chapter 29. Retrieved from http://www.legislation.gov.uk/ukpga/2017/29/pdfs/ukpga_20170029_en.pdf

Hunt, C., Collins, B., Wardrop, A., Hutchings, M., Heaslip, V., &

Pritchard, C. (2017). First- and second-generation design and engineering students: Experience, attainment and factors influencing them to attend university. Higher Education Research and Development, 32(5), 706-721.

Marshall, B., Reay, D., & Wiliam, D. (1999). “I found it confrontational”: Rethinking questionnaires as a large-scale research instrument. Paper presented at the British Educational Research Association Annual Conference, University of Sussex at Brighton, September 2-5, 1999. Retrieved from http://www.leeds.ac.uk/educol/

documents/00001363.htm

Mountford-Zimdars, A., & Harrison, N. (2016). Access to higher education: Theoretical perspectives and contemporary challenges. London: Routledge.

OFFA. (2015). Celebrating ten years of access agreements. Retrieved from https://www.offa.org.uk/uncategorized/celebrating-ten-years-of-access-agreements/

OFFA. (2016). Strategic guidance: Developing your 2017-18 access agreement. Bristol: Office for Fair Access.

OfS. (2018). A new approach to regulating access and participation in English higher education: Consultation. Bristol: Office for Students. Retrieved from https://www.officeforstudents.org.uk/media/b6e62c0c-e056-40c3-a2bd-0a5a25678bf2/ofs2018_33.pdf

Reed, R., King, A., & Whiteford, G. (2015). Re-conceptualising sustainable widening participation: Evaluation, collaboration and evolution. Higher Education Research & Development, 34(2), 383-39.

Richardson, J.E., Slater, J.B., & Wilson, J. (2007). The National Student Survey: Development, findings and implications. Studies in Higher Education, 32(5), 557-580.

Rubin, M., Denson, N., Kilpatrick, S., Matthews, K.E., Stehilk, T., & Zyngier, D. (2014). “I am working-class”: Subjective self-definition as a missing measure of social class and socioeconomic status in higher education research. Educational Researcher, 43(2), 196-200.

Shah, M., Bennett, A., & Southgate, E. (Eds.). (2015). Widening higher education participation: A global perspective. Cambridge: Chandos Publishing.

Stern, M.J., Bilgen, I. & Dillman, D.A. (2014). The State of Survey Methodology: Challenges, Dilemmas, and New Frontiers in the Era of the Tailored Design. Field Methods, 26(3), 284-301.

The Sutton Trust. (2015). Evaluating Access. London: The Sutton Trust.

Thomas, L. (2012). Building student engagement and belonging in higher education at a time of change: Final report from the What Works? Student Retention & Success programme. London: Paul Hamlyn Foundation.

Waller, R., Harrison, N., & Last, K. (2015). Building a culture of participation: Interviews with the former directors of the national Aimhigher programme. Project Report. Bristol: University of the West of England. Retrieved from http://eprints.uwe.ac.uk/27225

Wardrop, A., Hutchings, M., Collins, B., Eccles, S., Heaslip, V., Hunt, C., & Pritchard, C. (2016). Troubling ideas for widening participation: How higher education institutions in England engage with research in their access agreements. Widening Participation and Lifelong Learning, 18(2), 84-110.

Wittenbrink, B., Judd, D., & Parl, B. (1997). Evidence for racial prejudice at the implicit level and its relationship with questionnaire measures. Journal of Personality and Social Psychology, 72(2), 262-274.