A Qualitative Exploration of Indicators of Digital Assessment Quality in Remote Education
Keywords:
Digital assessment quality, remote education, qualitative study, assessment validity, technical reliability, student engagement, educational equityAbstract
This study aims to qualitatively explore the key indicators of digital assessment quality in remote
education from the perspectives of educators and assessment specialists. A qualitative research design
was employed, utilizing semi-structured interviews with 19 participants from educational institutions in
Tehran. Data collection continued until theoretical saturation was reached. The interviews were audiorecorded, transcribed verbatim, and analyzed thematically using NVivo software to identify major
themes, subthemes, and concepts related to digital assessment quality. Thematic analysis revealed three
main themes influencing digital assessment quality: (1) assessment validity and fairness, highlighting
the importance of clear criteria, authentic tasks, inclusivity, scoring consistency, bias mitigation, and
effective feedback mechanisms; (2) technical and logistical reliability, encompassing platform stability,
data security, technical support, device compatibility, consistent delivery, and proctoring integrity; and
(3) pedagogical and student experience, focusing on student engagement, clarity of instructions, selfregulated learning support, communication, and perceived assessment value. Participants emphasized
the interconnectedness of these dimensions in ensuring equitable, valid, and effective assessments in
remote learning environments. The findings underscore that high-quality digital assessment in remote
education requires a holistic approach addressing pedagogical, technical, and fairness-related factors.
Clear communication, inclusive design, reliable technology, and supportive feedback are critical
components. These insights offer practical guidance for educators and institutions striving to enhance
digital assessment practices, especially in contexts with rapid shifts to remote education.
Downloads
References
Al-Azawei, A., Serenelli, F., & Lundqvist, K. (2017). Universal Design for Learning (UDL): A content analysis of peer-reviewed journal
papers from 2012 to 2015. Journal of the Scholarship of Teaching and Learning, 16(3), 39-56. https://doi.org/10.14434/josotl.v16i3.19295
Bakia, M., Shear, L., Toyama, Y., & Lasseter, A. (2012). Understanding the Implications of Online Learning for Educational Productivity.
U.S. Department of Education, Office of Educational Technology.
Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning
environments: A systematic review. The Internet and Higher Education, 27, 1-13. https://doi.org/10.1016/j.iheduc.2015.04.007
Buchanan, T. (2020). Assessment in online and blended learning environments. In S. Conrad & A. Donaldson (Eds.), Assessment for learning
in higher education (pp. 129-145). Routledge.
Dendir, S., & Maxwell, R. S. (2020). Cheating in online courses: Evidence from online proctoring. Computers in Human Behavior Reports,
2, 100033. https://doi.org/10.1016/j.chbr.2020.100033
Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 5-22.
https://doi.org/10.1177/0047239520934018
Eaton, S. E. (2020). Academic integrity during COVID-19: Reflections from the University of Calgary. International Studies in Educational
Administration, 48(1), 80-85.
Farrokhnia, M. R., Saeedi, S., & Areshi, A. (2021). Digital transformation in education: Iranian teachers’ perspectives during the COVID-19
pandemic. Education and Information Technologies, 26(4), 4647-4667. https://doi.org/10.1007/s10639-021-10540-y
Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers
& Education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004
Heinrich, E., Milne, J., & Moore, M. (2021). Developing an evaluation framework for digital assessment in higher education. Assessment &
Evaluation in Higher Education, 46(5), 792-807. https://doi.org/10.1080/02602938.2020.1838097
JISC. (2015). Transforming assessment and feedback with technology. JISC Guide. https://www.jisc.ac.uk/guides/transforming-assessmentand-feedback
Kearns, L. R. (2012). Student assessment in online learning: Challenges and effective practices. MERLOT Journal of Online Learning and
Teaching, 8(3), 198-208.
Ng, S. F. (2021). Assessing assessment: Challenges and innovations in online assessment. Education and Information Technologies, 26,
5669-5685. https://doi.org/10.1007/s10639-021-10601-2
Nicol, D. (2009). Assessment for learner self-regulation: Enhancing achievement in the first year using learning technologies. Assessment &
Evaluation in Higher Education, 34(3), 335-352. https://doi.org/10.1080/02602930802255139
Nguyen, T., Netto, C. L. M., Wilkins, J. F., Bröker, P., Vargas, E. E., Sealfon, C. D., ... & Palen, L. A. (2021). Insights into students’
experiences and perceptions of remote learning methods: From the COVID-19 pandemic to best practice for the future. Frontiers in
Education, 6, 647986. https://doi.org/10.3389/feduc.2021.647986
O’Shea, S., Stone, C., & Delahunty, J. (2021). “We need to talk about online learning”: A qualitative exploration of student expectations and
experiences. Higher Education Research & Development, 40(7), 1382-1396. https://doi.org/10.1080/07294360.2020.1862598
Redecker, C., & Johannessen, Ø. (2013). Changing assessment—Towards a new assessment paradigm using ICT. European Journal of
Education, 48(1), 79-96. https://doi.org/10.1111/ejed.12018
Volume 2, Issue 4
9
Reeves, T. C., & Lin, L. (2020). Formative and summative assessment in online education. In M. G. Moore & W. C. Diehl (Eds.), Handbook
of Distance Education (4th ed., pp. 304-315). Routledge.
Rienties, B., Daza, V., & Giesbers, B. (2022). Unpacking the complexity of learning analytics: A review of studies examining digital
assessment and feedback in higher education. British Journal of Educational Technology, 53(5), 1181-1201.
https://doi.org/10.1111/bjet.13191
Selwyn, N., O’Neill, C., Smith, G., Andrejevic, M., & Gu, X. (2021). Face-to-face with the future: Academic perspectives on digital
assessment in the post-pandemic university. Learning, Media and Technology, 46(4), 442-458.
https://doi.org/10.1080/17439884.2021.1943480
Sotiriadou, P., Logan, D., Daly, A., & Guest, R. (2020). The role of remote proctoring in assessment: Managing security and risk. Assessment
& Evaluation in Higher Education, 45(4), 514-528. https://doi.org/10.1080/02602938.2019.1699021
Winstone, N. E., & Boud, D. (2023). The role of feedback in student learning: New perspectives from the assessment and feedback literature.
Assessment & Evaluation in Higher Education, 48(2), 259-272. https://doi.org/10.1080/02602938.2022.2064926
Zimmerman, B. J., & Schunk, D. H. (2011). Handbook of self-regulation of learning and performance. Routledge.
Downloads
Published
Submitted
Revised
Accepted
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
