Evaluation in the Trap of Error: Identifying Common Evaluation Errors in the Context of E-Learning
Keywords:
Evaluation, evaluation errors, e-learning, meta-synthesisAbstract
The present study aimed to identify evaluation errors in e-learning environments. The research adopted a qualitative approach using the meta-synthesis method. The research population consisted of scholarly articles published in international databases including Scopus, ERIC, and ScienceDirect, which were retrieved based on predefined keywords within the time frame of 2010 to 2025. In this study, various parameters such as title, abstract, content, and methodological quality were considered. Accordingly, 969 articles related to the research topic were initially evaluated, and ultimately, 20 articles were purposively selected. Data analysis was conducted using the seven-step meta-synthesis method proposed by Sandelowski and Barroso (2007). The results of the meta-synthesis led to the identification of nine categories of e-learning evaluation errors, including: (1) ethical errors, (2) design errors, (3) implementation errors, (4) feedback errors, (5) measurement errors, (6) contextual errors, (7) technological errors, (8) human errors, and (9) security errors. These findings indicate that improving the quality of evaluation in e-learning environments requires careful attention to multiple dimensions of error and a thorough reconsideration of evaluation design and implementation processes.
Downloads
References
1. Means B, Toyama Y, Murphy R, Bakia M, Jones K. Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. U.S. Department of Education, 2010.
2. Garrison DR, Anderson T. E-learning in the 21st century: A framework for research and practice: Routledge; 2003.
3. Oosterhof A, Conrad R, Ely D. Assessing Learners Online: Prentice Hall; 2008.
4. Alruwais N, Wills G, Wald M. Advantages and challenges of using e-assessment. International Journal of Information and Education Technology. 2018;8(1):34-7. doi: 10.18178/ijiet.2018.8.1.1008.
5. Gikandi JW, Morrow D, Davis NE. Online formative assessment in higher education: A review of the literature. Computers & Education. 2011;57(4):2333-51. doi: 10.1016/j.compedu.2011.06.004.
6. Nicol DJ, Macfarlane-Dick D. Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education. 2006;31(2):199-218. doi: 10.1080/03075070600572090.
7. Anderson LW, Krathwohl DR. A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives: Longman; 2001.
8. Hodges C, Moore S, Lockee B, Trust T, Bond A. The difference between emergency remote teaching and online learning. Educause Review. 2020.
9. Unesco. Adverse consequences of school closures. 2020.
10. Guangul FM, Suhail AH, Khalit MI, Khidhir BA. Challenges of remote assessment in higher education in the context of COVID-19: A case study of Middle East College. Educational Assessment, Evaluation and Accountability. 2020;32:519-35. doi: 10.1007/s11092-020-09340-w.
11. Rajab K, Baig M. Challenges to online medical education during the COVID-19 pandemic. Cureus. 2020;12(7):e8966. doi: 10.7759/cureus.8966.
12. Bao W. COVID-19 and online teaching in higher education: A case study of Peking University. Human Behavior and Emerging Technologies. 2020;2(2):113-5. doi: 10.1002/hbe2.191.
13. Koçdar S, Karadeniz A, Peytcheva-Forsyth R, Stoeva V. Cheating and Plagiarism in E-Assessment: Students' Perspectives. Open Praxis. 2018. doi: 10.5944/openpraxis.10.3.873.
14. Surahman E, Wang T. Academic dishonesty and trustworthy assessment in online learning: A systematic literature review. Journal of Computer Assisted Learning. 2022;38:1535-53. doi: 10.1111/jcal.12708.
15. Khlifi Y, El-Sabagh HA. A Novel Authentication Scheme for E-assessments Based on Student Behavior over E-learning Platform. International Journal of Emerging Technologies in Learning. 2017;12(4):62-89. doi: 10.3991/ijet.v12i04.6478.
16. Garg M, Goel A. A systematic literature review on online assessment security: Current challenges and integrity strategies. Computers & Security. 2022;113:102544. doi: 10.1016/j.cose.2021.102544.
17. Holden OL, Norris ME, Kuhlmeier VA. Academic integrity in online assessment: A research review. Frontiers in Education. 2021;6:639814. doi: 10.3389/feduc.2021.639814.
18. Heil J, Ifenthaler D. Online Assessment in Higher Education: A Systematic Review. Online Learning. 2023. doi: 10.24059/olj.v27i1.3398.
19. Altınay F, Alpturk K, Berigel M, Ayaz A, Dagli G, Altınay Z. Evolution of Online Assessment in Higher Education: A Bibliometric Analysis. Pakistan Journal of Life and Social Sciences. 2024. doi: 10.57239/PJLSS-2024-22.1.00494.
20. Aluko FR, Omidire MF. A Critical Review of Student Assessment Practices in Distance Education in an Emerging Economy: Benchmarking Practices against Policy. Africa Education Review. 2020;17:76-94. doi: 10.1080/18146627.2021.1920842.
21. Chaudhary SV, Dey N. Assessment in Open and Distance Learning System (ODL): A Challenge. Open Praxis. 2013;5:207-16. doi: 10.5944/openpraxis.5.3.65.
22. Carless D, Boud D. The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education. 2018;43(8):1315-25. doi: 10.1080/02602938.2018.1463354.
23. Al Hashimi S, Alamarat Y, Zaki Y. Students' perceptions of online assessment, feedback practices, and challenges. International Journal of Evaluation and Research in Education. 2022;11(4):1939-49. doi: 10.11591/ijere.v11i4.22753.
24. Florjancic V. The challenges of distance assessment in higher education: A case study. International Journal of Learning Technology. 2022;17:77-93. doi: 10.1504/IJLT.2022.123685.
25. Wahas YM, Syed AJ. E-assessment challenges during e-learning in higher education: A case study. Education and Information Technologies. 2024;29:14431-50. doi: 10.1007/s10639-023-12421-0.
26. Muna F, Waheeda A, Shaheeda F, Shina A. Challenges in implementing online assessments at Maldivian higher education institutions: Lessons from the COVID-19 pandemic. Environment and Social Psychology. 2024. doi: 10.54517/esp.v9i3.1907.
27. Torres-Madroñero EM, Torres-Madronero MC, Botero LD. Challenges and Possibilities of ICT-Mediated Assessment in Virtual Teaching and Learning Processes. Future Internet. 2020;12:232. doi: 10.3390/fi12120232.
28. Fatima SS, Idrees R, Jabeen K, Sabzwari SR, Khan S. Online assessment in undergraduate medical education: Challenges and solutions from a LMIC university. Pakistan Journal of Medical Sciences. 2021;37:945-51. doi: 10.12669/pjms.37.4.3948.
29. Gupta T, Shree A, Chanda P, Banerjee A. Online assessment techniques adopted by the university teachers amidst COVID-19 pandemic: A case study. Social Sciences & Humanities Open. 2023;8:100579. doi: 10.1016/j.ssaho.2023.100579.
30. Al-Maqbali AH, Al-Shamsi A. Assessment Strategies in Online Learning Environments during the COVID-19 Pandemic in Oman. Journal of University Teaching and Learning Practice. 2023. doi: 10.53761/1.20.5.09.
31. Montenegro-Rueda M, Luque-de la Rosa A, Sarasola Sánchez-Serrano JL, Fernández-Cerero J. Assessment in higher education during the COVID-19 pandemic: A systematic review. Sustainability. 2021;13(19):10509. doi: 10.3390/su131910509.
32. Shraim KY. Online Examination Practices in Higher Education Institutions: Learners' Perspectives. Turkish Online Journal of Distance Education. 2019. doi: 10.17718/tojde.640588.
33. Rodriguez MC, Ooms A, Montañez M. Students' Perceptions of Online-learning Quality Given Comfort, Motivation, Satisfaction, and Experience. Journal of Interactive Online Learning. 2008;7(2):105-25.
34. Reeves TC. Enhancing the worth of instructional technology research through design experiments and other development research strategies. International Perspectives on Instructional Technology Research for the 21st Century2000. p. 27-36.
35. Mayer RE. The Cambridge handbook of multimedia learning. 2 ed: Cambridge University Press; 2014.
36. Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick's Four Levels of Training Evaluation: ATD Press; 2016.
37. Jordan S. E-assessment: Past, present and future. New Directions in the Teaching of Physical Sciences. 2014(10).
38. Sandelowski M, Barroso J. Handbook for Synthesizing Qualitative Research. New York: Springer; 2007.
39. Nagizadeh R, Elahi S, Moteghi M, Ghazi Noori S. Metasynthesis of regional innovation models: A review of the years 1990-2013. Innovation Management. 2014;3(4):25-56.
40. Gundu T. Strategies for E-Assessments in the Era of Generative Artificial Intelligence. The Electronic Journal of E-Learning. 2025;22(7):40-50. doi: 10.34190/ejel.22.7.3477.
41. Norwood J, Pabon‐Rodriguez FM, Figueroa-Rosado AL. Assessment of Self-Reported Perception and Aspirations of Online Undergraduate Students Regarding STEM Fields. 2025. doi: 10.21203/rs.3.rs-5717811/v1.
42. Bretag T. Challenges in addressing plagiarism in education. PLoS Medicine. 2016;13(12):e1002183. doi: 10.1371/journal.pmed.1002183.
43. Bennett RE. The Changing Nature of Educational Assessment. Review of Research in Education. 2015;39:370-407. doi: 10.3102/0091732X14554179.
44. Bennett RE. Technology for Large-scale Assessment. Assessment in Education: Principles, Policy & Practice. 2010;17(1):1-21. doi: 10.1016/B978-0-08-044894-7.00701-6.
45. Butler-Henderson K, Crawford J. A systematic review of online examinations: A pedagogical innovation for scalable authentication and integrity. Computers & Education. 2020;159:104024. doi: 10.1016/j.compedu.2020.104024.
Downloads
Published
Submitted
Revised
Accepted
Issue
Section
License
Copyright (c) 2025 Maryam Mahmoodi; Gholamreza Shams, Abasalt Khorasani, Saeed Safai Movahed (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
