Continued Usage of E-Learning: A Systematic Literature Review

Document Type : Research Paper

Authors

1 Azman Hashim International Business School, University Technology Malaysia, Johor Bahru, Malaysia; Sriwijaya University, Faculty of Computer Science, Palembang, Indonesia.

2 Azman Hashim International Business School, University Technology Malaysia, Johor Bahru, Malaysia.

3 Sriwijaya University, Faculty of Computer Science, Palembang, Indonesia.

Abstract

During the COVID-19 pandemic, the usage of e-learning systems became the main challenge for many universities. E-learning has risen as cutting-edge method for promoting learning delivery. To ensure productive use, it is important to continue using e-learning. Numerous studies have shown that continued usage by the user is the indicator of success in e-learning, and in recent years, research on continued use of e-learning is being explored at a higher level than before. However, to date, there have been no attempts to systematically analyse these studies in order to provide researchers and practitioners with a picture of the current state of continued usage of e-learning.
The aim of this research is to provide an in-depth look at the theory of continued use information systems in e-learning context. In this study, we used a systematic review approach to collect, evaluate, and synthesize data on the accuracy and value of previous articles published in digital databases between 2009 and 2019 that were based on this research area.
To include all relevant research papers that were written during this period time, we used a Systematic Literature Review (SLR) approach to collect and review studies by following a predefined review process that included both automated and manual search strategies.
We listed 87 primary studies from the review study that presented research on the continued use of e-learning. These studies were analysed using a comprehensive mapping method that collected relevant information to address a series of research questions. We summarized and analysed the published articles, which covered a wide range of research subjects, including the majority of factors that affect e-learning use.
While research on the continued use of e-learning is growing and providing a promising new field of research, the systematic review found that a clearer understanding of the environment and path is not well reported. This research will contribute to a better understanding of the factors that affect e-learning use over time

Keywords

References

Al-samarrie, H., Teng, B. K., Alzahrani, A. I., & T., N. (2017). E-learning continuance satisfaction in higher education: a unified perspective from instructors and students. Student in Higher Education, vol. 43.
Chang, C.-C. (2012). Exploring the determinants of e-learning systems continuance intention in academic libraries. Library Management, vol. 34.
Guo, Z., Xiao, L., Toorn, C., Lai, Y., & Seo, C. (2015). Promoting online learners’ continuance intention: An integrated flow framework. Information & Management, vol. 53.
Islam , A., & Azad, N. (2015). Satisfaction and continuance with a learning management system. The International Journal of Information and Learning Technology, Vol. 32.
Al-Fraihat, D., Joy, M., Masa'deh, R., & Sinclair, J. (2020). Evaluating E learning systems success: An empirical study. Computers in Human Behavior, vol. 102.
Alharthi, A. D., Spichkova, M., & Hamilton, M. (2018). Sustainability requirements for eLearning systems: a systematic literature review and analysis. Requirements Engineering, vol. 24.
Lopes, S., Rodrigues, H., Almeida, F., Figueiredo, H., & Lopes, S. (2019). MApping Key concept E-learning and Education: A systematic review through published papers. Computers & Education, vol. 136.
Al-Busaidi. (2013). An empirical investigation linking learners’ adoption of blended learning to their intention of full e-learning”, Behavior & Information Technology. Behavior & Information Technology, Vol. 32 No. 11.
Islam, A. K. (2013). Investigating e-learning system usage outcomes in the university context. Computers & Education, Vol. 69.
Perisco, D., Manca, S., & Pozzi, F. (2014). Adapting the Technology Acceptance Model to evaluate the innovative potential of e-learning systems. Computers in Human Behavior, vol. 30.
Alexander, P. A. (2012). Reading Into the Future: Competence for the 21st Century. Human Behavior, vol. 102.
Cheng, M., & Yuen, A. (2018). Student Continuance of Learning Management System Use: A Longitudinal Exploration. Computer & Education, vol. 120.
Hong, J. (2016). Internet cognitive failure relevant to users' satisfaction with content and interface design to reflect continuance intention to use a government e-learning system. Computer in Human Behaviour, vol. 66.
Choudhury, S., & Pattnaik, S. (2019). Emerging themes in e-learning: A review from the stakeholder perspective. Computers & Education, vol. 144.
Rodrigues, H. (2019). Tracking e-learning through published papers: A systematic review. Computers & Education, vol. 136.
Versitkaya, E. R., Mikhaylova, A., Gilmanshina, S., Dorozhkin, E., & Epaneshnikov, V. (2019). Present-day management of universities in Russia: Prospects and challenges of e-learning. Education and Information Technologies.
Limayem, M., & Cheung, C. (2011). Predicting continued use of Internet-based learning technologies: the role of habit. Behaviour & Information Technology, vol. 30.
Zhang, Y., Fang, Y., Wei, K., & Wang, Z. (2012). Promoting the intention of students to continue their participation in e-learning systems: The role of the communication environment. Information Technology & People, vol.25.
Bourelle, A., Bourelle, T., Knutson, A., & Spong, S. (2016). Sites of multimodal literacy: Comparing student learning in online and face-to-face environments. Computers and Composition, vol. 39.
Yang, S., Zhou, S., & Chen, X. (2018). “Why do college students continue to use mobile learning? Learning involvement and self-determination theory: College students mobile learning continuance. British Journal of Educational Technology.
Daghan, G., & Akkoyunlu, B. (2016). Modeling the contnuance usage intention of online learning environments. Computers in Human Behavior, vol. 60.
Ji, Z., Yang, Z., Liu, J., & Yu, C. (2019). Investigating Users’ Continued Usage Intentions of Online Learning Applications. Information vol 10.
Pereira, F., Ramos, A., Gouvea, M., & Costa, M. (2015). Satisfaction and continuous use intention of e-learning service in Brazilian public organizations. Computer in Human Behaviour, vol 46.
Tan, M., & Shao, P. (n.d.). . (An ECM-ISC based Study on Learners’ Continuance Intention toward E-learning”. IJET, vol. 10.
Wu, B., & Zhang, C. (2014). “Empirical study on continuance intentions towards ELearning 2.0 systems. Behaviour & Information Technology, vol. 33.
Capece, G., & Campisi, D. (2013). User satisfaction affecting the acceptance of an elearning platform as a mean for the development of the human capital. Behaviour & Information Technology, vol. 3.
Lewis, K., Cidon, M., Seto, T., Chen, H., & Mahan, J. (2014). Leveraging e-learning in Medical Education. International Journal on E-Learning, vol.13 .
Hew, K. F., & Cheung, W. S. (2014). Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and Challenges. Educational Research Review.
Muresan, M., & Gogu, E. (2013). E-learning Challenges and Provisions. Social and Behavioral Science.
Kang, M., Liew, B., Kim, J., & Jung, H. (2014). Learning presence as a predictor of achievement and satisfaction in online learning environments. International Journal on E-Learning, vol. 13.
Lee, M. C. (2010). Explaining and predicting users’ continuance intention toward e-learning: An extension of the expectation–confirmation model. Computers & Education, vol. 54.
Hung, M., Chang, I., & Hwang. (2011). Exploring academic teachers’ continuance toward the web-based learning system: The role of causal attributions. Computers & Education, vol. 57.
Tawafak, R., Romli, A., Arshah, R., & Malik, S. (2019). Framework design of university communication model (UCOM) to enhance continuous intentions in teaching and e-learning process. Education and Information Technologies.
Shee, D. Y. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers and Education.
Sørebø, Ø. H. (2009). he role of self-determination theory in explaining teachers’ motivation to continue to use e-learning technology. Computers and Education.
Bandara, W. M. (2011). A systematic, tool-supported method for conducting literature reviews in information systems. 19th European Conference on Information Systems, ECIS 2011.
Webster, J. W. (2002). Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly.
Joo, Y. J. (2016). Factors predicting online university students’ use of a mobile learning management system (m-LMS). Educational Technology Research and Development.
Cheng, Y. M. (2019). How does task-technology fit influence cloud-based e-learning continuance and impact? Education and Training.
Daneji, A. A. (2019). The effects of perceived usefulness, confirmation and satisfaction on continuance intention in using massive open online course (MOOC). Knowledge Management and E-Learning.
Loogma, K. K. (2012). E-learning as innovation: Exploring innovativeness of the VET teachers’ community in Estonia. Computers and Education.
Cheng, M. Y. (2019). Cultural divides in acceptance and continuance of learning management system use: a longitudinal study of teenagers. Educational Technology Research and Development.
Cheng, B. W. (2012). The effects of organizational learning environment factors on e-learning acceptance. Computers and Education.
Cho, V. C. (2009). The role of perceived user-interface design in continued usage intention of self-paced e-learning tools. Computers and Education.
Ismail, N. Z. (2012). E-Learning Continuance Intention Among Higher Learning Institution Students’ in Malaysia. Procedia - Social and Behavioral Sciences.
Lin, W. S. (2012). Perceived fit and satisfaction on web learning performance: IS continuance intention and task-technology fit perspectives. International Journal of Human Computer Studies.
Wang, L. Y. (2019). Usability factors predicting continuance of intention to use cloud e-learning application. Heliyon.
Yang, M. S. (2017). Understanding the quality factors that influence the continuance intention of students toward participation in MOOCs. Educational Technology Research and Development.
Rodríguez-Ardura, I. M.-A. (2016). What leads people to keep on e-learning? An empirical analysis of users’ experiences and their effects on continuance intention. Interactive Learning Environments.
Lin, K. M. (2011). Understanding e-learning continuance intention: A negative critical incidents perspective. Behaviour and Information Technology.
Lin, T. C. (2012). Validating the satisfaction and continuance intention of e-learning systems: Combining tam and is success models. International Journal of Distance Education Technologies.
Cho, V. C. (2009). Continued usage of technology versus situational factors: An empirical analysis,. Journal of Engineering and Technology Management - JET-M.
Chow, M. C. (2013). Exploring the intention to use a clinical imaging portal for enhancing healthcare education. Nurse Education Today.
Saba, T. (2012). Implications of E-learning systems and self-efficiency on students outcomes: a model approach. Human-centric Computing and Information Sciences.
Wang, R.-B. D.-T. (2014). Mobile Social Network Sites as innovative pedagogical tools: factors and mechanism affecting students’ continuance intention on use. Journal of Computers in Education.
Wu, C. H. (2015). Acceptance of ICT-mediated teaching/learning systems for elementary school teachers: Moderating effect of cognitive style. Education and Information Technologies.
Yim, J. S. (2019). Predicting teachers’ continuance in a virtual learning environment with psychological ownership and the TAM: a perspective from Malaysia. Educational Technology Research and Development.
Orehovački, T. E. (2019). Modelling an interplay of adoption determinants with respect to social Web applications used in massive online open courses. Universal Access in the Information Society.
Sun, Y. G. (2020). An investigation of the influence of intrinsic motivation on students’ intention to use mobile devices in language learning. Educational Technology Research and Development.
Mohammadyari, S. S. (2015). Understanding the effect of e-learning on individual performance: The role of digital literacy. Computers and Education.
Kumar, J. A. (2019). Google Classroom for mobile learning in higher education: Modelling the initial perceptions of students. Education and Information Technologies.
Medina Molina, C. R. (2013). Previous beliefs and continuance intention. International Entrepreneurship and Management Journal.
Almaiah, M. A. (2019). Analysis of the essential factors affecting of intention to use of mobile learning applications: A comparison between universities adopters and non-adopters. Education and Information Technologies.
Woodward, A. F. (2014). Diffusion of e-health innovations in ‘post-conflict’ settings: A qualitative study on the personal experiences of health workers,. Human Resources for Health.
Shahijan, M. K. (2016). International students’ course satisfaction and continuance behavioral intention in higher education setting: an empirical assessment in Malaysia. Asia Pacific Education Review.
Lin, K. M. (2011). E-Learning continuance intention: Moderating effects of user e-learning experience. Computers and Education.
Bøe, T. G. (2015). How to stimulate the continued use of ICT in higher education: Integrating Information Systems Continuance Theory and agency theory. Computers in Human Behavior.
Lin, W. S. (2012). Antecedences to continued intentions of adopting e-learning system in blended learning instruction: A contingency framework based on models of information system success and task-technology fit. Computers and Education.
Jo, D. (2018). Exploring the determinants of MOOCs continuance intention. KSII Transactions on Internet and Information Systems.
Lin, J. W. (2020). Continuance model of formative computer-based assessment (CBA): Considering the effects of self-regulation and social influence. Universal Access in the Information Society.
Cheng, M. Y. (2018). Student continuance of learning management system use: A longitudinal exploration. Computers and Education.
Chow, W. S. (2014). Investigating Students’ Satisfaction and Continuance Intention toward E-learning: An Extension of the Expectation – Confirmation Model. Procedia - Social and Behavioral Sciences.
Tan, M. S. (2015). An ECM-ISC based study on learners' continuance intention toward E-learning. International Journal of Emerging Technologies in Learning.
Mouakket, S. B. (2015). Investigating the factors influencing continuance usage intention of Learning management systems by university instructors: The Blackboard system case. International Journal of Web Information Systems.
Chou, H. K. (2012). Engagement in e-learning opportunities: An empirical study on patient education using expectation confirmation theory. Journal of Medical Systems.
Ifinedo, P. (2018). Roles of perceived fit and perceived individual learning support in students’ weblogs continuance usage intention. International Journal of Educational Technology in Higher Education.
Hernandez, B. M. (2011). The role of social motivations in e-learning: How do they affect usage and success of ICT interactive tools? Computers in Human Behavior.
Lin, J. W. (2016). The impact of an online project-based learning environment with group awareness support on students with different self-regulation levels: An extended-period experiment. Computers and Education.
Luo, N. Z. (2017). Effects of different interactions on students’ sense of community in e-learning environment. Computers and Education.
Ramayah, T. A. (2010). The role of quality factors in intention to continue using an e-learning system in Malaysia. Procedia - Social and Behavioral Sciences.
Udo, G. J. (2011). Using SERVQUAL to assess the quality of e-learning experience. Computers in Human Behavior.
Shahzad, F. X. (2020). The moderating role of intrinsic motivation in cloud computing adoption in online education in a developing country: a structural equation model. Asia Pacific Education Review.
Yuen, A. H. (2019). Student satisfaction with learning management systems: A growth model of belief and use. British Journal of Educational Technology.
Al-Busaidi, K. A.-S. (2012). Key factors to instructors’ satisfaction of learning management systems in blended learning. Journal of Computing in Higher Education.
Calli, L. B. (2013). Identifying factors that contribute to the satisfaction of students in e-learning. Turkish Online Journal of Distance Education.
Cidral, W. A. (2018). E-learning success determinants: Brazilian empirical study. Computers and Education.
Lwoga, E. (2014). Critical success factors for adoption of web-based learning management systems in Tanzania. International Journal of Education and Development using Information and Communication Technology (IJEDICT).
Islam, N. (2011). The Determinants of the Post-Adoption Satisfaction of Educators with an E-Learning System,. Journal of Information Systems Education.
Cheung, C. M. (2011). Antecedents and Consequences of User Satisfaction with an e-Learning Portal. International Journal for Digital Society.
Bøe, T. (2018). E-learning technology and higher education: the impact of organizational trust,. Tertiary Education and Management.
Sharma, S. K. (2017). Structural equation model (SEM)-neural network (NN) model for predicting quality determinants of e-learning management systems. Behaviour and Information Technology.
Lwoga, E. T. (2015). Antecedents of continued usage intentions of web-based learning management system in Tanzania. Education and Training.
Chong, M. C. (2015). Access to, interest in and attitude toward e-learning for continuous education among Malaysian nurses. Nurse Education Today.
Ho, C. K. (2015). Choice decision of e-learning system: Implications from construal level theory. Information and Management.
Kanwal, F. R. (2017). Factors Affecting E-Learning Adoption in Developing Countries-Empirical Evidence from Pakistan’s Higher Education Sector. IEEE Access.
Cheng, Y. M. (2013). Exploring the roles of interaction and flow in explaining nurses’ e-learning acceptance. Nurse Education Today.
Moghavvemi, S. P. (2017). tudent’s perceptions towards using e-learning via Facebook. Behaviour and Information Technology.
Maldonado, U. P. (2011). E-learning motivation and educational portal acceptance in developing countries. Online Information Review.
Ali, S. U. (2018). A conceptual framework highlighting e-learning implementation barriers. Information Technology and People.
Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele University,UK and National ICT Australia.
Kitchenham, B. C. (2007). Guidelines for performing Systematic Literature Reviews in SE. Guidelines for performing Systematic Literature Reviews in SE.
Nidhra, S. Y. (2013). Knowledge transfer challenges and mitigation strategies in global software development—A systematic literature review and industrial validation. International Journal of Information Management.
Aqilah, A. N. (2018). E-learning services acceptance in higher educational institutes: A case study in Brunei. Education and Information Technologies.
You, J. W. (2014). The role of academic emotions in the relationship between perceived academic control and self-regulated learning in online learning. Computers and Education.
Hrastinski, S. (2009). A theory of online learning as online participation. Computers and Education.
Moore, M. &. (2012). Distance Education: A system views of online learning (3rd Edition). Belmont: Wadsworth Cengage Learning.
Berge, Z. L. (2013). Handbook of mobile learning. New York: Routledge.
Chen, B. S. (2013). User acceptance of mobile technology: A campus-wide implementation of mobile learn application. Journal of Educational Computing Research.
Kinash, S. B. (2012). Challenging mobile learning discourse through research: Student perceptions of Blackboard mobile learn and iPads. Australasian Journal of Educational Technology, , 28(4).
Ouyang, Y. T. (2017). Task- technology fit aware expectation-confirmation model towards understanding of MOOCs continued usage intention. Proceedings of the 50th Hawaii International Conference on System Sciences.
(2008). National Context In N. Law, W. J. Pelgrum, & T. Plomp (Eds.), Pedagogy and ICT in schools around the world: Findings from the SITES 2006 study (pp. 38–66). Hong Kong: CERC and Springer.
Anderson R., &. P. (2008). National Contexts. In N. Law, W. J. Pelgrum, & T. Plomp (Eds.), Pedagogy and ICT in schools around the world: Findings from the SITES 2006 study (. Hong Kong: CERC and Springer.
Budgen, D. K. (2008). Presenting software engineering results using structured abstracts: A randomised experiment. Empirical Software Engineering.
 

Files

Share

How to cite

Statistics