A website evaluation model by integration of previous evaluation models using a quantitative approach

Document Type : Research Paper

Authors

1 Associate Prof., Engineering Sciences, Faculty of Engineering, University of Tehran, Tehran, Iran

2 Assistant Prof., IT Management Department, Faculty of Management, University of Tehran, Tehran, Iran

3 Associate Prof., IT Management Department, Faculty of Management and Economy, Tarbiat Modares University, Tehran, Iran

4 Ph.D. Candidate, System Management, Faculty of Management, University of Tehran, Tehran, Iran

Abstract

Regarding the ecommerce growth, websites play an essential role in business success. Therefore, many authors have offered website evaluation models since 1995. Although, the multiplicity and diversity of evaluation models make it difficult to integrate them into a single comprehensive model. In this paper a quantitative method has been used to integrate previous models into a comprehensive model that is compatible with them. In this approach the researcher judgment has no role in integration of models and the new model takes its validity from 93 previous models and systematic quantitative approach.

Keywords

Main Subjects


Agarwal, R. & Venkatesh, V. (2002). Assessing a firm's web presence: a heuristic evaluation procedure for the measurement of usability. Information Systems Research, 13(2): 168-186.
Akincilar, A. & Dagdeviren, M. (2014). A hybrid multi-criteria decision making model to evaluate hotel websites. International Journal of Hospitality Management, 36, 263-271.
Aladwani, A. M. & Palvia, P.C. (2002). Developing and validating an instrument for measuring user-perceived web quality. Information & management, 39(6): 467-476.
Alkindi, S. & Bouazza, A.M. (2010). An evaluation study of the navigation and search systems on two academic websites and Google. The International Information & Library Review, 42 (1): 50-61.
Bai, B., Law, R. & Wen, I. (2008). The impact of website quality on customer satisfaction and purchase intentions: Evidence from Chinese online visitors. International Journal of Hospitality Management, 27 (3): 391-402.
Baloglu, S. & Pekcan, Y.A. (2006). The website design and Internet site marketing practices of upscale and luxury hotels in Turkey. Tourism Management, 27 (1): 171-176.
Barnes, S. J. & Richard V. (2003). Measuring web site quality improvements: a case study of the forum on strategic management knowledge exchange. Industrial management & Data systems, 103 (5): 297-309.
Barnes, S. J. & Vidgen, R.T. (2002). An Integrative Approach to the Assessment of E-Commerce Quality. Journal of Electron. Commerce Research, 3 (3): 114-127.
Barnes, S. J. & Vidgen, R.T. (2006). Data triangulation and web quality metrics: A case study in e-government. Information & Management, 43 (6): 767-777.
Barron, A. E. (1996). Design Guidelines for the World Wide Web. Journal of Interactive Instruction Development, 8 (3): 13-17.
Belanche, D., Luis, V. C. & Miguel, G. (2012). Website usability, consumer satisfaction and the intention to use a website: the moderating effect of perceived risk. Journal of retailing and consumer services, 19 (1): 124-132.
Beldona, S. & Liping A. C. (2006). An exploratory evaluation of rural tourism websites. Journal of Convention & Event Tourism, 8 (1): 69-80.
Bell, H. & Nelson, K. H. T. (1998). The effectiveness of commercial Internet Web sites: A user’s perspective. Internet Research, 8 (3): 219-228.
Benbunan-Fich, R. (2001). Using protocol analysis to evaluate the usability of a commercial web site. Information & Management, 39(2): 151-163.
Bilsel, R. U., Gülçin, B. & Da, R. (2006). A fuzzy preference‐ranking model for a quality evaluation of hospital web sites. International Journal of Intelligent Systems, 21 (11): 1181-1197.
Blake, B. F., Kimberly, A. N. & Colin, M. V. (2005).Tailoring new websites to appeal to those most likely to shop online. Technovation, 25 (10): 1205-1214.
Buenadicha, M.M., Chamorro, M.A., González, F.J.M. & González, L.Ó.R. (2001). A new Web assessment index: Spanish universities analysis. Internet Research, 11(3): 226-234.
Bueyuekoezkan, G. & Da, R. (2007). Evaluating government websites based on a fuzzy multiple criteria decision-making approach. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 15 (3): 321-343.
Cao, M., Zhang, Q. & Seydel, J. (2005). B2C e-commerce web site quality: an empirical examination. Industrial Management & Data Systems, 105 (5): 645-661.
Cebi, S. (2013). Determining importance degrees of website design parameters based on interactions and types of websites. Decision Support Systems, 54 (2): 1030-1043.
Cebi, S. A. (2013). A quality evaluation model for the design quality of online shopping websites. Electronic Commerce Research and Applications, 12 (2): 124-135.
Chakraborty, G., Prashant, S. & David, L. W. (2005). Understanding corporate B2B web sites' effectiveness from North American and European perspective. Industrial Marketing Management, 34 (5): 420-429.
Chang, H. H. & Su W. C. (2009). Consumer perception of interface quality, security, and loyalty in electronic commerce. Information & Management, 46 (7): 411-417.
Chiang, L. Ch. (2003). Effectiveness of the hotel websites in Singapore: A perspective from Business‐to‐Business (B2B) organisations. Asia Pacific Journal of Tourism Research, 8 (2): 38-47.
Chiou, W., Lin, Ch. & Perng, Ch. (2010). A strategic framework for website evaluation based on a review of the literature from 1995–2006. Information & Management, 47 (6): 282-290.
Chiou, W., Lin, Ch. & Perng, Ch. (2011). A strategic website evaluation of online travel agencies. Tourism Management, 32 (6): 1463-1473.
Choi, S. & Alastair, M. M. (2005). Website effectiveness for bricks and mortar travel retailers. Anatolia, 16 (1): 63-78.
Chou, W. & Yi-Ping Ch. (2012). A hybrid fuzzy MCDM approach for evaluating website quality of professional accounting firms. Expert Systems with Applications, 39 (3): 2783-2793.
Connolly, R. (2009). Website Service Quality in Ireland: An Empirical Study. Web Information Systems and Technologies. Springer Berlin Heidelberg, 18: 321-332.
Davoli, P., Francesca, M. & Elena, C. (2005). Quality assesment of cultural web sites with fuzzy operators. Journal of Computer Information Systems, 46 (1): 45-57.
Delavar, A. (2004) Theoric and Scientific principles of humanities and social science, second edition, published by Roshd, Tehran, Iran.
Devaraj, S., Ming, F. & Rajiv, K. (2002). Antecedents of B2C channel satisfaction and preference: validating e-commerce metrics. Information systems research, 13 (3): 316-333.
Dreze, X. & Fred, Z. (1997). Testing web site design and promotional content. Journal of Advertising Research, 37: 77-91.
Elling, S. (2012). Measuring the quality of governmental websites in a controlled versus an online setting with the ‘Website Evaluation Questionnaire’. Government Information Quarterly, 29 (3): 383-393.
Elling, S., Lentz, L. & De Jong, M. (2007). Website evaluation questionnaire: development of a research-based tool for evaluating informational websites. InElectronic Government, 4656: 293-304.
Evans, J. R. & Vanessa, E. K. (1999). Business-to-business marketing and the World Wide Web: planning, managing, and assessing web sites. Industrial Marketing Management, 28 (4): 343-358.
Hasan, L. & Emad, A. (2011). Assessing the quality of web sites. Applied Computing and Informatics, 9 (1): 11-29.
Hashim, N. H., Jamie, M. & Rob, L. (2007). A review of hospitality website design frameworks. Information and communication technologies in tourism 2007. Springer Vienna, 219-230.DOI: 10.1007/978-3-211-69566-1_21.
Hernández, B., Jiménez, J. & Martín, M. J. (2009). Key website factors in e-business strategy. International Journal of Information Management, 29(5): 362-371.
Hong, S. & Jinwoo, K. (2004). Architectural criteria for website evaluation–conceptual framework and empirical validation. Behaviour & Information Technology, 23 (5): 337-357.
Hsu, C. L., Chang, K. C. & Chen, M. C. (2012). The impact of website quality on customer satisfaction and purchase intention: perceived playfulness and perceived flow as mediators. Information Systems and e-Business Management, 10(4): 549-570.
Hu, Y. C. (2009). Fuzzy multiple-criteria decision making in the determination of critical criteria for assessing service quality of travel websites. Expert Systems with Applications, 36 (3): 6439-6445.
Huizingh, E. K.R.E. (2000). The content and design of websites: an empirical study. Information & Management, 37 (3): 123-134.
Johnson, K. L. & Mark, M. M. (1999). Benchmarking: a tool for web site evaluation and improvement. Internet Research, 9 (5): 383-392.
Kabak, M. & Serhat, B. (2013). A holistic evaluation of the e-procurement website by using a hybrid MCDM methodology. Electronic Government, an International Journal, 10 (2): 125-150.
Kaplanidou, K. & Vogt, C. (2004). Destination Marketing Organization Websites (DMOs). Evaluation and Design what you need to know. Retrieved from: http://www.travelmichigannews.org/mtr/pdf/White_paper-Web_site_ evaluation. pdf. February 18 (2004).
Kim, H. & Linda, S. N. (2009). The impact of website quality on information quality, value, and loyalty intentions in apparel retailing. Journal of Interactive Marketing, 23 (3): 221-233.
Kim, S. & Leslie S. (2004). Dimensional hierarchy of retail website quality. Information & Management, 41(5): 619-633.
Kuo, Y. F. (2003). A study on service quality of virtual community websites. Total Quality Management and Business Excellence, 14 (4): 461-473.
Lavie, T. & Noam, T. (2004). Assessing dimensions of perceived visual aesthetics of web sites. International journal of human-computer studies, 60 (3): 269-298.
Lee, K. C. & Namho, C. (2006). Cognitive map-based web site design: empirical analysis approach. Online Information Review, 30 (2): 139-154.
Lee, K. C. & Sangjae, L. (2003). A cognitive map simulation approach to adjusting the design factors of the electronic commerce web sites. Expert Systems with Applications, 24 (1): 1-11.
Lee, Y. & Kenneth, A. K. (2006).Investigating the effect of website quality on
e-business success: an analytic hierarchy process (AHP) approach. Decision support systems, 42 (3): 1383-1401.
Lee, Y. & Kenneth A. K. (2012). Understanding of website usability: Specifying and measuring constructs and their relationships. Decision Support Systems 52 (2): 450-463.
Li, F. & Yefei, L. (2011). Usability evaluation of e-commerce on B2C websites in China. Procedia Engineering, 15: 5299-5304.
Li, Y. N., Tan, K. C. & Xie, M. (2002). Measuring web-based service quality. Total quality management, 13 (5): 685-700.
Lin, H. (2007). The impact of website quality dimensions on customer satisfaction in the B2C e-commerce context. Total Quality Management and Business Excellence, 18 (4): 363-378.
Lin, H. (2010).An application of fuzzy AHP for evaluating course website quality. Computers & Education 54 (4): 877-888.
Lin, Y. (2009). Website evaluation of international tourist hotels in Taiwan. U-and E-Service, Science and Technology. Springer Berlin Heidelberg, 62: 98-103.
Liu, C. & Kirk P. A. (2000). Exploring the factors associated with Web site success in the context of electronic commerce. Information & management, 38 (1): 23-33.
Liu, C., Arnett, K. P., Capella, L. M. & Taylor, R.D. (2001). Key dimensions of web design quality as related to consumer response. Journal of Computer Information Systems, 42(1): 70-82.
Liu, C., Arnett, K. P., Capella, L. M. & Beatty, R. C. (1997). Web sites of the Fortune 500 companies: facing customers through home pages. Information & Management, 31(6): 335-345.
Lu, M. T. & Yeung, W. L. (1998). A framework for effective commercial web application development. Internet Research8(2): 166-173.
Miranda González, F. J. & Bañegil, P. (2004). Quantitative evaluation of commercial web sites: an empirical study of Spanish firms. International Journal of Information Management, 24 (4): 313-328.
Muylle, S., Moenaert R. & Despontin M. (2004).The conceptualization and empirical validation of web site user satisfaction. Information & Management, 41 (5): 543-560.
Olsina, L. & Rossi G. (2002). A Quantitative Method for Quality Evaluation of Web Sites and Applications. IEEE multimedia, 9(4): 20-29.
Olsina, L., Godoy, D., Lafuente, G. & Rossi, G. (1999). Assessing the quality of academic websites: a case study. New Review of Hypermedia and Multimedia, 5(1): 81-103.
Palmer, J.W. (2002). Web site usability, design, and performance metrics. Information systems research, 13(2): 151-167.
Park, H. & Seung J. N. (2002). Enhancement of web design quality through the QFD approach. Total Quality Management, 13(3): 393-401.
Park, Y. A. & Gretzel U. (2007). Success factors for destination marketing web sites: a qualitative meta-analysis. Journal of Travel Research, 46(1): 46-63.
Park, Y. A., Gretzel U. & Sirakaya-Turk E. (2007).Measuring web site quality for online travel agencies. Journal of Travel and Tourism Marketing, 23 (1): 15-30.
Pavic, Z. Novoselac, V. (2013). Notes on TOPSIS Method. International Journal of Engineering and Science, 1(2): 5-12.
Perdue, R.R. (2002). Internet site evaluations: the influence of behavioral experience, existing images, and selected website characteristics. Journal of Travel & Tourism Marketing, 11(2-3): 21-38.
Qi, S., Law, R. & Buhalis, D. (2008). Usability of Chinese destination management organization websites. Journal of Travel & Tourism Marketing, 25(2): 182-198.
Qiu, J. & Tan, C. (2007). The Credibility of Enterprise’s Website and Its Evaluation in the Customer’s Perspective. In Integration and Innovation Orient to
E-Society,
Vol. 1, pp. 309-322. Springer US.
Rababah, O. M. A. & Masoud, F. A. (2010). Key factors for developing a successful e-commerce website. Communications of the IBIMA, 2010: 1-9.
Ranganathan, C. & Ganapathy, S. (2002). Key dimensions of business-to-consumer web sites. Information & Management, 39(6): 457-465.
Robbins, S. S. & Stylianou, A. C. (2003). Global corporate web sites: an empirical investigation of content and design. Information & Management, 40(3): 205-212.
Rocha, Á. (2012). Framework for a global quality evaluation of a website. Online Information Review, 36(3): 374-382.
Saha, R. & Sandeep G. (2011). Quantitative Evaluation of Website Quality Dimension for Web 2.0 Environment. International Journal of U-& E-Service, Science & Technology, 4 (4): 15-36.
Schmidt, S., Cantallops, A. S. & dos Santos, C. P. (2008). The characteristics of hotel websites and their implications for website effectiveness. International Journal of Hospitality Management, 27(4): 504-516.
Shee, D. Y. & Wang, Y. S. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education, 50(3): 894-905.
Smith, A. G. (2001). Applying evaluation criteria to New Zealand government websites. International journal of information management, 21(2): 137-149.
So, S. I. A. & Morrison, A. M. (2004). Internet marketing in tourism in Asia: an evaluation of the performance of East Asian national tourism organization websites. Journal of hospitality & leisure marketing, 11(4): 93-118.
Stienmetz, J. L., Levy, S. E. & Boo, S. (2013). Factors influencing the usability of mobile destination management organization websites. Journal of Travel Research, 52(4): 453-464.
Tarafdar, M. & Zhang, J. (2005). Analyzing the influence of web site design parameters on web site usability. Information Resources Management Journal (IRMJ), 18(4): 62-80.
Tsai, W. H., Chou, W. C. & Lai, C. W. (2010). An effective evaluation model and improvement analysis for national park websites: A case study of Taiwan.Tourism Management, 31(6): 936-952.
Tsai, W. H., Chou, W. C. & Leu, J. D. (2011). An effectiveness evaluation model for the web-based marketing of the airline industry. Expert Systems with Applications, 38(12): 15499-15516.
Van der Merwe, R. & Bekker, J. (2003). A framework and methodology for evaluating e-commerce web sites. Internet Research, 13(5): 330-341.
Van Iwaarden, J., van der Wiele, T., Ball, L. & Millen, R. (2004). Perceptions about the quality of web sites: a survey amongst students at Northeastern University and Erasmus University. Information & Management, 41(8): 947-959.
Vila, N. & Kuster, I. (2011). Consumer feelings and behaviours towards well designed websites. Information & Management, 48(4): 166-177.
Vladimirov, Z. (2012). Customer satisfaction with the Bulgarian tour operators and tour agencies' websites. Tourism Management Perspectives, 4: 176-184.
Yen, B., Hu, P. J. H. & Wang, M. (2007). Toward an analytical approach for effective Web site design: A framework for modeling, evaluation and enhancement. Electronic Commerce Research and Applications, 6(2): 159-170.
Yu, X., Guo, S., Guo, J. & Huang, X. (2011). Rank B2C e-commerce websites in
e-alliance based on AHP and fuzzy TOPSIS. Expert Systems with Applications, 38(4): 3550-3557.
Zhang, P & Von Dran, G.M. (2000).Satisfiers and dissatisfiers: A two‐factor model for website design and evaluation. Journal of the American society for information science, 51(14): 1253-1268.
Zhang, P. & Von Dran, G.M. (2002). User expectations and rankings of quality factors in different web site domains. International Journal of Electronic Commerce, 6: 9-34.