User experience of digital science and education evaluation platform: identification and analysis of key influencing factors
| Date | 20 June 2023 |
| Pages | 1839-1862 |
| DOI | https://doi.org/10.1108/LHT-10-2022-0468 |
| Published date | 20 June 2023 |
| Subject Matter | Library & information science,Librarianship/library management,Library technology,Information behaviour & retrieval,Information user studies,Metadata,Information & knowledge management,Information & communications technology,Internet |
| Author | Junping Qiu,Zhongyang Xu,Haibei Luo,Jianing Zhou,Yu Zhang |
User experience of digital science
and education evaluation platform:
identification and analysis of key
influencing factors
Junping Qiu and Zhongyang Xu
School of Management, Hangzhou Dianzi University, Hangzhou, China and
Chinese Academy of Science and Education Evaluation, Hangzhou Dianzi University,
Hangzhou, China
Haibei Luo and Jianing Zhou
College of Modern Science and Technology, China Jiliang University,
Hangzhou, China, and
Yu Zhang
China Academy of Art, Hangzhou, China
Abstract
Purpose –Establishing and developing digital science and education evaluation platforms (DSEEPs) have
several practical implications for the development of China’s science, technology and education. Identifying
and analyzing the key factors influencing DSEEP user experience (UX) can improve the users’willingness to
use the platform and effectively promote its sustainable development.
Design/methodology/approach –First,a literature survey, a five-element model of UX and semi-structured
interviews were used in this study to develop a DSEEP UX-influencing factor model, which included five
dimensions and 22 influencing factors. Second, the model validity was verified using questionnaire data.
Finally, the key influencing factors were identified and analyzed using a fuzzy decision-making trial and
evaluation laboratory (fuzzy-DEMATEL) method.
Findings –Fourteen influencing factors, including diverse information forms and comprehensive information
content, are crucial for the DSEEP UX. Its optimization pathis “‘Function Services’→‘Information Resources’
→‘InteractionDesign’→‘Interface Design’and ‘Visual Design’.”In this regard,platform managers can take the
following measures to optimize UX: strengthening functional services, improving information resources,
enhancing the interactive experience and considering interface effects.
Originality/value –This study uses a combination of qualitative and quantitative research methods to
determine the key influencing factors and optimization path of DSEEP UX. Optimization suggestions for UX
are proposed from the perspective of platform managers, who provide an effective theoretical reference for
innovating and developing a DSEEP.
Keywords Digital science and education evaluation platform, User experience, Influencing factors,
Five-element model of user experience, Fuzzy-DEMATEL method
Paper type Research paper
1. Introduction
Since human society has entered the era of data intelligence, the rise and development of
emerging digital technologies, such as big data, cloud computing and blockchain, have not
only brought significant changes to all walks of life but also provided a new driving force for
the transformation and development of traditional science and education evaluation websites
(De Reuver et al., 2018;Tang et al., 2020). Traditional science education evaluation websites
User
experience
of DSEEPs
1839
This study was supported by the Major Programs of the National Social Science Foundation of China
(Grant No. 19ZDA348).
The current issue and full text archive of this journal is available on Emerald Insight at:
https://www.emerald.com/insight/0737-8831.htm
Received 9 October 2022
Revised 10 March 2023
15 May 2023
Accepted 29 May 2023
Library Hi Tech
Vol. 42 No. 6, 2024
pp. 1839-1862
© Emerald Publishing Limited
0737-8831
DOI 10.1108/LHT-10-2022-0468
have been optimized and upgraded in many aspects, such as data sources, evaluation indices
and intelligent services, and have been gradually transformed into “digital science education
evaluation platforms (DSEEPs)”(Li et al., 2022a,b). A DSEEP is a digital platform developed
by universities, research institutions and private companies, centered on science and
education evaluation information services. It typically provides users with knowledge
products for university evaluation, discipline evaluation, science and technology
competitiveness evaluation, and other related services (Li et al., 2022a,b). Similar to other
digital platforms, such as social media and online shopping platforms, users’continued
willingness to use the DSEEP is the main driving force for its development (Hsiao and Chen,
2021;Zhou et al., 2022). All the subjective feelings of users in the process of using products,
systems or services, namely, user experience (UX) (Tung and Campos, 2022), which occurs
throughout the process of users using the DSEEP, are important influencing factors in users’
continued willingness to use the platform (Liang et al., 2021). Therefore, we believe that
optimizing the UX of the platform is of great significance to enhance users’willingness to
continue using it and promote the sustainable development of the platform. Constructing a
reasonable model of UX-influencing factors for a DSEEP and accurately identifying and
analyzing the key influencing factors among them is the main research problem of this study.
Considering the existing research, the emerging research area of UX has attracted
extensive attention from scholars in the fields of information science and library science, and
several scholars have already focused on several applications, including social robot (Tung
and Campos, 2022), multi-modal information search (MMIS) (Li et al., 2022a,b), virtual-reality-
based product demonstration systems (Xin, 2022), social media platforms (Liu et al., 2021),
mobile libraries (Wei et al., 2015), and e-government platforms (Okunola and Rowley, 2019),
and multiple results have been achieved in terms of UX-influencing factors (Grange and
Barki, 2020), UX evaluation systems (Hu, 2019) and UX technology innovation (Shin and
Huang, 2020). However, we believe that there remain some gaps in the existing field of UX
research. In terms of research objectives, although DSEEPs can effectively meet the
requirements of the general public, students, universities, and government in relation to
science and education evaluation information and are very valuable, relatively few studies
have been conducted on them. In terms of research methods, because UX is highly subjective
and difficult to measure directly, previous studies have primarily focused on qualitative
research, and only questionnaires, interviews and literature survey methods are used to
obtain the relevant influencing factors of UX without further measuring the actual influence
degree of each influencing factor.
In this study, we used the following approach to bridge these research gaps. First, we
selected DSEEPs, which currently receive less attention but have important research value as
the research objects. Second, we decided to use a combination of subjective and objective
approaches to conduct the study and used a combination of literature survey, model and
semi-structured interview methods to construct a model of UX-influencing factors for a
DSEEP. Finally, we invited experts in the field of UX to provide ratings, used the rating data
as the data source, measured the actual degree of influence of each influencing factor of UX
using the fuzzy DEMATEL method, which is a quantitative method, identified and analyzed
the key influencing factors among them, and proposed suggestions for optimizing the DSEEP
UX from the perspective of platform managers.
2. Literature review
This section reviews and discusses recent research results on UX-influencing factors by
scholars in the fields of information science and library science, which provided a theoretical
and empirical basis for this study.
LHT
42,6
1840
Get this document and AI-powered insights with a free trial of vLex and Vincent AI
Get Started for FreeStart Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
