Measuring the usability of academic digital libraries. Instrument development and validation

Published date09 August 2011
DOIhttps://doi.org/10.1108/02640471111156777
Date09 August 2011
Pages523-537
AuthorSoohyung Joo,Jee Yeon Lee
Subject MatterInformation & knowledge management,Library & information science
Measuring the usability of
academic digital libraries
Instrument development and validation
Soohyung Joo
School of Information Studies, University of Wisconsin-Milwaukee,
Milwaukee, Wisconsin, USA, and
Jee Yeon Lee
Yonsei University, Seoul, South Korea
Abstract
Purpose – This study aims to develop a measurement instrument, which involves four usability
dimensions of efficiency, effectiveness, satisfaction, and learnability, as a way of assessing the
usability of academic digital libraries.
Design/methodology/approach – To generate measurement items, previous research related to
usability frameworks, usability guidelines, and empirical usability tests was reviewed. The
measurement instrument was then verified in terms of reliability and validity, empirically using data
from 230 actual users of an academic digital library. To ensure the reliability of the instrument,
internal consistency of measurements, measurement item reliability, and construct reliability were
examined. Construct validity, which consists of convergent validity and discriminant validity, was
also examined on the basis of confirmatory factor analysis using structural equation modeling.
Findings – The usability evaluation instrument suggested in this study comprises four dimensions:
efficiency, effectiveness, satisfaction, and learnability, and three to four items were identified to
measure each dimension.
Originality/value – To date, while many of the usability studies have relied on either experimental
methods or inspection methods, few studies have been conducted to identify evaluation measures that
can assess the usability of a digital library from a survey method. This study is one of a few studies to
develop a measurement instrument tailored to academic digital library environments.
Keywords Digital libraries,Academic libraries, Measurement
Paper type Research paper
Introduction
With the rapid expansion of web information technology, the growth of available
electronic materials, and increaseduser needs for web-based informationsources, digital
libraries have supplemented and even replaced significant portions of traditional library
services in academic environments. Recently, many researchers have addressed a
substantial change in user preferences,namely, the preference for electronic sources over
traditional paper-based resources.Accordingly, online informationresources are utilized
more often than traditional paper-based sources for academic purposes (Tenopir et al.,
2003; Bar-Ilan and Fink, 2005; Lee et al., 2008; Xie and Joo, 2009). A digital library
provides not only convenient access to and retrieval of resources, but also easier
acquisition of full-text materials than do traditional library services.
Digital libraries have become a fundamental information source for faculty
members, researchers, and students in research and education. The definition of digital
The current issue and full text archive of this journal is available at
www.emeraldinsight.com/0264-0473.htm
Usability of
academic digital
libraries
523
Received January 2010
Revised March 2010
Accepted April 2010
The Electronic Library
Vol. 29 No. 4, 2011
pp. 523-537
qEmerald Group Publishing Limited
0264-0473
DOI 10.1108/02640471111156777

To continue reading

Request your trial

VLEX uses login cookies to provide you with a better browsing experience. If you click on 'Accept' or continue browsing this site we consider that you accept our cookie policy. ACCEPT