Understanding the effects of task and topical knowledge in the evaluation of websites as information patch
| DOI | https://doi.org/10.1108/JD-04-2017-0050 |
| Published date | 08 January 2018 |
| Pages | 162-186 |
| Date | 08 January 2018 |
| Author | Helena Lee,Natalie Pang |
| Subject Matter | Library & information science,Records management & preservation,Document management,Classification & cataloguing,Information behaviour & retrieval,Collection building & management,Scholarly communications/publishing,Information & knowledge management,Information management & governance,Information management,Information & communications technology,Internet |
Understanding the effects of task
and topical knowledge in the
evaluation of websites as
information patch
Helena Lee and Natalie Pang
Department of Information Studies, Nanyang Technological University, Singapore
Abstract
Purpose –The purpose of this paper is to examine the role of task and user’s topic familiarity in the
evaluation of information patch (websites).
Design/methodology/approach –An experimental study was conducted in a computer laboratory to
examine users’information seeking and foraging behaviour. In total, 160 university students participated in
the research. Two types of task instructions, specifically defined and non-specifically defined (general) task
types were administered. Mixed methods approach involving both quantitative and qualitative thematic
coding were adopted, from the data of the questionnaire surveys and post-experiment interviews.
Findings –In the context of task attributes, users who conducted information seeking task with specifically
defined instructions, as compared to the non-specifically defined instructions, demonstrated stricter
credibility evaluations. Evidence demonstrated the link between topical knowledge and credibility perception.
Users with topical knowledge applied critical credibility assessments than users without topical knowledge.
Furthermore, the evidential results supported that the level of difficulty and knowledge of the topic or subject
matter associated with users’credibility evaluations. Users who have lesser or no subject knowledge and who
experienced difficulty in the information search tended to be less diagnostic in their appraisal of the
information patch (website or webpages). Users equipped with topical knowledge and who encountered less
difficulty in the search, exhibited higher expectation and evaluative criteria of the information patch.
Research limitations/implications –The constraints of time in the lab experiment, carried out in the
presence of and under the observation of the researcher, may affect users’information seeking behaviour.
It would be beneficial to consider users’information search gratifications and motivations in studying
information evaluations and foraging patterns. There is scope to investigate users’proficiency such as expert
or novice, and individual learning styles in assessing information credibility.
Practical implications –Past studies on information evaluation, specifically credibility is often associated
with users’characteristics, source, or contents. This study sheds light on the context of task type, task
difficulty and topical knowledge in affecting users’information judgement.
Originality/value –One of the scarce studies in relating task orientation, task difficulty and topical
knowledge to information evaluations.
Keywords Task type, Information credibility,Information evaluation, Information patch, Information scent,
Topical knowledge
Paper type Research paper
Introduction
Users conducting information search task exhibit varied information processing behaviour in
multiple context such as task attributes, users’characteristics, and the information environments
that are entrenched within the task activities. Information search task comprises simple
browsing task, or specific task with well-defined task goals. Users’characteristics such as
information search experience, topical knowledge or topic familiarity and the perceived task
difficulty affect their performance (Locke et al., 1981; Saracevic and Kantor, 1988). In Blackmon’s
(2012) study on task difficulty and user’s allocation of attention on the webpages, the results
showed that users who took on difficult information search were less successful in task
completion.Theformulationoftasksearchstartswithusers’initiation, selection, exploration,
formulation, collection, to presentation (Kuhlthau, 1991). Kuhltau’s model of information seeking
process suggested that information evaluation is central to information retrieval.
Journal of Documentation
Vol. 74 No. 1, 2018
pp. 162-186
© Emerald PublishingLimited
0022-0418
DOI 10.1108/JD-04-2017-0050
Received 4 April 2017
Revised 2 August 2017
Accepted 3 August 2017
The current issue and full text archive of this journal is available on Emerald Insight at:
www.emeraldinsight.com/0022-0418.htm
162
JD
74,1
In conducting information search task, familiarity of the subject or topical knowledge
has impact on the information behaviour (Vakkari, 2002). Contextual factors such as
situation, social, and user’s subject matter knowledge may influence the cognitive and
affective human information processing behaviour (Allen, 1997; Savolainen, 2012).
Users equipped with topical knowledge and prior search experience of the subject are
likely to be evaluative, and adopt an efficient approach in their search goal. Previous
research (Shiri, 2005) suggested that users who possess higher level of topic familiarity
demonstrated ability to formulate relevant queries and terminologies. These studies implied
that cognitive state and proficiency of the subject matter or topical knowledge have an
impact on information users’searching strategies and information evaluations.
In the everyday life information seeking, users’information behaviour and perception of
the information credibility, quality and value relies on the cognitive, affective and
situational factors (Savolainen and Kari, 2004). To overcome information overload,
information seekers tend to assess the credibility and reliability of the information source
and content stronger than the information recency (Sundar et al., 2007). The process of
discerning the perceived value and credibility of the informational cues or source requires a
series of evaluative information judgements on the part of the users. In optimal foraging
behaviour (Stephens and Krebs, 1986) the cues displayed in the information environments,
or information patch (Pirolli and Card, 1999) determine the response of information seekers.
Despite these studies, there has been less attention paid to the effect of topical knowledge
and level of task difficulty on users’information judgement, specifically the perceived
credibility of the information environments.
In the online information environment, information patches are websites and webpages
that comprise the interactive links of hypermedia and hypertext documents (Catledge and
Pitkow, 1995; Lazo nder et al., 2000). These links included the visual elements, cues and
objects that emit an information scent (Olston and Chi, 2003). The transmission
of the information scent, be it strong or weak information scent, derived from the
hyperlinks and cues shapes users’judgement and information processing. Information
cues are displayed in the form of visual cues (Tomasi, 2014), source cues (Winter and
Kramer, 2012), and informational cues. Pirolli and Card (1999) suggested that these cues
transmit an information scent by which people use as the proximal means to evaluate the
value and relevance of information sources. Information users tend to weigh the cost and
benefits when foraging for information, and choose between alternatives of the
information scent to follow. It would be meaningful to examine the relationship between
the contexts of task, topical knowledge in users’information scent engagement and
information credibility evaluations.
Research questions
In examining information behaviour to meet individual or organisation’s information needs,
it is equally important to study information seeking behaviour in relation to task orientation
(Wilson, 2000). Performing a task involves physical actions and cognitive behaviour
(Vakkari, 2005), and it is appropriate to understand how task attributes such as task
specificity and task difficulty affect the cognitive information behaviour. The specificity and
complexity of the task affect the search performance (Saracevic and Kantor, 1988). In the
context of optimising the information search goal, individuals commonly adopt a satisficing
decision, using rules of thumb instead of a rational choice (Gigerenzer and Goldstein, 1996)
when encountering challenging or difficult information search task.
Information judgement encompasses the process of evaluative effort such as the
assessment of the credibility, quality, value, and cognitive authority of resources
(Hughes et al., 2010, p. 4; Rieh and Danielson, 2007) and hypertextual links nestled in the web
environments. Past studies on credibility, such as source credibility based on the media
163
Evaluation of
websites as
information
patch
To continue reading
Request your trial