A Critique of Using the Delphi Technique for Assessing Evaluation Capability-Building Needs
| Author | Julie McGeary |
| Published date | 01 March 2009 |
| Date | 01 March 2009 |
| DOI | http://doi.org/10.1177/1035719X0900900105 |
| Subject Matter | Refereed Article |
31
McGeary— A critique of using the Delphi technique for assessing evaluation capability-building needs
Evaluation Journal of Australasia, Vol. 9, No. 1, 2009, pp. 31–39
REFEREED ARTICLE
A critique of using the Delphi
technique for assessing evaluation
capability-building needs
This article examines the use of the Delphi technique
as part of a Needs Assessment to inform an
evaluation capability-building plan within a government
department. Besides considering the Delphi process
itself, it also raises methodological issues and suggests
steps that might be taken in the future.
Introduction
This article focuses on the use of the Delphi technique for a component of
a Needs Assessment to inform the development of an Evaluation Capability
Building Plan for the Agriculture and Fisheries Group of the Victorian
Department of Primary Industries.
It begins with the contextual background to the Agriculture and
Fisheries Group and an outline of the evaluation task in order to give the
reader an understanding of the organisational environment in which this
task has been situated. Concepts of Evaluation Capability Building and
Needs Assessment are then introduced. This is followed by a description of
the Delphi application and an analysis of the findings. In the next section
methodological issues are discussed before conclusions are offered with
suggestions for the next steps.
Background
The Victorian Department of Primary Industries
The Victorian Department of Primary Industries (DPI) is a large public
sector organisation promoting the sustainable development of primary and
energy industries for the benefit of all Victoria. Responsibility for Victoria’s
agriculture and fisheries sectors rests with the Agriculture and Fisheries
Group (AFG) within DPI.
The main purpose of evaluation within AFG is to demonstrate
accountability for the use of public funds. However, evaluation is also
considered an essential learning tool to inform decisions of investment, as
well as program planning, development and implementation (DPI 2008).
AFG recently produced an Evaluation Framework that articulates the
organisation’s evaluation requirements and expectations. This framework
aims to ‘contribute to the efficient and effective delivery of outcomes
to Victorians by providing a more systematic and rigorous approach to
evaluation’ (DPI 2008, p. 2).
Julie McGeary
Julie McGeary is an Evaluation Specialist
with the Victorian Department of Primary
Industries, Ballarat, Victoria.
Email: <julie.mcgeary@dpi.vic.gov.au>
EJA_9_1.indb 31 18/10/09 10:34:21 PM
To continue reading
Request your trial