Moving from guideline to measure to findings: The Australian Evaluation Society and the Learn Evaluation Assessment Portal
| Published date | 01 December 2024 |
| DOI | http://doi.org/10.1177/1035719X241293808 |
| Author | Amy M Gullickson,Taimur Siddiqi,Delyth Lloyd,Anne Stephens,George Argyrous,Lauren Wildschut |
| Date | 01 December 2024 |
Academic Article
Evaluation Journal of Australasia
2024, Vol. 24(4) 272–300
© The Author(s) 2024
Article reuse guidelines:
sagepub.com/journals-permissions
DOI: 10.1177/1035719X241293808
journals.sagepub.com/home/evj
Moving from guideline to
measure to findings: The
Australian Evaluation Society
and the Learn Evaluation
Assessment Portal
Amy M Gullickson
The University of Melbourne, Australia
Taimur Siddiqi
Victoria Legal Services Board and Commissioner, Australia
Delyth Lloyd
Victoria Department of Health, Australia
Anne Stephens
Ethos of Engagement, Australia
George Argyrous
Paul Ramsay Foundation, Australia
Lauren Wildschut
Stellenbosch University, South Africa
Abstract
In 2013, the Australasian Evaluation Society (AES) launched the Evaluators’Professional
Learning Competency Framework. In 2020, the AES (now Australian Evaluation So-
ciety) partnered with learnevaluation.org to develop an online self-assessment for the
AES community. The AES Competencies were explicitly designed to support pro-
fessional learning, not as any kind of assessment instrument. Therefore, work was
Corresponding author:
Amy M Gullickson, The University of Melbourne, Melbourne, VIC 3010, Australia.
Email: amy.gullickson@unimelb.edu.au
needed to update the competencies into a measurable format. The authors report the
history of the competencies, developments made before and after pilot testing them in
the online Learn Evaluation Assessment Portal (LEAP), and the findings from the data
collected over two and a half years of using the LEAP. The AES Competencies
Framework remains one of the few competency sets with explicit knowledge and skill
statements related to the logic of evaluation.
Keywords
evaluator competencies, evaluator self-assessment, evaluation capacity building,
evaluation professional associations, research on evaluation
What we already know
•Evaluator competency sets have become a way to define the profession of
evaluation.
•Self-assessments are useful for planning personal and organisational
evaluation capacity building.
•Few self-assessments of evaluator competencies exist.
The original contribution the article makes to theory and/
or practice
•History of the AES Evaluators’Professional Learning Competency
Framework.
•Publication of updated AES competency framework used in the self-
assessment.
•Analysis of findings on the competencies from the self-assessment.
Introduction
For evaluation to fully mature as a profession, there needs to be a process for de-
termining the necessary knowledge, skills, and values which evaluators require –no
matter where they practise (Smith, 1999;Worthen, 1994;Worthen & Sanders, 1991).
Evaluator competencies, ‘the essential knowledge, skills, and dispositions that eval-
uators need to conduct program evaluations effectively’(Ghere et al., 2006, p. 109)
have been developed by academics, Voluntary Organisations for Professional Eval-
uation, and other organisations worldwide to address this need in their contexts.
Gullickson et al. 273
Get this document and AI-powered insights with a free trial of vLex and Vincent AI
Get Started for FreeStart Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting
Start Your Free Trial of vLex and Vincent AI, Your Precision-Engineered Legal Assistant
-
Access comprehensive legal content with no limitations across vLex's unparalleled global legal database
-
Build stronger arguments with verified citations and CERT citator that tracks case history and precedential strength
-
Transform your legal research from hours to minutes with Vincent AI's intelligent search and analysis capabilities
-
Elevate your practice by focusing your expertise where it matters most while Vincent handles the heavy lifting