Evaluation Journal of Australasia

Publisher:: Sage Publications, Inc.
Publication date:: 2021-09-06

ISBN:: 1035-719X

Issue Number

Latest documents

The practice of evaluation: Partnership approaches for community change
Exploring action research as a method of creating evidence that is informed by Aboriginal and Torres Strait Islander ways of being, doing and knowing
Over the past two decades there has been growing acknowledgement of the need to decolonise approaches to evaluation policy, programs and services impacting on the lives of Aboriginal and Torres Strait Islander Peoples. Action research methodologies have been identified as the most appropriate approach (Evans et al., 2014). This article outlines how a community controlled peak body is utilising an action research approach guided by First Nations wisdom and knowledge to drive evaluation. Examination of two action research projects undertaken by Queensland Aboriginal and Torres Strait Islander Child Protection Peak (QATSICPP) demonstrate how action research embodies the principles of self-determination and Indigenous Data Sovereignty in evaluative processes. The article also highlights how evaluative evidence informs new approaches to address the overrepresentation of Aboriginal and Torres Strait Islander children in child protection. Project reflections suggest participants found the action research approach inclusive, participatory, and effective in assisting them to address critical practice and systemic issues. The importance of ensuring evaluative methodologies are meaningful for Aboriginal and Torres Strait Islander people was also highlighted.
Embedding evaluation in non-profit organisations: Lessons from evaluation advocates
Integrating evaluation initiatives in organisations as part of routine operations to support organisational learning and development can be difficult; extant literature lacks detail on the factors enhancing sustainability. This article presents research undertaken with evaluation advocates attempting to embed evaluation in their Australian non-profit organisations. The research involved interviewing seventeen participants, four of whom also were the focus of organisational case studies. The researchers used social interdependence theory to understand participants’ strategies for embedding evaluation and found that some elements of cooperative teamwork were more prominent than others. Participants in high hierarchical positions, or those who had influence, worked intentionally and incorporated strategies that aligned with all five elements. Examples of those strategies and their use in context presented herein may help leaders and internal and external evaluators increase the likelihood of embedding evaluation in organisational systems.
Transformative spaces for evaluation in programs, policies and organisations
Evaluator Perspective: Meet an Australian Evaluation Society Fellow – Janet Clinton
A scoping review of commissioning practices used in the evaluation of Indigenous health and wellbeing programs: Protocol article
Despite the billions of dollars invested in improving Indigenous health and wellbeing outcomes in Australia, there is little evidence of program effectiveness to inform policy and practice. The deficiency of evaluations is problematic. Critical to this process is the effective engagement of commissioners with Indigenous peoples, which is not well documented. Currently, there is scant evidence on modes of commissioning practices used. This scoping review will aim to identify the spectrum of commissioning practices used when evaluating Indigenous health and wellbeing programs in Australia, codifying them into a model set. Documents (between 2008 and 2020) will be retrieved from Scopus, Proquest, Informit, Google Scholar and via a web-based search that refers to the commissioning of Indigenous health and wellbeing program evaluations in Australia, New Zealand, Canada or the United States. Importantly, the research team is Indigenous-led and the project’s governance, quality and translation framework will be informed by a project advisory group, including Indigenous associates. This will be the first scoping review globally to identify practices used to commission Indigenous health and wellbeing program evaluations. Results will be utilised to strengthen the commissioning practices of Indigenous health and wellbeing programs in Australia and overseas.
Getting evaluation right in diverse contexts
Population health challenges and evaluative thinking: Rapid responses in the time of COVID-19
There are multiple complex challenges that the population health sector faces to improve the health of the community, and the sector must work efficiently and effectively to make the most of the committed funds, sometimes in contexts of uncertainty. This article explores, through the case study of the South Australian COVID-19 Vaccine Hesitancy Project, the application of pillars from the Lean Start-up model of setting a clear vision, and creation of a series of minimum viable products to enable work with the community to commence as quickly as possible. This article draws parallels between this corporate model and the notion of evaluative thinking as well as adaptive evaluation approaches, demonstrates the interest from population health program and policy actors in adaptive practices and proposes a continuing opportunity for the evaluation profession in this space.
Advancing an ethical imperative for collaborative approaches to evaluation with low incidence and underserved communities: Insights from a DeafBlind Support Services pilot program evaluation
This practice article advances an ethical imperative for guiding collaborative approaches to evaluation with low incidence and underserved communities. We describe our evaluation processes for building transformative partnerships during a DeafBlind Support Services pilot program evaluation in Western Canada using collaborative approaches to evaluation. This program was designed to enable adults living with dual sensory loss to experience self-determined activities in the community that enhance resilience and belonging. Key features involve specialised Support Service Providers who assist DeafBlind community members with accessing and participating in essential community services and social, vocational, educational, and recreational activities. In presenting our co-generated evaluation insights, we advance an ethical imperative describing philosophical foundations, pragmatic actions, and political leadership for implementation of collaborative approaches to evaluation with a low incidence and underserved community.
An asset-based evaluation of a novel New Zealand rural health service
This article describes the background behind the development of a novel evaluation approach of an Aotearoa New Zealand rural health service using an equity-focused, strengths-based approach to complement the traditional audit process. This approach avoids a deficit-based, gap-analysis of service shortcomings in favour of a strengths-based model through which services can draw on identified assets in planning future service initiatives. The approach discussed aims to identify and mobilise assets and strengths of people and services that promote quality outcomes, with a particular focus on those that address the deeply embedded health inequities for Māori (the indigenous people of Aotearoa). The asset model will be used to evaluate a rural service that is uniquely co-located with other health-related hospital services. This article aims to provide a commentary on the benefits of an asset-based approach to rural general practice evaluation.