Evaluating the cultural appropriateness of service delivery in multi-ethnic communities

AuthorDavid R Thomas
DOI10.1177/1035719X0200200213
Published date01 December 2002
Date01 December 2002
Subject MatterRefereed Article
81423 01-07
R E F E R E E D A R T I C L E
E v a l u a t i o n J o u r n a l o f A u s t r a l a s i a , V o l . 2 ( n e w s e r i e s ) , N o . 2 , D e c e m b e r 2 0 0 2 , p p . 5 0 – 5 6
Evaluating the cultural
appropriateness of service delivery
in multi-ethnic communities
In reports of evaluations carried out in New Zealand the assessment of
David R Thomas
the cultural appropriateness of the service being evaluated is rarely
mentioned. Over the past 5-10 years evaluators have been
increasingly required to demonstrate that their research approach is
consistent with the principles of the Treaty of Waitangi and responsive
to the needs of the indigenous Mäori people and other non-dominant
ethnic groups such as those of Pacific descent. This requires attention
to at least two aspects of an evaluation: (1) the appropriate design of
the research methods and conduct of the research team; and (2)
assessment of the extent to which programs and services operate in
culturally appropriate ways. There has been relatively little discussion of
how these aspects might be incorporated into the design of
evaluations. This paper will focus on the second topic. Literature
discussing appropriate programs and services for indigenous Mäori
people in New Zealand is reviewed. Specific strategies for assessing
culturally appropriateness are illustrated using examples drawn from
evaluation of ‘mainstream’ services in New Zealand. These topics will
include: program management policies and practices, staff training
and orientation, use of cultural advisers, networking with local
communities, and liaison with specialist service providers. A framework
that includes specific indicators for assessing the cultural
appropriateness of services is outlined.
Introduction
New Zealand and Australia both have culturally diverse populations in the cities and
larger towns where social programs and services are delivered. In spite of this
diversity there has been relatively little evaluation literature reporting criteria for
assessing the extent to which services delivered are culturally appropriate for multiple
ethnic groups. A review of papers published in the Evaluation Journal of Australasia
over the last six years located only two studies that have mentioned or addressed
cultural appropriateness (Faisandier & Bunn 1997; Scougall 1997). A small number
of papers covering evaluations from cross-cultural or international perspectives did
not mention cultural appropriateness. Only a few Australian reports have referred to
the need to incorporate cultural appropriateness in evaluation (e.g. Gray et al. 1995;
Mooney, Jan & Wiseman 2002; Scougall 1997). Most mention the need to engage in
community consultation, such as with indigenous stakeholders. However, no detailed
guidelines appear to have been developed for assessing the extent to which programs
and services are culturally appropriate for ethnically diverse client groups.
In New Zealand there is now a considerable literature about the need for
Professor David Thomas is
evaluations to take into account the cultural appropriateness of services provided for
based in the Division of
Mäori. This is often framed in terms of meeting obligations arising from the Treaty of
Community Health at the
Waitangi for services and evaluations that involve Mäori people (e.g. Durie 1994;
Durie 2001; Durie & Kingi 1997; Te Puni Kokiri 1999). The report by Faisandier &
University of Auckland and is
Bunn (1997) described in some detail the evaluation of two parallel programs for
Director of the Health
treatment of alcohol addiction, one for non-Mäori and one for Mäori (the Taha
Research Methods Advisory
Mäori Program). This paper was noteworthy for providing detail about the
Service and the Survey
evaluation design to ensure it was appropriate for the Taha Mäori program.
Research Unit.
50
E v a l u a t i o n J o u r n a l o f A u s t r a l a s i a , V o l . 2 ( n e w s e r i e s ) , N o . 2, D e c e m b e r 2 0 0 2

R E F E R E E D A R T I C L E
Given the need to assess cultural
program and services, and the delivery of services in
appropriateness, it is perhaps surprising that no
ways that are incompatible with, or inappropriate
general model or framework has been elaborated in
for, the cultural styles of Mäori clients (e.g. Durie
the Australasian evaluation literature. The AES
2001; Durie & Kingi 1997; Te Puni Kokiri 1999).
Guidelines for the ethical conduct of evaluations,
However, there is a need for further development of
which have been updated recently (Australasian
the criteria relevant to assessing cultural
Evaluation Society 2002), include the following
appropriateness to guide effective evaluations. A
guideline under the heading ‘Consider implications
further point is that it has become common in New
of differences and inequalities’. While not
Zealand for government-funded requests for
specifically mentioning cultural appropriateness, this
proposals to include a requirement that evaluators
concept is perhaps implicit in guideline 10:
assess whether ‘the delivery of services is culturally
appropriate for clients’ and whether ‘agencies,
Account should be taken of the potential effects of
programs and services meet the specific cultural and
differences and inequalities in society related to
ethnic needs of the clients’.
race, age, gender, sexual orientation, physical or
intellectual ability, religion, socio-economic or
Types of program providers
ethnic background in the design, conduct and
In New Zealand programs and services can be seen
reporting of evaluations. Particular regard should
as somewhere on a continuum from ‘mainstream’
be given to any rights, protocols, treaties or legal
which are essentially monocultural (providing a
guidelines which apply.
‘standard’ treatment for all clients or participants)
through those which endeavour to ensure that
The purpose of this paper is to:
services provided are culturally appropriate for
■ review recent New Zealand literature relevant to
more than one cultural group to ethnic or culture
assessing the cultural appropriateness of
specific programs intended to provide services for
programs and services
specific...

To continue reading

Request your trial

VLEX uses login cookies to provide you with a better browsing experience. If you click on 'Accept' or continue browsing this site we consider that you accept our cookie policy. ACCEPT