TY - JOUR
T1 - Methodological pluralism for better evaluations of complex interventions
T2 - Lessons from evaluating an innovation platform in Australia
AU - Bailie, J.
AU - Cunningham, F.
AU - Abimbola, S.
AU - Laycock, A.
AU - Bainbridge, R.
AU - Bailie, R.
AU - Conte, K.
AU - Passey, M.
AU - Peiris, D.
N1 - Funding Information:
The National Health and Medical Research Council ( www.nhmrc.gov.au ) funded the Centre for Research Excellence in Integrated Quality Improvement (#1078927) and the Centre for Research Excellence in Strengthening Systems for Indigenous Healthcare Equity (#1170882). Jodie Bailie was supported by a University of Sydney Postgraduate Award (#SC0649). Megan Passey is supported by a NHMRC Career Development Fellowship (#1159601). Seye Abimbola is supported by a NMHRC Overseas Early Career Fellowship (#1139631). In-kind support was provided by a range of community-controlled and government agencies.
Publisher Copyright:
© 2022, The Author(s).
PY - 2022/1/28
Y1 - 2022/1/28
N2 - Complex interventions, such as innovation platforms, pose challenges for evaluators. A variety of methodological approaches are often required to build a more complete and comprehensive understanding of how complex interventions work. In this paper, we outline and critically appraise a methodologically pluralist evaluation of an innovation platform to strengthen primary care for Aboriginal and Torres Strait Islander Australians. In doing so, we aim to identify lessons learned from the approach taken and add to existing literature on implementing evaluations in complex settings, such as innovation platforms. The pluralist design used four evaluation approaches-developmental evaluation, principles-focused evaluation, network analysis, and framework analysis-with differing strengths and challenges. Taken together, the multiple evaluation approaches yielded a detailed description and nuanced understanding of the formation, functioning and outcomes of the innovation platform that would be difficult to achieve with any single evaluation method. While a methodologically pluralist design may place additional pressure on logistical and analytic resources available, it enables a deeper understanding of the mechanisms that underlie complex interventions.
AB - Complex interventions, such as innovation platforms, pose challenges for evaluators. A variety of methodological approaches are often required to build a more complete and comprehensive understanding of how complex interventions work. In this paper, we outline and critically appraise a methodologically pluralist evaluation of an innovation platform to strengthen primary care for Aboriginal and Torres Strait Islander Australians. In doing so, we aim to identify lessons learned from the approach taken and add to existing literature on implementing evaluations in complex settings, such as innovation platforms. The pluralist design used four evaluation approaches-developmental evaluation, principles-focused evaluation, network analysis, and framework analysis-with differing strengths and challenges. Taken together, the multiple evaluation approaches yielded a detailed description and nuanced understanding of the formation, functioning and outcomes of the innovation platform that would be difficult to achieve with any single evaluation method. While a methodologically pluralist design may place additional pressure on logistical and analytic resources available, it enables a deeper understanding of the mechanisms that underlie complex interventions.
KW - Collaborations
KW - Complex interventions
KW - Developmental evaluation
KW - Innovation platforms
KW - Network analysis
KW - Principles-focused evaluation
KW - Systems thinking
KW - Utilization-focused
UR - http://www.scopus.com/inward/record.url?scp=85123815814&partnerID=8YFLogxK
U2 - 10.1186/s12961-022-00814-5
DO - 10.1186/s12961-022-00814-5
M3 - Article
C2 - 35090472
AN - SCOPUS:85123815814
SN - 1478-4505
VL - 20
SP - 1
EP - 14
JO - Health Research Policy and Systems
JF - Health Research Policy and Systems
IS - 1
M1 - 14
ER -