Exploring the reliability and acceptability of cognitive tests for Indigenous Australians

A pilot study

Kylie M. Dingwall, Allison Olga Gray, Annette R. McCarthy, Jennifer F. Delima, Stephen C. Bowden

    Research output: Contribution to journalArticleResearchpeer-review

    6 Downloads (Pure)

    Abstract

    Background: Reliable cognitive assessment for Indigenous Australians is difficult given that mainstream tests typically rely on Western concepts, content and values. A test's psychometric properties should therefore be assessed prior to use in other cultures. The aim of this pilot study was to examine the reliability and acceptability of four cognitive tests for Australian Aboriginal people.

    Methods: Participants were 40 male and 44 female (N = 84) Aboriginal patients from Alice Springs Hospital. Four tests were assessed for reliability and acceptability - Rowland Universal Dementia Assessment Screen (RUDAS) (n = 19), PEBL Corsi Blocks (Corsi) (n = 19), Story Memory Recall Test (SMRT) (n = 17) and a CogState battery (n = 18). Participants performed one to three of the tests with repeated assessment to determine test-retest reliability. Qualitative interviews were conducted and analysed based on an adapted phenomenological approach to explore test acceptability. An Indigenous Reference Group gave advice and guidance.

    Results: Intra-class correlations (ICC) for test retest reliability ranged from r = 0.58 (CogState One Back accuracy) to 0.86 (RUDAS). Themes emerged relating to general impressions, impacts on understanding and performance, appropriateness, task preferences and suggested improvements.

    Conclusions: RUDAS, CogState Identification task, and SMRT showed the highest reliabilities. Overall the tests were viewed as a positive challenge and an opportunity to learn about the brain despite provoking some anxiety in the patients. Caveats for test acceptability included issues related to language, impacts of convalescence and cultural relevance.

    Original languageEnglish
    Article number26
    Pages (from-to)1-16
    Number of pages16
    JournalBMC Psychology
    Volume5
    Issue number1
    DOIs
    Publication statusPublished - 2 Aug 2017

    Fingerprint

    Dementia
    Reproducibility of Results
    Task Performance and Analysis
    Psychometrics
    Language
    Anxiety
    Interviews
    Brain

    Cite this

    Dingwall, Kylie M. ; Gray, Allison Olga ; McCarthy, Annette R. ; Delima, Jennifer F. ; Bowden, Stephen C. / Exploring the reliability and acceptability of cognitive tests for Indigenous Australians : A pilot study. In: BMC Psychology. 2017 ; Vol. 5, No. 1. pp. 1-16.
    @article{c00fed55cc4044d99d63d0a6463d0276,
    title = "Exploring the reliability and acceptability of cognitive tests for Indigenous Australians: A pilot study",
    abstract = "Background: Reliable cognitive assessment for Indigenous Australians is difficult given that mainstream tests typically rely on Western concepts, content and values. A test's psychometric properties should therefore be assessed prior to use in other cultures. The aim of this pilot study was to examine the reliability and acceptability of four cognitive tests for Australian Aboriginal people. Methods: Participants were 40 male and 44 female (N = 84) Aboriginal patients from Alice Springs Hospital. Four tests were assessed for reliability and acceptability - Rowland Universal Dementia Assessment Screen (RUDAS) (n = 19), PEBL Corsi Blocks (Corsi) (n = 19), Story Memory Recall Test (SMRT) (n = 17) and a CogState battery (n = 18). Participants performed one to three of the tests with repeated assessment to determine test-retest reliability. Qualitative interviews were conducted and analysed based on an adapted phenomenological approach to explore test acceptability. An Indigenous Reference Group gave advice and guidance. Results: Intra-class correlations (ICC) for test retest reliability ranged from r = 0.58 (CogState One Back accuracy) to 0.86 (RUDAS). Themes emerged relating to general impressions, impacts on understanding and performance, appropriateness, task preferences and suggested improvements. Conclusions: RUDAS, CogState Identification task, and SMRT showed the highest reliabilities. Overall the tests were viewed as a positive challenge and an opportunity to learn about the brain despite provoking some anxiety in the patients. Caveats for test acceptability included issues related to language, impacts of convalescence and cultural relevance.",
    keywords = "Aboriginal, Cognition, Cognitive testing, Cross-cultural, Indigenous",
    author = "Dingwall, {Kylie M.} and Gray, {Allison Olga} and McCarthy, {Annette R.} and Delima, {Jennifer F.} and Bowden, {Stephen C.}",
    year = "2017",
    month = "8",
    day = "2",
    doi = "10.1186/s40359-017-0195-y",
    language = "English",
    volume = "5",
    pages = "1--16",
    journal = "BMC Psychology",
    issn = "2050-7283",
    publisher = "BioMed Central",
    number = "1",

    }

    Exploring the reliability and acceptability of cognitive tests for Indigenous Australians : A pilot study. / Dingwall, Kylie M.; Gray, Allison Olga; McCarthy, Annette R.; Delima, Jennifer F.; Bowden, Stephen C.

    In: BMC Psychology, Vol. 5, No. 1, 26, 02.08.2017, p. 1-16.

    Research output: Contribution to journalArticleResearchpeer-review

    TY - JOUR

    T1 - Exploring the reliability and acceptability of cognitive tests for Indigenous Australians

    T2 - A pilot study

    AU - Dingwall, Kylie M.

    AU - Gray, Allison Olga

    AU - McCarthy, Annette R.

    AU - Delima, Jennifer F.

    AU - Bowden, Stephen C.

    PY - 2017/8/2

    Y1 - 2017/8/2

    N2 - Background: Reliable cognitive assessment for Indigenous Australians is difficult given that mainstream tests typically rely on Western concepts, content and values. A test's psychometric properties should therefore be assessed prior to use in other cultures. The aim of this pilot study was to examine the reliability and acceptability of four cognitive tests for Australian Aboriginal people. Methods: Participants were 40 male and 44 female (N = 84) Aboriginal patients from Alice Springs Hospital. Four tests were assessed for reliability and acceptability - Rowland Universal Dementia Assessment Screen (RUDAS) (n = 19), PEBL Corsi Blocks (Corsi) (n = 19), Story Memory Recall Test (SMRT) (n = 17) and a CogState battery (n = 18). Participants performed one to three of the tests with repeated assessment to determine test-retest reliability. Qualitative interviews were conducted and analysed based on an adapted phenomenological approach to explore test acceptability. An Indigenous Reference Group gave advice and guidance. Results: Intra-class correlations (ICC) for test retest reliability ranged from r = 0.58 (CogState One Back accuracy) to 0.86 (RUDAS). Themes emerged relating to general impressions, impacts on understanding and performance, appropriateness, task preferences and suggested improvements. Conclusions: RUDAS, CogState Identification task, and SMRT showed the highest reliabilities. Overall the tests were viewed as a positive challenge and an opportunity to learn about the brain despite provoking some anxiety in the patients. Caveats for test acceptability included issues related to language, impacts of convalescence and cultural relevance.

    AB - Background: Reliable cognitive assessment for Indigenous Australians is difficult given that mainstream tests typically rely on Western concepts, content and values. A test's psychometric properties should therefore be assessed prior to use in other cultures. The aim of this pilot study was to examine the reliability and acceptability of four cognitive tests for Australian Aboriginal people. Methods: Participants were 40 male and 44 female (N = 84) Aboriginal patients from Alice Springs Hospital. Four tests were assessed for reliability and acceptability - Rowland Universal Dementia Assessment Screen (RUDAS) (n = 19), PEBL Corsi Blocks (Corsi) (n = 19), Story Memory Recall Test (SMRT) (n = 17) and a CogState battery (n = 18). Participants performed one to three of the tests with repeated assessment to determine test-retest reliability. Qualitative interviews were conducted and analysed based on an adapted phenomenological approach to explore test acceptability. An Indigenous Reference Group gave advice and guidance. Results: Intra-class correlations (ICC) for test retest reliability ranged from r = 0.58 (CogState One Back accuracy) to 0.86 (RUDAS). Themes emerged relating to general impressions, impacts on understanding and performance, appropriateness, task preferences and suggested improvements. Conclusions: RUDAS, CogState Identification task, and SMRT showed the highest reliabilities. Overall the tests were viewed as a positive challenge and an opportunity to learn about the brain despite provoking some anxiety in the patients. Caveats for test acceptability included issues related to language, impacts of convalescence and cultural relevance.

    KW - Aboriginal

    KW - Cognition

    KW - Cognitive testing

    KW - Cross-cultural

    KW - Indigenous

    UR - http://www.scopus.com/inward/record.url?scp=85026656664&partnerID=8YFLogxK

    U2 - 10.1186/s40359-017-0195-y

    DO - 10.1186/s40359-017-0195-y

    M3 - Article

    VL - 5

    SP - 1

    EP - 16

    JO - BMC Psychology

    JF - BMC Psychology

    SN - 2050-7283

    IS - 1

    M1 - 26

    ER -