Measuring the unmeasured in educational programs

filling in the blanks through evaluation

John Guenther

    Research output: Contribution to journalArticleResearchpeer-review

    Abstract

    The indicators of performance put forward as measures of achievement at a state and territory level in Australia reflect to some extent the priorities of those jurisdictions. These are revealed in the annual reports of departments, usually under headings of targets and corresponding outcomes. It may seem reasonable to assume that these performance measures line up with stated objectives, and with what matters on the ground. But do they? This paper argues that while the aims of education are broad, the measures of education are narrow. Philosophically, a good education is one that has social, developmental, intellectual and economic aims. However, even though some of those broad aims are reflected in national, state and territory foundational documents and reports, they are not reflected in Australian measurement or reporting frameworks, which seem to suggest that it is neither practical nor cost-effective to collect such data. The purpose of this paper is to demonstrate that it is possible to measure educational success in ways that support the broader goals of education and schooling in Australia. To this end, the paper draws on two evaluation case studies in the field of education (run within schools), to highlight ways that the unmeasured aspects of educational activity can be measured. One case highlights the significance of social capital in a school-family partnership program, and the other demonstrates the psycho-social benefits of an alternative education program for ‘at risk’ children. These cases illustrate what can be measured and they provide useful data to fill in the blanks of what is not measured at a system level. However, the cases also raise bigger questions about what should be measured and reported as indicators of what matters to educational stakeholders.
    Original languageEnglish
    Pages (from-to)204-222
    Number of pages19
    JournalLearning Communities: International Journal of Learning in Social contexts
    Volume14
    Publication statusPublished - Sep 2014

    Fingerprint

    educational program
    evaluation
    education
    way to school
    aim of education
    goal of education
    annual report
    educational activities
    social benefits
    performance
    social capital
    jurisdiction
    stakeholder
    costs
    school
    economics

    Cite this

    @article{2d1a43da9bfc4fcaaa0e5275657a1521,
    title = "Measuring the unmeasured in educational programs: filling in the blanks through evaluation",
    abstract = "The indicators of performance put forward as measures of achievement at a state and territory level in Australia reflect to some extent the priorities of those jurisdictions. These are revealed in the annual reports of departments, usually under headings of targets and corresponding outcomes. It may seem reasonable to assume that these performance measures line up with stated objectives, and with what matters on the ground. But do they? This paper argues that while the aims of education are broad, the measures of education are narrow. Philosophically, a good education is one that has social, developmental, intellectual and economic aims. However, even though some of those broad aims are reflected in national, state and territory foundational documents and reports, they are not reflected in Australian measurement or reporting frameworks, which seem to suggest that it is neither practical nor cost-effective to collect such data. The purpose of this paper is to demonstrate that it is possible to measure educational success in ways that support the broader goals of education and schooling in Australia. To this end, the paper draws on two evaluation case studies in the field of education (run within schools), to highlight ways that the unmeasured aspects of educational activity can be measured. One case highlights the significance of social capital in a school-family partnership program, and the other demonstrates the psycho-social benefits of an alternative education program for ‘at risk’ children. These cases illustrate what can be measured and they provide useful data to fill in the blanks of what is not measured at a system level. However, the cases also raise bigger questions about what should be measured and reported as indicators of what matters to educational stakeholders.",
    author = "John Guenther",
    year = "2014",
    month = "9",
    language = "English",
    volume = "14",
    pages = "204--222",
    journal = "Learning Communities: International Journal of Learning in Social contexts",
    issn = "1329-1440",
    publisher = "Centre for Research and Learning in Regional Australia",

    }

    Measuring the unmeasured in educational programs : filling in the blanks through evaluation. / Guenther, John.

    In: Learning Communities: International Journal of Learning in Social contexts, Vol. 14, 09.2014, p. 204-222.

    Research output: Contribution to journalArticleResearchpeer-review

    TY - JOUR

    T1 - Measuring the unmeasured in educational programs

    T2 - filling in the blanks through evaluation

    AU - Guenther, John

    PY - 2014/9

    Y1 - 2014/9

    N2 - The indicators of performance put forward as measures of achievement at a state and territory level in Australia reflect to some extent the priorities of those jurisdictions. These are revealed in the annual reports of departments, usually under headings of targets and corresponding outcomes. It may seem reasonable to assume that these performance measures line up with stated objectives, and with what matters on the ground. But do they? This paper argues that while the aims of education are broad, the measures of education are narrow. Philosophically, a good education is one that has social, developmental, intellectual and economic aims. However, even though some of those broad aims are reflected in national, state and territory foundational documents and reports, they are not reflected in Australian measurement or reporting frameworks, which seem to suggest that it is neither practical nor cost-effective to collect such data. The purpose of this paper is to demonstrate that it is possible to measure educational success in ways that support the broader goals of education and schooling in Australia. To this end, the paper draws on two evaluation case studies in the field of education (run within schools), to highlight ways that the unmeasured aspects of educational activity can be measured. One case highlights the significance of social capital in a school-family partnership program, and the other demonstrates the psycho-social benefits of an alternative education program for ‘at risk’ children. These cases illustrate what can be measured and they provide useful data to fill in the blanks of what is not measured at a system level. However, the cases also raise bigger questions about what should be measured and reported as indicators of what matters to educational stakeholders.

    AB - The indicators of performance put forward as measures of achievement at a state and territory level in Australia reflect to some extent the priorities of those jurisdictions. These are revealed in the annual reports of departments, usually under headings of targets and corresponding outcomes. It may seem reasonable to assume that these performance measures line up with stated objectives, and with what matters on the ground. But do they? This paper argues that while the aims of education are broad, the measures of education are narrow. Philosophically, a good education is one that has social, developmental, intellectual and economic aims. However, even though some of those broad aims are reflected in national, state and territory foundational documents and reports, they are not reflected in Australian measurement or reporting frameworks, which seem to suggest that it is neither practical nor cost-effective to collect such data. The purpose of this paper is to demonstrate that it is possible to measure educational success in ways that support the broader goals of education and schooling in Australia. To this end, the paper draws on two evaluation case studies in the field of education (run within schools), to highlight ways that the unmeasured aspects of educational activity can be measured. One case highlights the significance of social capital in a school-family partnership program, and the other demonstrates the psycho-social benefits of an alternative education program for ‘at risk’ children. These cases illustrate what can be measured and they provide useful data to fill in the blanks of what is not measured at a system level. However, the cases also raise bigger questions about what should be measured and reported as indicators of what matters to educational stakeholders.

    M3 - Article

    VL - 14

    SP - 204

    EP - 222

    JO - Learning Communities: International Journal of Learning in Social contexts

    JF - Learning Communities: International Journal of Learning in Social contexts

    SN - 1329-1440

    ER -