Standardised Evaluation Analysis (StEvAn) model

A standardised method for evaluating outcomes

Vulnerable people typically use services across multiple service domains, meaning their data crosses multiple government agencies. There are many gaps in the evidence base in measuring the effectiveness of human services programs in NSW in achievement of targeted participant outcome changes. A measurement model is required that should be widely applicable, using a standardised, robust framework, designed to provide comparable, ongoing assessments of program outcomes.

The Standardised Evaluation Analysis (StEvAn) model was developed to support the implementation of an investment approach for human services in NSW. The model directs and prioritises whole-of-government funding to deliver evidence-based solutions that achieve meaningful and measurable outcomes for vulnerable people in NSW.

An investment approach to human services relies on a comparative assessment of the effectiveness of programs designed to deliver social and health outcomes, and to quantify the likely impact of policy settings. The first step in implementing the investment approach requires the measurement of outcomes that each in-scope program achieves.

The StEvAn model uses the Human Services Dataset linked asset to evaluate the impact of program participation by conducting outcome analysis in a standardised way. A series of statistical analyses determine and quantify any positive impacts that a program is delivering to its participants.

Achievements

The StEvAn model supports the investment approach for human services in NSW, which aims to focus efforts towards effective and efficient services, relying on data and evidence of program effectiveness and return-on-investment to drive decision-making to improve the outcomes of children and families in NSW.

Engagement

The following stakeholders contribute to the StEvAN model, each with a specific role:

• Multiple NSW Government agencies provide data for linkage and subject matter expertise on that data
• The Centre for Health Record Linkage (CHeReL) links data - the Human Services Dataset (HSDS). The HSDS contains de-identified administrative records from 12 NSW government agencies, including information on over 9 million people.
• Areas in charge of human services programs such as family preservation and restoration programs
• An External academic review team provides review on approach, methods and interpretation

Final products are intended to provide evidence to decision makers such as DCJ Policy & Commissioning and NSW Treasury

Department leading the project

NSW Government Actuary (NSW Department of Communities and Justice)