Refine search Expand filter

Reports

Published

Actions for Regional, rural and remote education

Regional, rural and remote education

Education
Management and administration
Project management
Service delivery

What this report is about

Students in rural and remote areas of NSW face greater challenges compared to their metropolitan peers.

This report examined how the NSW Department of Education (the department) is ensuring that rural and remote students have access to the same quality of early childhood, school education, and skills pathways as metropolitan students.

What we found

A decade since the previous (2013) strategy to address educational disadvantage, there remain considerable gaps in access and outcomes between rural and remote students and metropolitan students.

The Rural and Remote Education Strategy (2021–24) is unlikely to address these longstanding and known issues of educational disadvantage in rural and remote areas.

Key enabling factors such as resourcing a dedicated team, setting performance measures, and establishing suitable governance arrangements were not put in place to support effective implementation of the 2021 strategy.

The department has programs aimed at addressing remoteness challenges, but does not know if these initiatives improve access or outcomes.

The department does not monitor or report on student access or outcomes according to geographic location.

What we recommended

The Department of Education should:

  • develop a new strategy that addresses disadvantage in regional, rural and remote education
  • establish and report publicly on regional, rural and remote key performance indicators
  • improve data collection by using a standard remoteness classification
  • improve governance arrangements for regional, rural and remote education
  • review the resources provided for regional, rural and remote areas that recognises the additional costs
  • develop an approach that ensures all students can access best practice modes of delivery.

In February 2021, the department of Education (the department) released the ‘Rural and Remote Education Strategy (2021–2024)’. The strategy sets a vision that ‘every child in regional New South Wales has access to the same quality of education as their metropolitan peers’. It recognises that students in rural and remote areas of New South Wales face greater challenges compared to students in metropolitan locations. These challenges contribute to regional, rural and remote students underperforming on major educational indicators compared to their metropolitan peers.

In recent years, regional, rural and remote communities experienced a series of natural disasters as well as the COVID-19 pandemic. In response to the pandemic and subsequent school closures, the department introduced new initiatives aimed at minimising the disruption to children including online learning and small group tuition.

The department established a regional, rural and remote education policy unit in 2021 to support delivery of the strategy and its vision.

The objective of this audit was to assess the effectiveness of the department’s activities to ensure that regional, rural and remote students have access to the same quality of early childhood, school education, and skills pathways as their metropolitan peers.

In making this assessment, the audit examined whether:

  • The department developed and implemented a strategy that enables regional, rural and remote students to access the same quality of early childhood education, school education, and skills pathways as students in metropolitan New South Wales.
  • The department has been addressing the complexities and needs of regional, rural and remote early childhood education, school education, and skills pathways.
Conclusion

The department's rural and remote education strategy is unlikely to achieve its vision that every child in regional New South Wales has access to the same quality of education as their metropolitan peers. Shortcomings in the design and implementation of the strategy have meant there is little to report on its impact after more than two years since its release.

The department did not take on board lessons learned from the previous strategy. The department did not provide additional resources to meet the strategy aims, establish strong central coordination, set timeframes, set measures of success, or identify new programs to address gaps in regional and remote access and outcomes. Instead, the department relied on matching existing programs and activities across its business areas to meet the stated actions and goals of the strategy.

There was not enough work put in to plan for successful implementation. A changeover in staff responsible for coordinating implementation of the strategy and lack of fit-for-purpose governance arrangements slowed its momentum. The department took one year to recruit a central team and almost two years to set up governance that gives relevant department executives oversight of the strategy. This was not fast enough to support a four-year strategy with an ambitious vision.

The department did not establish a program logic model, set baseline measures or develop an evaluation plan to assess the impact of the strategy. Consequently, it has not adequately monitored changes in access or outcomes for regional, rural and remote students. Two years after its release, there has not been any public reporting against the actions or outcomes of the strategy.

The department is not addressing the complexities of delivering regional, rural and remote early childhood, school education and skills pathways. There are a range of programs targeted to overcoming challenges of remoteness, but the department does not monitor data to determine whether these programs are sufficient to close the persistent gaps in access and outcomes for regional, rural and remote students.

A decade after the Rural and Remote Education Blueprint was launched in 2013, there remain considerable gaps in access and outcomes between metropolitan and regional, rural and remote areas. The department identifies 'equity' as a key value in its strategic plan but does not monitor or report on performance against key indicators according to geographic location. Data produced in response to our requests for this report demonstrate that previously identified gaps in access and outcomes remain.

Different areas of the department recognise the challenges of delivering services in regional, rural and remote locations and have developed specific programs or approaches aimed at addressing these challenges. The department does not know whether these interventions are sufficient to close the gaps in access or outcomes. Schools we spoke with as part of the audit reported significant ongoing challenges with attracting and retaining staff, providing a full curriculum and accessing support services when needed. 

This chapter examines the process to develop the Rural and Remote Education Strategy (2021–2024). It considers whether there was a comprehensive program of stakeholder consultation, whether relevant research and evidence was incorporated and whether an effective performance monitoring system was established.

The department made genuine efforts to consult with stakeholders on the new strategy

The department had a clear process to engage and obtain feedback from key stakeholders during the development of the new strategy. It developed a range of documents to support the consultation process including a stakeholder engagement plan, communications plan, and presentation. The department used the International Association for Public Participation (IAP2) Spectrum of Public Participation principles to help ensure that relevant stakeholders were included in the planning and decision-making process.

In late 2019, the department began its first phase of consultations with internal and external stakeholders to get their views on rural and remote education. It consulted internally with department directors, advisory groups, and learning communities, and externally with government agencies, service providers, non-government schools, and universities.

In March 2020, the department developed a stakeholder engagement paper to test the key issues from stakeholder consultations. Four focus areas were identified and included in a consultation paper that went out to key stakeholders for the second round of consultations in May 2020.

In the third consultation phase, the department conducted a workshop with stakeholders to review the earlier feedback, prioritise issues, identify gaps, and provide further input.

This consultation process enabled the department to identify issues and challenges to inform the new strategy. However, it was already aware that the blueprint was having limited success, and had already identified potential focus areas, following the evaluation of the blueprint in 2019.

The department did not consider recent research when developing the new strategy

The department's guidance materials promote the importance of considering research during policymaking. The guidelines describe the need to understand a topic, consult with stakeholders, identify gaps in existing knowledge, and ensure future work is informed by current literature.

In 2013, the department published a literature review on rural and remote education to inform the blueprint. The literature review found that students in rural and remote schools were not performing as well as their metropolitan peers, and that this performance gap was widening. The review attributed this to the higher number of children from low socio-economic backgrounds attending rural and remote schools. The review also identified several other factors that could negatively impact performance outcomes for rural and remote students. The department used the findings of the literature review to develop the key focus areas in the 2013 blueprint.

When the department began developing the new rural and remote education strategy in 2019, it recognised the need to review the literature on recent international initiatives. However, it has not yet released this review. This means that the department could have missed important new developments since it last examined the literature in 2013. Incorporating up-to-date research is important where past strategies have not met all their intended outcomes.

A national review into rural and remote education in 2018 examined Australian and international literature to inform its findings. The review made 11 recommendations to the Australian and state governments. While the NSW Government was not required to formally respond to the review, it could have considered the work done by that review when developing the new strategy. Several review recommendations are addressed in the strategy, while several others are only partly addressed. Gaps between review recommendations and specific strategy actions include improving the availability of quality accommodation, substantially reducing the waiting times for specialist assessments of students with learning difficulties and disabilities and increasing access to high quality distance education.

In 2019, the department commissioned a rural and remote project to contribute a research and evidence base to the new strategy. The main aim of the project was to help the department understand how it could better support rural and remote schools to increase educational outcomes. There was not enough time for this review to be completed prior to the release of the strategy. As of June 2023, the research project had not yet been released.

The strategy did not address all findings and recommendations from a recent evaluation

In 2020, the department's Centre for Education Statistics and Evaluation (CESE) published an evaluation of the blueprint. The evaluation examined how the actions in the blueprint were implemented. It recommended that a new strategy be developed, and made recommendations for things that should be incorporated into the strategy.

The blueprint aimed to ensure students in rural and remote areas could access the same quality of education as their metropolitan peers. The blueprint identified four focus areas to meet that aim:

  • quality early childhood education
  • great teachers and school leaders
  • curriculum access for all
  • effective partnerships and connections.

The department developed several initiatives to help meet the objectives of each of the four focus areas. These initiatives are described in Exhibit 5 below.

Exhibit 5: Key initiatives in the Rural and Remote Education Blueprint (2013)
Key focus area Initiative
Quality early childhood education
  • Funding model to help vulnerable and disadvantaged children access preschool.
Great teachers and school leaders
  • Rental subsidy to help attract and retain teachers.
Curriculum access for all
  • Virtual school to provide a varied curriculum for high potential and gifted students.
Effective partnerships and connections
  • Education networks for teachers and school leaders to access expert advice to support student learning.
  • Networked specialist centres to bring together services to support student health and wellbeing.

Source: Department of Education, Rural and remote education: A blueprint for action 2013.

The evaluation found that initiatives in two of the four focus areas – Quality early childhood education and Curriculum access for all – had performed well. However, the evaluation found that initiatives in the other two focus areas – Great teachers and school leaders and Effective partnerships and connections – did not achieve intended outcomes.

On the whole, the evaluation found that the 'remoteness gap' between rural and remote students and metropolitan students had not reduced since the blueprint was introduced. It recommended that the department continue its focus on rural and remote education by developing a new evidence-based strategy that focused on student outcomes and clear measures of success.

Objectives and actions in the new strategy were similar to those in the blueprint

The 2021 strategy sets an overall vision that 'every child in regional New South Wales has access to the same quality of education as their metropolitan peers'. It also states that the department 'is committed to ensuring all rural and remote students have equitable access to educational opportunities'.

Exhibit 6: Comparison of objectives in the blueprint and the new strategy
Rural and Remote Education Blueprint (2013) Rural and Remote Education Strategy (2021–24)
Provide more children with access to quality early child education in the year before school. Ensure all students have access to quality preschool in the year before school.
Ensure rural and remote schools have greater capacity to attract and retain quality teachers and leaders. Increase supply of high-quality educators in rural and remote communities.
Build the capacity of teachers and leaders in rural and remote schools. Better develop rural and remote teachers to deliver quality learning opportunities.
Address wellbeing needs through effective partnerships and connections. Address wellbeing needs through connections with local communities.
Develop partnerships so that rural and remote students have access to quality pathways into further education, training, or employment. Build partnerships to increase student access to post-school opportunities.

Source: Audit Office summary of Department of Education information.

Four areas in the blueprint remained a focus in the new strategy – early childhood education, teacher recruitment and retention, curriculum, and student wellbeing support services. Each focus area identifies a goal, as well as the aims and actions that contribute to those goals.

While this shows the department identified that these areas required continued attention, most actions were to 'increase', 'expand' or 'improve' existing programs and resources. The new strategy did not propose any new ideas or solutions, despite the blueprint achieving limited success in improving outcomes for rural and remote students.

There were no baseline or target measures set to monitor progress of the new strategy

The blueprint evaluation recommended that the department develop a new evidence-based strategy which focused on improving student outcomes. It also recommended the department use a program logic methodology to ensure there was a clear definition of success, adequate measures of success, and continual monitoring to ensure success.

Program logic models are a visual representation of the various components of a program. They can be used to illustrate program priorities, inputs, activities, outputs, outcomes, and assumptions. Logic models are used to explain how a proposed solution will address a specific problem. They are important because they can help test assumptions, build business cases, and identify potential enablers or barriers that could impact the project.

The department did not complete a program logic model during development of the new strategy, nor did it define measures to monitor whether the strategy's overall vision for quality education or the commitment to equitable access was on track to be achieved.

The department has not comprehensively monitored changes in educational outcomes in regional, rural and remote areas since the evaluation of the blueprint in 2020. This evaluation had seven indicators of educational outcomes by remoteness. The measures used in the evaluation could have provided a starting point given the similarity in focus areas between the blueprint and the new strategy. Not addressing past review recommendations increases risks that issues will be repeated.

The policy unit advised it has plans to set up a dashboard to monitor performance across the department's business plan measures by remoteness. This is intended to identify areas where system-wide improvements are required. This is not a comprehensive account of the strategy outcomes because the business plan measures don't capture all the goals of the strategy.

There were no timeframes or resources identified for implementing new strategy actions

The strategy has an overall timeframe of 2021–2024 but does not clarify when it expects the vision, goals, or aims to be achieved, or actions to be implemented.

The department's guidance on policymaking sets out how projects should be transitioned between the policy and implementation teams. This guidance is intended to help ensure the policy intent and scope of the project are not lost during the delivery of the project. The guidance highlights that the policy team should establish clear project implementation timeframes. It is important to have clear timeframes because it enables teams to measure progress, manage resources, and prioritise actions to ensure project outcomes are achieved.

The strategy states that there is a further $1 billion of investment planned over the next three years for rural and remote education but does not identify how this is allocated across its focus areas. It is important to identify the resources required to support the implementation of a program so that program objectives are met in a timely and cost-effective manner. The previous blueprint identified much lower funding of $80 million but more clearly showed how it would be allocated for identified actions across the four focus areas.

In response to our requests, the department separately identified $1.286 billion in expenditure for regional, rural and remote schools referenced in the strategy. Most of this expenditure related to existing department programs and activities rather than new initiatives. The total amount included:

  • $576.9 million for new and upgraded schools
  • $365.8 million for upgraded information technology equipment and resources
  • $120 million for school facility upgrades to be co-funded by schools
  • $60 million to replace school roofs
  • $60 million for the COVID Intensive Learning Support Program
  • $32 million for the Early Action for Success program
  • $29.7 million for staffing incentives
  • $21.7 million for literacy and numeracy interventions
  • $18.8 million in school location allowances
  • $1.45 million for the Rural Learning Exchange Pilot
  • $0.4 million for Rural and Remote Network initiatives.

This chapter examines the arrangements in place to implement the strategy. It considers whether effective governance arrangements are in place and how progress is monitored and reported.

This chapter considers the effectiveness of arrangements to ensure regional, rural and remote students have access to quality early childhood education, school education, and post‑school transitions.

This chapter considers the department's arrangements to monitor educational and wellbeing outcomes of students by remoteness. It reports on differences in outcomes between students in metropolitan areas and those in regional, rural and remote areas.

Those living in regional, rural and remote areas can have greater difficulty in accessing government services, often needing to travel long distances, or facing lower service levels than provided in major cities. This context is important when considering educational and wellbeing outcomes, given the disruptive effects of waiting or missing out on important services.

The rest of this chapter details key measures in the department's outcome and business plan.

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

 

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #385 - released 10 August 2023

Published

Actions for Student attendance

Student attendance

Education
Management and administration
Service delivery

What the report is about

Poor attendance at school is related to poor student outcomes, particularly once patterns of non-attendance have been established.

This report examined how the NSW Department of Education (the department) is managing student attendance in NSW government schools.

What we found

Around a third of students in Years 1–10 attended school less than 90% of the time in semester one, 2021. Missing more than 10% of school may put a student's educational outcomes at risk.

Since 2018, the department has improved the quality of student attendance data, analysis and reporting. However, there are still gaps in understanding the reasons for absence at a system level.

The department set state-wide and school-level targets to increase the proportion of students attending school at least 90% of the time. This emphasis risks diverting attention away from students with very low attendance rates.

There are gaps in central programs to support schools in lifting student attendance. Schools are taking a variety of approaches to this work.

There is a large gap in attendance between Aboriginal and non-Aboriginal students, which has increased since 2018.

What we recommended

The Department of Education should:

  • set new state-wide and school level attendance targets
  • evaluate its attendance support programs
  • update its attendance strategies and programs
  • publish the attendance level for each school in their annual reports
  • improve internal analysis and reporting of attendance data
  • finalise the review of the attendance policy, procedure and codes
  • review programs supporting Aboriginal student attendance and address any gaps
  • review the approach to enforcing compulsory school attendance.

Fast facts

  • 90% - attending school less than 90% of the time can put a student's educational outcomes at risk
  • 67.9% of Year 1–10 students in NSW government schools attended at least 90% of the time in semester one, 2021
  • 42.7% of Aboriginal Year 1–10 students in NSW government schools attended school at least 90% of the time in semester one, 2021.

Regular attendance at school is important for academic and other long-term outcomes. Students who do not attend regularly are less likely to complete school and more likely to experience poorer long-term health and social outcomes. A range of factors influence student attendance including student engagement and wellbeing, family and community factors and the school environment.

The NSW Department of Education's (the department's) Strategic Plan for 2018–2022 identifies improving student attendance as a priority. It has identified 95% as its expected level of attendance. It set targets to increase the proportion of students attending school at least 90% of the time, from 79.4% to 82% in primary schools and 64.5% to 70% for secondary schools.

This report focuses on attendance data for semester one of 2018, 2019 and 2021. Unless otherwise noted, attendance data refers to Years 1–10 in alignment with national reporting conventions. Changes in recording systems and definitions mean attendance data prior to 2018 is not comparable. Attendance data for semester one of 2020 and 2022 was significantly affected by COVID-related disruptions, which prevented many students across the State from attending school. Data for semester one of 2021 is considered relatively less affected by COVID-related disruptions.

The Education Act 1990 (the Act) sets out the responsibilities of students, parents and the department for ensuring students receive compulsory schooling. The department has developed policies, procedures and guidance to assist schools in managing their responsibilities to promote regular attendance. In this report, we define 'regular' attendance as at least 90% of the time. This is equivalent to missing one day of school each fortnight or four weeks of school across a school year.

The objective of this audit was to assess whether student attendance is effectively managed in NSW government schools for students from kindergarten to Year 10. In making this assessment, the audit examined whether:

  • there are effective systems and policies for managing student attendance
  • the department effectively supports schools to manage student attendance
  • schools are effectively managing student attendance.

Conclusion

There are too many students in NSW Government schools who regularly miss school. In semester one of 2021, around a third of students in Years 1–10 attended school less than 90% of the time — a level that puts their educational outcomes at risk. Attendance problems are widespread. 775 of 2,200 schools in NSW had an average attendance rate below 90% in 2021. Aboriginal student attendance is significantly below non-Aboriginal students and there is no specific strategy to address this gap. The department needs to place greater attention on supporting schools to lift student attendance.

Good quality data on attendance patterns is critical to developing strategies to address the underlying reasons for absence. The quality of the department's data on student attendance has improved from 2018. This has allowed it to monitor attendance more closely throughout the year, rather than relying on a yearly collection. However, there are still gaps in capturing and analysing the reasons for absence.

The improved data collection allowed the department to begin reporting on the 'attendance level' for the first time in 2018. This measures the proportion of students attending more than 90% of the time. The department has set state-wide and school-level targets to improve the attendance level. The new targets have influenced the focus of strategies to lift attendance. There is now a greater focus on lifting students above the reportable benchmark of 90% rather than addressing more serious attendance concerns.

The School Success Model formalises the focus on achieving school-level targets. When introduced, the department stated that schools would receive targeted support as part of the rollout of the model. Targeted support for attendance was initially planned to be delivered in late 2021 but was delayed due to the impact of COVID. The two main attendance support programs do not cater to schools with fewer than 100 students and there are gaps in support due to two different methodologies being used to select schools.

The Home School Liaison Program is a longstanding program to support students with low attendance. Requests for support are rationed pending availability of case officers, which leads to younger students being prioritised. Older students are not supported because there is a lower chance of prosecution in the legal system if attendance is not restored by the program. There is insufficient monitoring of the adequacy of resources, activities and long-term outcomes of this program.

The department's Aboriginal Education Policy aims to have Aboriginal students matching or exceeding outcomes of non-Aboriginal students. In semester one, 2021 42.7% of Aboriginal students attended school regularly (at least 90% of the time) compared with 70.3% of non-Aboriginal students. The gap in attendance between Aboriginal and non-Aboriginal students has grown since 2018. There are relatively new programs supporting Aboriginal students in secondary school to attain their Higher School Certificate, but greater attention should be placed on supporting attendance for Aboriginal students in primary schools.

Schools are using a wide range of strategies to improve student attendance depending on their local contexts. Schools we spoke with told us of allocating responsibility to key staff members, closer monitoring of data, community engagement, rewards and incentives, before school sporting and breakfast programs, and partnerships with external agencies. The school planning and annual reporting process prompts schools to evaluate the impact of their strategies on progress towards their targets. The department could do more to promote evidence-based programs, showcase better practice examples from schools in NSW and identify the circumstances where these approaches are most effective. 

This chapter considers the effectiveness of systems to accurately collect, analyse and report student attendance data. It also considers the effectiveness of policies and procedures to support attendance and central oversight of attendance issues.

This chapter considers the effectiveness of the department's strategies to improve student attendance and the support it provides to schools to achieve this. It also considers the effectiveness of school-level strategies and actions for students with low attendance.

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #368 - released 27 September 2022

Published

Actions for Audit Insights 2018-2022

Audit Insights 2018-2022

Community Services
Education
Environment
Finance
Health
Industry
Justice
Local Government
Premier and Cabinet
Planning
Transport
Treasury
Universities
Whole of Government
Asset valuation
Cross-agency collaboration
Compliance
Cyber security
Financial reporting
Fraud
Information technology
Infrastructure
Internal controls and governance
Management and administration
Procurement
Project management
Regulation
Risk
Service delivery
Shared services and collaboration
Workforce and capability

What the report is about

In this report, we have analysed the key findings and recommendations from our audit reports over the past four years.

This analysis includes financial audits, performance audits, and compliance audits of state and local government entities that were tabled in NSW Parliament between July 2018 and February 2022.

The report is framed by recognition that the past four years have seen significant challenges and emergency events.

The scale of government responses to these events has been wide-ranging, involving emergency response coordination, service delivery, governance and policy.

The report is a resource to support public sector agencies and local government to improve future programs and activities.

What we found

Our analysis of findings and recommendations is structured around six key themes:

  • Integrity and transparency
  • Performance and monitoring
  • Governance and oversight
  • Cyber security and data
  • System planning for disruption
  • Resource management.

The report draws from this analysis to present recommendations for elements of good practice that government agencies should consider in relation to these themes. It also includes relevant examples from recent audit reports.

In this report we particularly call out threats to the integrity of government systems, processes and governance arrangements.

The report highlights the need for balanced advice to government on options and risks, for transparent documentation and reporting of directions and decisions, and for early and open sharing of information with integrity bodies and audit.

A number of the matters highlighted in this report are similar to those described in our previous Insights Report, (Performance Audit Insights: key findings from 2014–2018) specifically in relation to cyber and information security, to performance measurement, reporting and evaluation, and system and workforce planning and capability.

Fast facts

  • 72 audits included in the Audit Insights 2018–2022 analysis
  • 4 years of audits tabled by the Auditor-General for New South Wales
  • 6 key themes for Audit Insights 2018–2022.

picture of Margaret Crawford Auditor-General for New South Wales in black dress with city skyline as backgroundI am pleased to present the Audit Insights 2018–2022 report. This report describes key findings, trends and lessons learned from the last four years of audit. It seeks to inform the New South Wales Parliament of key risks identified and to provide insights and suggestions to the agencies we audit to improve performance across the public sector.

The report is framed by a very clear recognition that governments have been responding to significant events, in number, character and scale, over recent years. Further, it acknowledges that public servants at both state and council levels generally bring their best selves to work and diligently strive to deliver great outcomes for citizens and communities. The role of audit in this context is to provide necessary assurance over government spending, programs and services, and make suggestions for continuous improvement.

A number of the matters highlighted in this report are similar to those described in our previous Insights Report, (Performance Audit Insights: key findings from 2014–2018) specifically in relation to cyber and information security, to performance measurement, reporting and evaluation, and system and workforce planning and capability.

However, in this report we particularly call out threats to the integrity of government systems, processes and governance arrangements. We highlight the need for balanced advice to government on options and risks, for transparent documentation and reporting of directions and decisions, and for early and open sharing of information with integrity bodies and audit. Arguably, these considerations are never more important than in an increasingly complex environment and in the face of significant emergency events and they will be key areas of focus in our future audit program.

While we have acknowledged the challenges of the last few years have required rapid responses to address the short-term impacts of emergency events, there is much to be learned to improve future programs. I trust that the insights developed in this report provide a helpful resource to public sector agencies and local government across New South Wales. I would be pleased to receive any feedback you may wish to offer.

Margaret Crawford
Auditor-General for New South Wales

Integrity and transparency Performance and monitoring Governance and oversight Cyber security and data System planning Resource management
Insufficient documentation of decisions reduces the ability to identify, or rule out, misconduct or corruption. Failure to apply lessons learned risks mistakes being repeated and undermines future decisions on the use of public funds. The control environment should be risk-based and keep pace with changes in the quantum and diversity of agency work. Building effective cyber resilience requires leadership and committed executive management, along with dedicated resourcing to build improvements in cyber security and culture. Priorities to meet forecast demand should incorporate regular assessment of need and any emerging risks or trends. Absence of an overarching strategy to guide decision-making results in project-by-project decisions lacking coordination. Governments must weigh up the cost of reliance on consultants at the expense of internal capability, and actively manage contracts and conflicts of interest.
Government entities should report to the public at both system and project level for transparency and accountability. Government activities benefit from a clear statement of objectives and associated performance measures to support systematic monitoring and reporting on outcomes and impact. Management of risk should include mechanisms to escalate risks, and action plans to mitigate risks with effective controls. In implementing strategies to mitigate cyber risk, agencies must set target cyber maturity levels, and document their acceptance of cyber risks consistent with their risk appetite. Service planning should establish future service offerings and service levels relative to current capacity, address risks to avoid or mitigate disruption of business and service delivery, and coordinate across other relevant plans and stakeholders. Negotiations on outsourced services and major transactions must maintain focus on integrity and seeking value for public funds.
Entities must provide balanced advice to decision-makers on the benefits and risks of investments. Benefits realisation should identify responsibility for benefits management, set baselines and targets for benefits, review during delivery, and evaluate costs and benefits post-delivery. Active review of policies and procedures in line with current business activities supports more effective risk management. Governments hold repositories of valuable data and data capabilities that should be leveraged and shared across government and non-government entities to improve strategic planning and forecasting. Formal structures and systems to facilitate coordination between agencies is critical to more efficient allocation of resources and to facilitate a timely response to unexpected events. Transformation programs can be improved by resourcing a program management office.
Clear guidelines and transparency of decisions are critical in distributing grant funding. Quality assurance should underpin key inputs that support performance monitoring and accounting judgements. Governance arrangements can enable input into key decisions from both government and non-government partners, and those with direct experience of complex issues.     Workforce planning should consider service continuity and ensure that specialist and targeted roles can be resourced and allocated to meet community need.
Governments must ensure timely and complete provision of information to support governance, integrity and audit processes.          
Read more Read more Read more Read more Read more Read more

 

This report brings together a summary of key findings arising from NSW Audit Office reports tabled in the New South Wales Parliament between July 2018 and February 2022. This includes analysis of financial audits, performance audits, and compliance audits tabled over this period.

  • Financial audits provide an independent opinion on the financial statements of NSW Government entities, universities and councils and identify whether they comply with accounting standards, relevant laws, regulations, and government directions.
  • Performance audits determine whether government entities carry out their activities effectively, are doing so economically and efficiently, and in accordance with relevant laws. The activities examined by a performance audit may include a selected program or service, all or part of an entity, or more than one government entity. Performance audits can consider issues which affect the whole state and/or the local government sectors.
  • Compliance audits and other assurance reviews are audits that assess whether specific legislation, directions, and regulations have been adhered to.

This report follows our earlier edition titled 'Performance Audit Insights: key findings from 2014–2018'. That report sought to highlight issues and themes emerging from performance audit findings, and to share lessons common across government. In this report, we have analysed the key findings and recommendations from our reports over the past four years. The full list of reports is included in Appendix 1. The analysis included findings and recommendations from 58 performance audits, as well as selected financial and compliance reports tabled between July 2018 and February 2022. The number of recommendations and key findings made across different areas of activity and the top issues are summarised at Exhibit 1.

The past four years have seen unprecedented challenges and several emergency events, and the scale of government responses to these events has been wide-ranging involving emergency response coordination, service delivery, governance and policy. While these emergencies are having a significant impact today, they are also likely to continue to have an impact into the future. There is much to learn from the response to those events that will help the government sector to prepare for and respond to future disruption. The following chapters bring together our recommendations for core elements of good practice across a number of areas of government activity, along with relevant examples from recent audit reports.

This 'Audit Insights 2018–2022' report does not make comparative analysis of trends in public sector performance since our 2018 Insights report, but instead highlights areas where government continues to face challenges, as well as new issues that our audits have identified since our 2018 report. We will continue to use the findings of our Insights analysis to shape our future audit priorities, in line with our purpose to help Parliament hold government accountable for its use of public resources in New South Wales.

Appendix one – Included reports, 2018–2022

Appendix two – About this report

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for COVID-19: response, recovery and impact

COVID-19: response, recovery and impact

Community Services
Education
Health
Justice
Premier and Cabinet
Transport
Treasury
Whole of Government
Cross-agency collaboration
Financial reporting
Management and administration
Service delivery
Shared services and collaboration

What the report is about

This report draws together the financial impact of COVID-19 on the agencies integral to responses across the state government sector of New South Wales.

What we found

Since the COVID-19 pandemic hit NSW in January 2020, and until 30 June 2021, $7.5 billion was spent by state government agencies for health and economic stimulus. The response was largely funded by borrowings.

The key areas of spending since the start of COVID-19 in NSW to 30 June 2021 were:

  • direct health response measures – $2.2 billion
  • personal protective equipment – $1.4 billion
  • small business grants – $795 million
  • quarantine costs – $613 million
  • increases in employee expenses and cleaning costs across most agencies
  • vaccine distribution, including vaccination hubs – $71 million.

The COVID-19 pandemic significantly impacted the financial performance and position of state government agencies.

Decreases in revenue from providing goods and services were offset by increases in appropriations, grants and contributions, for health and economic stimulus funding in response to the pandemic.

Most agencies had expense growth, due to additional operating requirements to manage and respond to the pandemic along with implementing new or expanded stimulus programs and initiatives.

Response measures for COVID-19 have meant the NSW Government is unlikely to meet targets in the Fiscal Responsibility Act 2012 being:

  • annual expense growth kept below long-term average revenue growth
  • elimination of State’s unfunded superannuation liability by 2030.

 Fast facts

  • First COVID-19 case in NSW on 25 January 2020
  • COVID-19 vaccinations commenced on 21 February 2021
  • By 31 December 2021, 25.2 million PCR tests had been performed in NSW and 13.6 million vaccines administered, with 93.6% of the 16 and over population receiving two doses
  • During 2020–21, NSW Health employed an extra 4,893 full-time staff and incurred $28 million in overtime mainly in response to COVID-19
  • During 2020–21, $1.2 billion was spent on direct health COVID-19 response measures and $532 million was spent on quarantine for incoming international travellers

Section highlights

  • Up to 30 June 2021, $7.5 billion has been spent by state government agencies for health and economic stimulus.
  • Revenue increased for most agencies as falling revenue from providing goods and services was offset by additional funding from appropriations, grants and contributions.
  • Expenses increased as most agencies incurred additional costs to manage and respond to the pandemic along with delivering stimulus and support programs.
  • Borrowings of $7.5 billion over the last two years helped to fund the response to COVID-19.

Section highlights

  • NSW Government unlikely to meet targets in Fiscal Responsibility Act 2012.

Published

Actions for COVID Intensive Learning Support Program

COVID Intensive Learning Support Program

Education
Management and administration
Project management
Service delivery
Workforce and capability

What the report is about

This audit examined a state-wide program to provide small-group tuition to students disadvantaged by the move to learning from home during 2020.

The audit assessed the design and implementation of the program.

What we found

The program design was based on research and data showing learning loss during 2020. 

The department rapidly planned and developed the policy design and guidelines for schools. 

Governance arrangements matured during program delivery.

The department changed the models for funding schools but did not clearly explain the reasons for doing so.

Government schools with over 900 students were disadvantaged by the funding model compared to smaller schools. 

Guidelines, resources and professional learning helped schools implement the program.

Staff eligibility for the program was expanded after reported difficulties in recruiting qualified teachers in some areas. 

Online tuition and third-party provider options were developed throughout the program.

There were issues with the quality and timeliness of data used to monitor school progress. 

Evaluation arrangements were developed early in the program.

Data limitations mean the evaluation will not be able to fully assess all program objectives.

What we recommended

  1. Distributing funds between schools more equitably and improving communication of the funding methods. 
  2. Clearer communication about the intended targeted group of students.
  3. Reviewing the time needed to administer the program.
  4. Improve support for educators other than qualified teachers.
  5. Offer the online tuition program to more schools.
  6. Analysis of the effects of learning from home during 2021 across equity groups and geographic areas.
  7. Working with universities to increase use of pre-service teachers in the program.

The report also identifies lessons learned for future programs.
 

Fast facts

  • $337m in total program funding. $289 million for government schools and $31 million for non government schools
  • 12 days to develop the policy and provide costings to Treasury 
  • 290,000 targeted students in government schools and 31,000 in non government schools
  • 80% of schools were providing small group tuition by the target start date of Week 6, Term 1
  • 2–4 months was the estimated student learning loss from the move to learning from home during 2020
  • 7,600 tutors engaged in the program as at September 2021.

The NSW Government announced the COVID Intensive Learning Support Program on 10 November 2020, as part of the 2020–21 NSW Budget. The primary goal of the $337 million program was to deliver intensive small group tuition for students who were disadvantaged by the move to remote and/or flexible learning, helping to close the equity gap. It included:

  • $306 million to provide small-group tuition for eligible students across every NSW Government primary, secondary and special purpose school
  • $31.0 million for around 400 non-government schools to provide small-group tuition to students with the greatest levels of need.

The objective of this audit was to assess the effectiveness of the design and implementation of the COVID Intensive Learning Support Program (the program). To address this objective, the audit assessed whether the Department of Education (the department):

  • effectively designed the program and supporting governance arrangements
  • is effectively implementing the program.

This audit focuses on activities between October 2020 and August 2021, which aimed to address the first session of learning from home in New South Wales. From August to October 2021, students in many areas of New South Wales were learning from home again, but this second period has not been a focus of this audit. On 18 October 2021, the NSW Government announced the program would be extended into 2022.

Conclusion

The COVID Intensive Learning Support Program was effectively designed to help students catch up on learning loss due to the interruptions to schooling caused by COVID-19. The department rapidly stood up a taskforce to implement the program and then developed supporting governance arrangements during implementation.

Most students in New South Wales were required to learn from home for at least seven weeks during 2020 due to the impact of the Novel-Coronavirus (COVID-19). The department researched, analysed and advised government on several options to address the learning loss that resulted. It recommended small group tuition as the preferred option as it was supported by available evidence and could be rolled out at scale with speed. It identified risks of ensuring an adequate supply of educators and options to address those risks. Consistent with its analysis of where the impact of the learning loss was most severe, the department proposed to direct funding to schools with higher concentrations of students from the most disadvantaged backgrounds.

The department established a cross-functional taskforce to conduct detailed planning and support program implementation. Short timeframes meant the taskforce initially sought approval for key decisions from the program sponsor and existing oversight bodies on an as-needed basis before dedicated program governance arrangements were formalised. Once established, the governance body met regularly to oversee program delivery.

The COVID Intensive Learning Support Program is being effectively implemented. The department has refined the program during rollout to respond to risks, issues and feedback from schools. Issues with how schools enter data into department systems have affected the timeliness and accuracy of program monitoring information.

The department provided schools with guidelines, example models of delivery, systems to record student progress and professional learning. Around 80 per cent of schools had begun delivering tuition under the program by the target date. Schools reported issues with sourcing qualified teachers as a key reason they were unable to start the program by the expected date. In response, the department expanded the type of staff schools could employ, developed an online tuition program, and allowed schools to engage third-party providers to help schools that had difficulty finding qualified teachers for the program.

The department used existing systems to monitor school progress in implementing the program. This reduced the administrative burden on schools, but there were several issues with data quality and timeliness. The program included a mid-year review point to check whether schools were on track to spend their funding. This helped focus schools on ensuring funding would be spent and allowed for redistribution between schools.

The department considered program evaluation early in policy design and planning. It embedded an evaluator on the taskforce and expanded a key assessment program to help provide evidence of impact. A process and outcome evaluation is underway which will help inform future delivery. The evaluation will examine educational impacts for students participating in the program but it has not established methods to reliably assess the extent to which the program has met a goal to help 'close the equity gap' for students.

This chapter considers how effectively the COVID Intensive Learning Support Program (the program) was designed and planned for implementation.

This chapter considers how effectively the COVID Intensive Learning Support Program was implemented over our period of review (Terms 1 and 2, 2021).

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #358 - released (15 December 2021).

Published

Actions for Local Schools, Local Decisions: needs-based equity funding

Local Schools, Local Decisions: needs-based equity funding

Education
Internal controls and governance
Management and administration
Service delivery

The Auditor-General for New South Wales, Margaret Crawford, released a report today examining the Department of Education’s (the department’s) support and oversight of school planning and use of needs-based funding under the Local Schools, Local Decisions reform.

The report found the department has not had adequate oversight of how schools are using needs-based funding to improve student outcomes since it was introduced in 2014.

The department had not set measures or targets for needs-based equity funding. It had also not been clear enough in how it expected schools to report on the outcomes of additional funding. This means it has not been able to effectively demonstrate the impact of funding at a school, or state-wide level.

To assist with the transition to greater local decision-making, the department provided schools with guidance materials, additional resources and systems support. However, guidance material was not clear enough on the purpose of funding, school budgeting systems were not fit-for-purpose when initially introduced, and support for schools was spread across different areas of the department.

The department has recently increased executive oversight of progress to improve educational outcomes for Aboriginal students and students from a low socio-economic background. It has also developed a consistent set of school-level targets to be implemented from 2020. This may help the department more reliably monitor progress in lifting outcomes for students with additional learning needs.

The report makes eight recommendations aimed at clarifying requirements of schools, better coordinating support and strengthening oversight of the use of needs-based equity funding.

Read full report (PDF)

The Local Schools, Local Decisions reform was launched in 2012 to give public schools more authority to make local decisions about how best to meet the needs of their students. A major element of the reform was the introduction of a new needs-based school funding model. Core elements of the model address staffing and operational requirements, while needs-based elements reflect the characteristics of schools and students within them. This includes equity funding designed to support students with additional needs. The four categories of equity funding are:

  • socio-economic background
  • Aboriginal background
  • English language proficiency
  • low-level adjustment for disability. 

Around $900 million in equity funding was allocated in 2019. School principals decide how to use these funds and account for them through their school annual reports. The Department of Education (the department) supports schools in making these choices with tools and systems, guidelines, and good practice examples.

The objective of this audit was to assess the department's support and oversight of school planning and use of needs-based funding under the Local Schools, Local Decisions reform. To address this objective, the audit examined whether:

  • effective accountability arrangements have been established
  • effective support is provided to schools.  

Conclusion

The department has not had adequate oversight of how schools are using needs-based equity funding to improve student outcomes since it was introduced in 2014. While it provides guidance and resources, it has not set measures or targets to describe the outcomes expected of this funding, or explicit requirements for schools to report outcomes from how these funds were used. Consequently, there is no effective mechanism to capture the impact of funding at a school, or state-wide level. The department has recently developed a consistent set of school-level targets to be implemented from 2020. This may help it to better hold schools accountable for progress towards its strategic goal of reducing the impact of disadvantage.

A significant amount of extra funding has been provided to schools over recent years in recognition of the additional learning needs of certain groups of students facing disadvantage. Under the Local Schools, Local Decisions reform, schools were given the ability to make decisions about how best to use the equity funding in combination with their overall school resources to meet their students’ needs. However, multiple guidelines provided to schools contain inconsistent advice on how the community should be consulted, how funding could be used, and how impact should be reported. Because of this, it is not clear how schools have used equity funding for the benefit of identified groups. School annual reports we reviewed did not fully account for the equity funding received, nor adequately describe the impact of funding on student outcomes.

To help in the transition to greater local decision-making, the department provided extra support by; establishing peer support for new principals, increasing the number of directors, developing data analysis and financial planning systems, targeted training and showcasing good practice. Multiple roles and areas of the department provide advice to schools in similar areas and this support could be better co-ordinated.

Financial planning systems designed to help schools budget for equity and other funding sources were not fit-for-purpose when originally introduced. Schools reported a lack of trust in their budget figures and so were not fully spending their allocated funding. Since then, the department developed and improved a budgeting tool in consultation with stakeholder and user groups. It provided extra funding for administrative support and one-to-one training to help schools develop their capabilities. Despite this, schools we spoke to reported they were not yet fully confident in using the system and needed ongoing training and support. 

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #331 - released 8 April 2020.

Published

Actions for Ensuring teaching quality in NSW public schools

Ensuring teaching quality in NSW public schools

Education
Management and administration
Regulation
Service delivery
Workforce and capability

The Auditor-General for New South Wales, Margaret Crawford, has released a report on how the New South Wales Education and Standards Authority (NESA) and the Department of Education (the Department) ensure teaching quality in NSW public schools.

Around 2,200 NSW public school principals are responsible for accrediting their teachers in line with the Australian Professional Standards for Teachers. The report found that NESA does not oversight principals’ decisions to ensure that minimum standards for teaching quality are consistently met.

The Department does not effectively monitor teaching quality across the state. With limited data, it is difficult for the Department to ensure its strategies to improve teaching quality are appropriately targeted to improve teaching quality.

The Department’s Performance and Development Framework does not adequately support principals and supervisors to effectively manage and improve teacher performance or actively improve teaching quality. The Department manages those teachers formally identified as underperforming through teacher improvement programs. Only 53 of over 66,000 teachers employed by the Department were involved in these programs in 2018.

The report makes three recommendations towards NESA to improve accreditation processes, and four recommendations to the Department to improve its systems and processes for ensuring teaching quality across the State.

Australian research has shown that quality teaching is the greatest in-school influence on student engagement and outcomes, accounting for 30 per cent of the variance in student performance. An international comparative study of 15-year-old students showed the performance of New South Wales students in reading, mathematics and science has declined between 2006 and 2015.

The Australian Professional Standards for Teachers (the Standards) describe the knowledge, skills and understanding expected of effective teachers at different career stages. Teachers must be accredited against the Standards to be employed in NSW schools. The NSW Education Standards Authority (NESA) is responsible for ensuring all teachers in NSW schools are accredited. As part of the accreditation process the NSW Department of Education (The Department) assesses whether public school teachers meet proficient accreditation standards and advises NESA of its decisions.

The School Excellence Framework provides a method for the Department to monitor teaching quality at a school level across four elements of effective teaching practice. The Performance and Development Framework provides a method for teachers and their supervisors to monitor and improve teaching quality through setting professional goals to guide their performance and development.

The Department has a strategic goal that every student, every teacher, every leader and every school improves every year. In line with this goal, the Department has a range of strategies targeted to improving teaching quality at different career stages. These include additional resources to support new teachers, a program to support teachers to gain higher-level accreditation, support for principals to manage underperforming teachers, and a professional learning program where teachers observe and discuss each other's practice.

The objective of this audit was to assess the effectiveness of the NSW Department of Education's and the NSW Education Standards Authority's arrangements to ensure teaching quality in NSW public schools. To address this objective, the audit examined whether:

  • agencies effectively monitor the quality of teaching in NSW public schools
  • strategies to improve the quality of teaching are planned, communicated, implemented and monitored well.
The NSW Education Standards Authority does not oversight principals’ decisions to accredit teachers as proficient. This means it is not ensuring minimum standards for teaching quality are consistently met.
NESA does not have a process to ensure principals’ decisions to accredit teachers are in line with the Standards. The decision to accredit teachers is one of the main ways to ensure teaching quality. In New South Wales public schools, around 2,200 principals are tasked with making decisions to accredit their teachers as proficient. NESA provides training and guidelines for principals to encourage consistent accreditation decisions but regular turnover of principals makes it difficult to ensure that all principals are adequately supported. NESA has more oversight of provisional and conditional accreditation for beginning teachers, as well as higher-level accreditation for highly effective teachers. That said, there are only limited numbers of teachers with higher-level accreditation across the state.
The Department of Education does not effectively monitor teaching quality at a system level. This makes it difficult to ensure strategies to improve teaching quality are appropriately targeted.
The Department is not collecting sufficient information to monitor teaching quality across the state. No information on teacher assessment against the Performance and Development Framework is collected centrally. Schools self-assess their performance against the School Excellence Framework but this does not assess teaching quality for all teachers. The Department also surveys students about their experiences of teaching quality but schools opt-in to this survey, with 65 per cent of public schools participating in 2018. These factors limit the ability of the Department to target efforts to areas of concern.
We examined five key strategies that support the critical parts of a teacher’s career. Most strategies were based on research and consultation, planned, trialled, reviewed and adjusted before wider rollout. Guidance and training is provided to communicate requirements and help schools implement strategies at a local level. Monitoring of strategies implemented at a local level is variable. We identified several instances where Quality Teaching, Successful Students funding was used outside guidelines. Two strategies have not yet been evaluated, which prevents the Department from determining whether they are having the desired impact.
The Performance and Development Framework is not structured in a way that supports principals and supervisors to actively improve teacher performance and teaching quality.
There is limited opportunity for supervisors to set goals, conduct observations of teaching practice, or provide constructive written feedback on a teacher’s progress towards achieving their goals under this framework. Guidance on how to use the Standards to construct quality goals, observe teaching practice and provide valuable feedback is also insufficient. The framework focuses on teachers’ self-identified development goals but there is no requirement to align these with the Standards. These limitations reduce the ability of supervisors to use this framework to effectively manage teacher performance and improve teaching quality.
The Department manages those teachers formally identified as underperforming through teacher improvement programs. Only 53 of over 66,000 teachers employed by the Department were involved in these programs in 2018. By comparison, a report on inspections conducted in the United Kingdom assessed the quality of teaching as ‘inadequate’ in three per cent of schools.

Appendix one – Response from agencies

Appendix two – About the audit

Appendix three – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary Reference: Report number #327 - released 26 September 2019

36

Published

Actions for Wellbeing of secondary school students

Wellbeing of secondary school students

Education
Management and administration
Service delivery
Shared services and collaboration
Workforce and capability

The Department of Education has a strong focus on supporting secondary school students’ wellbeing. However, it is difficult to assess how well the Department is progressing as it is yet to measure or report on the outcomes of this work at a whole-of-state level.

The Department of Education’s (the Department) purpose is to prepare young people for rewarding lives as engaged citizens in a complex and dynamic society. The Department commits to creating quality learning opportunities for children and young people, including a commitment to student wellbeing, which is seen as directly linked to positive learning outcomes. Wellbeing is defined broadly by the Department as “the quality of a person’s life…It is more than the absence of physical or psychological illness”. Student wellbeing can be supported by everything a school does to enhance a student's learning—from curriculum to teacher quality to targeted policies and programs to whole-school approaches to wellbeing.

Several reforms have aimed to support student wellbeing in recent years. 'Local Schools, Local Decisions' gave NSW schools more local authority to make decisions, including schools' approaches to support student wellbeing. In 2016, the 'Supported Students, Successful Students' initiative provided $167 million over four years to support the wellbeing of students. From 2018, the 'Every Student is Known, Valued and Cared For' initiative provides a principal led mentoring program, and a website with policies, procedures and resources to support student wellbeing.

This audit assessed how well the Department of Education supports secondary schools to promote and support the wellbeing of their students and how well secondary schools are promoting and supporting the wellbeing of their students.

Conclusion

The Department has implemented a range of programs and reforms aimed at supporting student wellbeing. However, the outcomes of this work have yet to be measured or reported on at a system level, making it difficult to assess the Department's progress in improving student wellbeing.

Secondary schools have generally adopted a structured approach to deliver wellbeing support and programs, using both Department and localised resources. The approaches have been tailored to meet the needs of their school community. That said, public reporting on wellbeing improvement measures via annual school reports is of variable quality and needs to improve.

The Department’s wellbeing initiatives are supported by research and consultation, but outcomes have not been reported on

The Department’s development of wellbeing policy, guidance, tools and resources has been transparent, consultative and well researched. It has drawn on international and domestic evidence to support its aim to deliver a fundamental shift from welfare to wellbeing at the school and system level.

However, the key performance indicator to monitor and track progress in wellbeing has yet to be reported on despite the strategic plan including this as a priority for the period 2018 to 2022. This includes not yet reporting a baseline for the target, nor how it will be measured.

The Department’s wellbeing resources are mostly well targeted but there is room for improvement

The Department’s allocation of resources to deliver wellbeing initiatives in schools is mostly well targeted, reflects a needs basis and supports current strategic directions. This could be improved with some changes to formula allocations and clearer definitions of the resourcing required for identified wellbeing positions in schools. The workforce modelling for forecasting supply and demand, specifically for school counsellors and psychologists, needs to separately identify these positions as they are currently subsumed in general teacher numbers.

Schools' reporting on wellbeing improvement measures is of variable quality and needs to improve

Schools we visited demonstrated a variety of approaches to wellbeing depending on their local circumstances and student populations. They make use of Department policies, guidelines, and resources, particularly mandatory policies and data collections, which have good compliance and take-up at school level. Professional learning supports specific wellbeing initiatives and online systems for monitoring and reporting have contributed to schools’ capacity and capabilities.

Schools report publicly on wellbeing improvement measures through annual school reports but this reporting is of variable quality. The Department plans to improve the capability of schools in data analysis and we recommend that this include the setting and evaluation of improvement targets for wellbeing.

The implementation of the 2015 Wellbeing Framework in schools is incomplete and the Department has not effectively prioritised and consolidated tools, systems and reporting for wellbeing

Schools' take up of the 2015 Wellbeing Framework is hindered by it not being linked to the school planning and reporting policy and tools—the School Excellence Framework. At some schools we visited, this disconnect has led to a lack of knowledge and confidence in using it in schools. The Department has identified the need to improve alignment of policies, frameworks and plans and has commenced work on this.

We found evidence of overburdening in schools for addressing student wellbeing—in the number of tools, online systems for information collection, and duplication in reporting. Following the significant reforms of recent years, the Department should consolidate its efforts by reinforcing existing effective programs and systems and addressing identified gaps and equity issues, rather than introducing further change for schools. In particular, methods and processes for complex case coordination need improvement.

The NSW Department of Education commits to creating quality learning opportunities for students. This includes strengthening students’ physical, social, emotional and spiritual development. The Department sets out to enable students to be healthy, happy, engaged and successful.

Welfare and wellbeing

The Department’s approach has significantly shifted from student welfare to wellbeing of the whole child and young person. Wellbeing is defined in departmental policy and strategy documents broadly, and as directly linked to learning and positive learning outcomes. “Wellbeing can be described as the quality of a person’s life…It is more than the absence of physical or psychological illness…Wellbeing, or the lack of it, can affect a student’s engagement and success in learning…”

Student wellbeing can be supported by everything a school does to enhance a student's learning—from curriculum to teacher quality to targeted policies and programs to whole-school approaches to wellbeing. Distinctions between wellbeing and welfare in the school context are outlined below.

Exhibit 1: Welfare and wellbeing
Welfare Wellbeing
Operates from a basis of student need and doesn't always take into account a whole child view. For all students.
Rather than building on the strengths of students, operates from a deficit model of individual student problems or negative behaviours. Goes beyond just welfare needs of a few students and aims for all students to be healthy, happy, successful and productive individuals who are active and positive contributors to the school and society in which they live.

Source: Department of Education 2018 'Wellbeing is here' presentation.

Published

Actions for Supply of secondary teachers in STEM-related disciplines

Supply of secondary teachers in STEM-related disciplines

Education
Management and administration
Service delivery
Workforce and capability

The NSW Department of Education’s plans and strategies to respond to the demand for secondary teachers in STEM-related disciplines are limited by incomplete data and underperforming scholarship and sponsorship program. The Department does not collect sufficient information to monitor what disciplines teachers actually teach nor does it predict supply and demand for teachers by discipline and location. This restricts the Department’s ability to track and forecast the supply and demand for secondary teachers in STEM-related disciplines.

In recent years, Australian and international education policy has focused on improving outcomes in Science, Technology, Engineering and Mathematics (STEM) subjects. However, research has identified a shortage of qualified secondary teachers in STEM-related disciplines 1. This is projected to worsen due to a combination of student population increases, an ageing workforce, and fewer people going into teaching. Shortfalls are likely to be more acute in rural and remote areas, and areas of low socio-economic status.

The Department of Education (the Department) has a variety of strategies to encourage teachers to practise in locations or disciplines of need. These include scholarships for tertiary students going into teaching, sponsorships for teachers seeking approval to teach additional disciplines, and incentives to attract teachers to rural and remote locations. 

This audit assessed the effectiveness of the Department's workforce plans and strategies in responding to the demand for secondary teachers in STEM-related disciplines. We assessed:

  • how well the Department tracks the supply and demand for secondary teachers in STEM-related disciplines across NSW
  • whether the Department has effective strategies to attract and retain secondary teachers in STEM-related disciplines.
Conclusion
There are two key shortcomings that fundamentally limit the effectiveness of the Department's plans and strategies to respond to the demand for secondary teachers in STEM-related disciplines. First, the Department is not accurately tracking the supply and demand for secondary teachers by discipline due to incomplete data. Second, not all scholarship and sponsorship places are allocated and many scholars withdraw from the programs before completion. The Department has recognised and started to address these problems with a new workforce model, revised incentives and scholarship programs. 

The Department’s current workforce planning model does not provide the information needed to target workforce plans and strategies to areas of need. This is because it does not predict supply and demand for teachers by discipline and location. An internal review in 2017 acknowledged the limitations of this model. In response the Department developed a new model, which it is currently enhancing, to predict supply and demand for teachers by discipline and location. For this to be successful, the Department needs to monitor the level of out-of-field teaching and improve data on the willingness of teachers to work in particular locations. 

The Department does not allocate all available scholarship and sponsorship places and around 30 per cent of recipients do not complete the term of their agreement. An internal review in 2017 highlighted that some programs were not targeting workforce need and that there were no key performance indicators to determine the overall effectiveness of these programs. However, scholarship programs and incentives are promoted well through social media and face-to-face events at Universities. Further, the Department has used findings from internal reviews of incentives and scholarships in 2016 and 2017 to inform recent changes to programs. 

The Department has little oversight of access to practicum placements for pre-service teachers in areas of need. Professional experience agreements were established with each University in 2015 to improve the placement process for disciplines of need. Initial teacher education students must complete several ‘practicum placements’ before they can be qualified to teach in a school. Several universities we consulted reported difficulties finding practicum placements for pre-service teachers specialising in STEM-related disciplines. The Department is now revising the agreements to improve the quality of data it collects on the number, location and subject area of practicum placements. 

1 Australian Council for Educational Research 2015, The teacher workforce in Australia - supply, demand and data issues.

 

The Department is not accurately tracking the supply and demand for secondary teachers by discipline due to incomplete data. 

The Department’s current workforce planning model does not accurately predict supply and demand for teachers by discipline and location. An internal review in 2017 acknowledged the limitations of this model. In response the Department developed a new model which it is currently enhancing to address the findings of the review. For this model to be successful, the Department needs to monitor the level of out-of-field teaching and improve data on the willingness of teachers to work in particular locations. Further work also needs to be undertaken to refine the assumptions that underpin the Department’s workforce planning models as it starts to predict the need for teachers by discipline.

The Department has not publicly reported on the supply and demand for teachers by discipline since 2015. While it does report annually on its current workforce profile, this information is not detailed enough to inform future strategies or programs. More detailed public reporting may help the Department to influence the future supply of teachers by communicating its projected areas of need. Planned improvements to the Department's workforce planning model, as relayed to us, will add to the data available on areas of need. Once available, this should be reported publicly. 

Recommendations
By December 2019, the Department of Education should:

  1. Improve its workforce planning model to better understand and communicate supply and demand for teachers by: 
    • determining the extent, and analysing the impact, of out-of-field teaching by permanent and temporary teachers in each school
    • sourcing additional data to more accurately reflect teacher location preferences
    • projecting supply and demand by subject level and geographic area
    • regularly reporting on the supply and demand for secondary teachers in each discipline to communicate future areas of need to future teacher education students.

The Department's current scholarship and sponsorship programs are not allocating all available places and many scholars withdraw from the programs before completion. An internal review in 2017 raised several issues with the effectiveness of programs and the Department has started to revise its scholarship, sponsorship and incentive programs. 

An internal review in 2017 highlighted that scholarship and sponsorship programs were not targeting workforce need, and that there were no key performance indicators to determine the overall effectiveness of these strategies. In addition, the review found that only 79 per cent of available scholarship placements are allocated each year, and 31 per cent of scholarship recipients withdraw prior to completing their required service period. The Department recently announced changes to its scholarship programs from 2019 onwards.

The Department has incentives to encourage teachers to work in rural and remote areas, including teachers in STEM-related disciplines. Incentives include access to priority transfers, rental subsidies and other allowances. Research conducted in 2016 examined the influence of incentives in encouraging teachers to work in rural and remote areas. The Department used findings of this research when updating its set of rural and remote incentives in 2017.

The Department promotes its scholarship and sponsorship programs through the teach.NSW website. It uses social media to direct applicants to this website. It also promotes its programs through careers fairs, University open days, and professional events. Past applicants have reported that the website clearly communicates eligibility criteria and the terms of agreement for all scholarship programs. 

The Department could strengthen its relationship with universities to attract teachers to areas of need by collecting and analysing data on practicum placements, facilitating placements for scholarship recipients, and communicating predicted teacher needs by discipline. 

Recommendations
By December 2019, the Department of Education should:

2. Implement changes to address the findings of the 'Teacher Scholarship Realignment' report, including by:

  • testing a range of program designs with target candidates to determine the best options to attract more suitable applicants
  • establishing key performance indicators, and setting targets, to better monitor the effectiveness of the programs
  • reducing the number of scholars appointed to over-establishment positions
  • increasing the proportion of scholars appointed to priority locations 
  • further analysing scholarship recipients career paths to inform future improvements to the scholarship programs.

3. Review its role in the practicum placement process of pre-service teachers by:

  • analysing how many students each school accommodates per year, to ensure there are appropriate placements available for students in high needs disciplines
  • working with universities to facilitate practicum placements for scholarship recipients
  • establishing mechanisms for ongoing monitoring of its partnerships with universities to ensure they are meeting their aims.

Appendix one - Response from agency

Appendix two - About the audit

Appendix three - Performance auditing

 

Parliamentary Reference - Report number #313 - released 29 January 2019.

Published

Actions for Education 2018

Education 2018

Education
Asset valuation
Financial reporting
Information technology
Infrastructure
Service delivery
Shared services and collaboration
Workforce and capability

The Auditor-General for New South Wales, Margaret Crawford, released her report today on the results of the financial audits of agencies in the Education cluster. The report focuses on key observations and findings from the most recent financial audits of these agencies. 'I am pleased to report that unqualified audit opinions were issued on the financial statements of both agencies in the Education cluster', the Auditor-General said. Statements were submitted and audited within statutory deadlines.

This report analyses the results of our audits of financial statements of the Education cluster for the year ended 30 June 2018. The table below summarises our key observations.

This report provides parliament and other users of the Education cluster’s financial statements with the results of our audits, our observations, analysis, conclusions and recommendations in the following areas:

  • financial reporting
  • audit observations
  • service delivery.

Financial reporting is an important element of good governance. Confidence and transparency in public sector decision making are enhanced when financial reporting is accurate and timely.

This chapter outlines our audit observations related to the financial reporting of agencies in the Education cluster for 2017–18.

Observation Conclusions and recommendations
2.1 Quality of financial reporting
Unqualified audit opinions were issued on the financial statements of both cluster agencies. Sufficient audit evidence was obtained to conclude the financial statements were free of material misstatement.
2.2 Timeliness of financial reporting
Both cluster agencies met the statutory deadlines for completing early close procedures and submitting financial statements. Early close procedures continue to facilitate the timely preparation of cluster agencies’ financial statements and completion of audits, but scope exists to improve outcomes by resolving issues and supplying supporting documentation earlier.
2.3 Key issues from financial audits
Inconsistencies in the Department’s annual leave and long service leave data, identified over the past three audits, remain unresolved. This issue impacts the Department’s liability estimates for annual leave and long service leave, including associated on-costs. It also on-flows to the Crown Entity, which assumes the Department's liability for long service leave. Recommendation: The Department should confirm leave data and review assumptions following deployment of the new HR/Payroll system to better estimate the liability for employee benefits and the amount to be assumed by the Crown Entity.
2.4 Key financial information
Cluster agencies recorded net deficits in 2017–18.

The Department recorded a net deficit of $30.7 million in 2017–18 against a budgeted surplus of $122 million.

The NSW Education Standards Authority recorded a net deficit of $4.1 million against a budgeted deficit of $4.7 million.

Appropriate financial controls help ensure the efficient and effective use of resources and administration of agency policies. They are essential for quality and timely decision making.

This chapter outlines our observations and insights from:

  • our financial statement audits of agencies in the Education cluster for 2018
  • the areas of focus identified in the Audit Office work program.

The Audit Office Annual Work Program provides a summary of all audits to be conducted within the proposed time period as well as detailed information on the areas of focus for each of the NSW Government clusters.

Observation Conclusions and recommendations
3.1  Internal controls
Twenty internal control deficiencies were identified during our audits of cluster agencies. We assessed one as a high risk finding.  
Eight internal control weaknesses were repeat issues from previous financial audits that had not been fully addressed by management. Recommendation: Management should prioritise and action recommendations to address internal control weaknesses.
3.2 Information technology
Delivery of the Learning Management and Business Reform (LMBR) program is complete.

The LMBR program has been a major project for the Department since it was established in 2006.

A staged approach was adopted for implementing the Department’s new HR/Payroll system to manage the risks associated with this large-scale roll-out.

3.3 Valuation of the Department’s land and buildings
The Department completed a revaluation of land and building assets during 2017–18.

A market approach was used to revalue the Department’s land, resulting in a revaluation increment of $2.3 billion.

A current replacement cost approach was used to revalue the Department’s school buildings, resulting in an increment of $6.2 billion.

3.4 Maintenance of school facilities
The Department regularly assesses the condition of school buildings and uses Life Cycle Costing to predict maintenance and capital renewal, and to prioritise maintenance activities. The Life Cycle Costing assessment conducted by the Department in 2017–18 rated 70 per cent of school buildings as being in either as new or good condition. No school buildings were rated as being in end-of-life condition.
3.4 School asset delivery
The Department’s School Assets Strategic Plan is designed to ensure that there are sufficient fit-for-purpose places for students up to 2031. The Department created a new division, School Infrastructure NSW, to oversee the planning, supply and maintenance of schools and implement major school infrastructure projects.

This chapter provides service delivery outcomes for the Education cluster for 2017–18. It provides important contextual information about the cluster's operation, but the data on achievement of these outcomes is not audited. The Audit Office does not have a specific mandate to audit performance information.