Main navigation

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #386 - released 30 November 2023

10 August 2023

Published

Regional, rural and remote education

Education

Management and administration

Project management

Service delivery

What this report is about

Students in rural and remote areas of NSW face greater challenges compared to their metropolitan peers.

This report examined how the NSW Department of Education (the department) is ensuring that rural and remote students have access to the same quality of early childhood, school education, and skills pathways as metropolitan students.

What we found

A decade since the previous (2013) strategy to address educational disadvantage, there remain considerable gaps in access and outcomes between rural and remote students and metropolitan students.

The Rural and Remote Education Strategy (2021–24) is unlikely to address these longstanding and known issues of educational disadvantage in rural and remote areas.

Key enabling factors such as resourcing a dedicated team, setting performance measures, and establishing suitable governance arrangements were not put in place to support effective implementation of the 2021 strategy.

The department has programs aimed at addressing remoteness challenges, but does not know if these initiatives improve access or outcomes.

The department does not monitor or report on student access or outcomes according to geographic location.

What we recommended

The Department of Education should:

develop a new strategy that addresses disadvantage in regional, rural and remote education
establish and report publicly on regional, rural and remote key performance indicators
improve data collection by using a standard remoteness classification
improve governance arrangements for regional, rural and remote education
review the resources provided for regional, rural and remote areas that recognises the additional costs
develop an approach that ensures all students can access best practice modes of delivery.

In February 2021, the department of Education (the department) released the ‘Rural and Remote Education Strategy (2021–2024)’. The strategy sets a vision that ‘every child in regional New South Wales has access to the same quality of education as their metropolitan peers’. It recognises that students in rural and remote areas of New South Wales face greater challenges compared to students in metropolitan locations. These challenges contribute to regional, rural and remote students underperforming on major educational indicators compared to their metropolitan peers.

In recent years, regional, rural and remote communities experienced a series of natural disasters as well as the COVID-19 pandemic. In response to the pandemic and subsequent school closures, the department introduced new initiatives aimed at minimising the disruption to children including online learning and small group tuition.

The department established a regional, rural and remote education policy unit in 2021 to support delivery of the strategy and its vision.

The objective of this audit was to assess the effectiveness of the department’s activities to ensure that regional, rural and remote students have access to the same quality of early childhood, school education, and skills pathways as their metropolitan peers.

In making this assessment, the audit examined whether:

The department developed and implemented a strategy that enables regional, rural and remote students to access the same quality of early childhood education, school education, and skills pathways as students in metropolitan New South Wales.
The department has been addressing the complexities and needs of regional, rural and remote early childhood education, school education, and skills pathways.

Conclusion

The department's rural and remote education strategy is unlikely to achieve its vision that every child in regional New South Wales has access to the same quality of education as their metropolitan peers. Shortcomings in the design and implementation of the strategy have meant there is little to report on its impact after more than two years since its release.

The department did not take on board lessons learned from the previous strategy. The department did not provide additional resources to meet the strategy aims, establish strong central coordination, set timeframes, set measures of success, or identify new programs to address gaps in regional and remote access and outcomes. Instead, the department relied on matching existing programs and activities across its business areas to meet the stated actions and goals of the strategy.

There was not enough work put in to plan for successful implementation. A changeover in staff responsible for coordinating implementation of the strategy and lack of fit-for-purpose governance arrangements slowed its momentum. The department took one year to recruit a central team and almost two years to set up governance that gives relevant department executives oversight of the strategy. This was not fast enough to support a four-year strategy with an ambitious vision.

The department did not establish a program logic model, set baseline measures or develop an evaluation plan to assess the impact of the strategy. Consequently, it has not adequately monitored changes in access or outcomes for regional, rural and remote students. Two years after its release, there has not been any public reporting against the actions or outcomes of the strategy.

The department is not addressing the complexities of delivering regional, rural and remote early childhood, school education and skills pathways. There are a range of programs targeted to overcoming challenges of remoteness, but the department does not monitor data to determine whether these programs are sufficient to close the persistent gaps in access and outcomes for regional, rural and remote students.

A decade after the Rural and Remote Education Blueprint was launched in 2013, there remain considerable gaps in access and outcomes between metropolitan and regional, rural and remote areas. The department identifies 'equity' as a key value in its strategic plan but does not monitor or report on performance against key indicators according to geographic location. Data produced in response to our requests for this report demonstrate that previously identified gaps in access and outcomes remain.

Different areas of the department recognise the challenges of delivering services in regional, rural and remote locations and have developed specific programs or approaches aimed at addressing these challenges. The department does not know whether these interventions are sufficient to close the gaps in access or outcomes. Schools we spoke with as part of the audit reported significant ongoing challenges with attracting and retaining staff, providing a full curriculum and accessing support services when needed.

This chapter examines the process to develop the Rural and Remote Education Strategy (2021–2024). It considers whether there was a comprehensive program of stakeholder consultation, whether relevant research and evidence was incorporated and whether an effective performance monitoring system was established.

The department made genuine efforts to consult with stakeholders on the new strategy

The department had a clear process to engage and obtain feedback from key stakeholders during the development of the new strategy. It developed a range of documents to support the consultation process including a stakeholder engagement plan, communications plan, and presentation. The department used the International Association for Public Participation (IAP2) Spectrum of Public Participation principles to help ensure that relevant stakeholders were included in the planning and decision-making process.

In late 2019, the department began its first phase of consultations with internal and external stakeholders to get their views on rural and remote education. It consulted internally with department directors, advisory groups, and learning communities, and externally with government agencies, service providers, non-government schools, and universities.

In March 2020, the department developed a stakeholder engagement paper to test the key issues from stakeholder consultations. Four focus areas were identified and included in a consultation paper that went out to key stakeholders for the second round of consultations in May 2020.

In the third consultation phase, the department conducted a workshop with stakeholders to review the earlier feedback, prioritise issues, identify gaps, and provide further input.

This consultation process enabled the department to identify issues and challenges to inform the new strategy. However, it was already aware that the blueprint was having limited success, and had already identified potential focus areas, following the evaluation of the blueprint in 2019.

The department did not consider recent research when developing the new strategy

The department's guidance materials promote the importance of considering research during policymaking. The guidelines describe the need to understand a topic, consult with stakeholders, identify gaps in existing knowledge, and ensure future work is informed by current literature.

In 2013, the department published a literature review on rural and remote education to inform the blueprint. The literature review found that students in rural and remote schools were not performing as well as their metropolitan peers, and that this performance gap was widening. The review attributed this to the higher number of children from low socio-economic backgrounds attending rural and remote schools. The review also identified several other factors that could negatively impact performance outcomes for rural and remote students. The department used the findings of the literature review to develop the key focus areas in the 2013 blueprint.

When the department began developing the new rural and remote education strategy in 2019, it recognised the need to review the literature on recent international initiatives. However, it has not yet released this review. This means that the department could have missed important new developments since it last examined the literature in 2013. Incorporating up-to-date research is important where past strategies have not met all their intended outcomes.

A national review into rural and remote education in 2018 examined Australian and international literature to inform its findings. The review made 11 recommendations to the Australian and state governments. While the NSW Government was not required to formally respond to the review, it could have considered the work done by that review when developing the new strategy. Several review recommendations are addressed in the strategy, while several others are only partly addressed. Gaps between review recommendations and specific strategy actions include improving the availability of quality accommodation, substantially reducing the waiting times for specialist assessments of students with learning difficulties and disabilities and increasing access to high quality distance education.

In 2019, the department commissioned a rural and remote project to contribute a research and evidence base to the new strategy. The main aim of the project was to help the department understand how it could better support rural and remote schools to increase educational outcomes. There was not enough time for this review to be completed prior to the release of the strategy. As of June 2023, the research project had not yet been released.

The strategy did not address all findings and recommendations from a recent evaluation

In 2020, the department's Centre for Education Statistics and Evaluation (CESE) published an evaluation of the blueprint. The evaluation examined how the actions in the blueprint were implemented. It recommended that a new strategy be developed, and made recommendations for things that should be incorporated into the strategy.

The blueprint aimed to ensure students in rural and remote areas could access the same quality of education as their metropolitan peers. The blueprint identified four focus areas to meet that aim:

quality early childhood education
great teachers and school leaders
curriculum access for all
effective partnerships and connections.

The department developed several initiatives to help meet the objectives of each of the four focus areas. These initiatives are described in Exhibit 5 below.

Exhibit 5: Key initiatives in the Rural and Remote Education Blueprint (2013)
Key focus area	Initiative
Quality early childhood education	Funding model to help vulnerable and disadvantaged children access preschool.
Great teachers and school leaders	Rental subsidy to help attract and retain teachers.
Curriculum access for all	Virtual school to provide a varied curriculum for high potential and gifted students.
Effective partnerships and connections	Education networks for teachers and school leaders to access expert advice to support student learning. Networked specialist centres to bring together services to support student health and wellbeing.

Source: Department of Education, Rural and remote education: A blueprint for action 2013.

The evaluation found that initiatives in two of the four focus areas – Quality early childhood education and Curriculum access for all – had performed well. However, the evaluation found that initiatives in the other two focus areas – Great teachers and school leaders and Effective partnerships and connections – did not achieve intended outcomes.

On the whole, the evaluation found that the 'remoteness gap' between rural and remote students and metropolitan students had not reduced since the blueprint was introduced. It recommended that the department continue its focus on rural and remote education by developing a new evidence-based strategy that focused on student outcomes and clear measures of success.

Objectives and actions in the new strategy were similar to those in the blueprint

The 2021 strategy sets an overall vision that 'every child in regional New South Wales has access to the same quality of education as their metropolitan peers'. It also states that the department 'is committed to ensuring all rural and remote students have equitable access to educational opportunities'.

Exhibit 6: Comparison of objectives in the blueprint and the new strategy
Rural and Remote Education Blueprint (2013)	Rural and Remote Education Strategy (2021–24)
Provide more children with access to quality early child education in the year before school.	Ensure all students have access to quality preschool in the year before school.
Ensure rural and remote schools have greater capacity to attract and retain quality teachers and leaders.	Increase supply of high-quality educators in rural and remote communities.
Build the capacity of teachers and leaders in rural and remote schools.	Better develop rural and remote teachers to deliver quality learning opportunities.
Address wellbeing needs through effective partnerships and connections.	Address wellbeing needs through connections with local communities.
Develop partnerships so that rural and remote students have access to quality pathways into further education, training, or employment.	Build partnerships to increase student access to post-school opportunities.

Source: Audit Office summary of Department of Education information.

Four areas in the blueprint remained a focus in the new strategy – early childhood education, teacher recruitment and retention, curriculum, and student wellbeing support services. Each focus area identifies a goal, as well as the aims and actions that contribute to those goals.

While this shows the department identified that these areas required continued attention, most actions were to 'increase', 'expand' or 'improve' existing programs and resources. The new strategy did not propose any new ideas or solutions, despite the blueprint achieving limited success in improving outcomes for rural and remote students.

There were no baseline or target measures set to monitor progress of the new strategy

The blueprint evaluation recommended that the department develop a new evidence-based strategy which focused on improving student outcomes. It also recommended the department use a program logic methodology to ensure there was a clear definition of success, adequate measures of success, and continual monitoring to ensure success.

Program logic models are a visual representation of the various components of a program. They can be used to illustrate program priorities, inputs, activities, outputs, outcomes, and assumptions. Logic models are used to explain how a proposed solution will address a specific problem. They are important because they can help test assumptions, build business cases, and identify potential enablers or barriers that could impact the project.

The department did not complete a program logic model during development of the new strategy, nor did it define measures to monitor whether the strategy's overall vision for quality education or the commitment to equitable access was on track to be achieved.

The department has not comprehensively monitored changes in educational outcomes in regional, rural and remote areas since the evaluation of the blueprint in 2020. This evaluation had seven indicators of educational outcomes by remoteness. The measures used in the evaluation could have provided a starting point given the similarity in focus areas between the blueprint and the new strategy. Not addressing past review recommendations increases risks that issues will be repeated.

The policy unit advised it has plans to set up a dashboard to monitor performance across the department's business plan measures by remoteness. This is intended to identify areas where system-wide improvements are required. This is not a comprehensive account of the strategy outcomes because the business plan measures don't capture all the goals of the strategy.

There were no timeframes or resources identified for implementing new strategy actions

The strategy has an overall timeframe of 2021–2024 but does not clarify when it expects the vision, goals, or aims to be achieved, or actions to be implemented.

The department's guidance on policymaking sets out how projects should be transitioned between the policy and implementation teams. This guidance is intended to help ensure the policy intent and scope of the project are not lost during the delivery of the project. The guidance highlights that the policy team should establish clear project implementation timeframes. It is important to have clear timeframes because it enables teams to measure progress, manage resources, and prioritise actions to ensure project outcomes are achieved.

The strategy states that there is a further $1 billion of investment planned over the next three years for rural and remote education but does not identify how this is allocated across its focus areas. It is important to identify the resources required to support the implementation of a program so that program objectives are met in a timely and cost-effective manner. The previous blueprint identified much lower funding of $80 million but more clearly showed how it would be allocated for identified actions across the four focus areas.

In response to our requests, the department separately identified $1.286 billion in expenditure for regional, rural and remote schools referenced in the strategy. Most of this expenditure related to existing department programs and activities rather than new initiatives. The total amount included:

$576.9 million for new and upgraded schools
$365.8 million for upgraded information technology equipment and resources
$120 million for school facility upgrades to be co-funded by schools
$60 million to replace school roofs
$60 million for the COVID Intensive Learning Support Program
$32 million for the Early Action for Success program
$29.7 million for staffing incentives
$21.7 million for literacy and numeracy interventions
$18.8 million in school location allowances
$1.45 million for the Rural Learning Exchange Pilot
$0.4 million for Rural and Remote Network initiatives.

This chapter examines the arrangements in place to implement the strategy. It considers whether effective governance arrangements are in place and how progress is monitored and reported.

This chapter considers the effectiveness of arrangements to ensure regional, rural and remote students have access to quality early childhood education, school education, and post‑school transitions.

This chapter considers the department's arrangements to monitor educational and wellbeing outcomes of students by remoteness. It reports on differences in outcomes between students in metropolitan areas and those in regional, rural and remote areas.

Those living in regional, rural and remote areas can have greater difficulty in accessing government services, often needing to travel long distances, or facing lower service levels than provided in major cities. This context is important when considering educational and wellbeing outcomes, given the disruptive effects of waiting or missing out on important services.

The rest of this chapter details key measures in the department's outcome and business plan.

Parliamentary reference - Report number #385 - released 10 August 2023

23 June 2023

Published

Management of the Critical Communications Enhancement Program

Finance

Health

Justice

Whole of Government

Cyber security

Information technology

Infrastructure

Internal controls and governance

Project management

Risk

Service delivery

Shared services and collaboration

What the report is about

Effective radio communications are crucial to NSW's emergency services organisations.

The Critical Communications Enhancement Program (CCEP) aims to deliver an enhanced public safety radio network to serve the five emergency services organisations (ESOs), as well as a range of other users.

This report assesses whether the NSW Telco Authority is effectively managing the CCEP.

What we found

Where it has already been delivered (about 50% of the state), the enhanced network meets most of the requirements of ESOs.

The CCEP will provide additional infrastructure for public safety radio coverage in existing buildings agreed to with ESOs. However, radio coverage inside buildings constructed after the CCEP concludes will be at risk because building and fire regulations do not address the need for in-building public safety radio coverage.

Around 98% of radios connected to the network can be authenticated to protect against cloning, though only 42% are.

The NSW Telco Authority has not settled with ESOs on how call encryption will be used across the network. This creates the risk that radio interoperability between ESOs will not be maximised.

When completed, the public safety radio network will be the only mission critical radio network for ESOs. It is unclear whether governance for the ongoing running of the network will allow ESOs to participate in future network operational decisions.

The current estimated capital cost for the NSW Telco Authority to complete the CCEP is $1.293 billion. This is up from an estimated cost of $400 million in 2016. The estimated capital cost was not publicly disclosed until $1.325 billion was shown in the 2021–22 NSW Budget Papers.

We estimate that the full cost to government, including costs to the ESOs, of implementing the enhanced network is likely to exceed $2 billion.

We made recommendations about

The governance of the enhanced Public Safety Network (PSN) to support agency relationships.
The need to finalise a Traffic Mitigation Plan for when the network is congested.
The need to provide advice to the NSW Government about the regulatory gap for ensuring adequate network reach in future buildings.
The need to clarify how encryption and interoperability will work on the enhanced network.
The need for the NSW Telco Authority to comply with its policy on Infrastructure Capacity Reservation.
Expediting measures to protect against the risk of cloning by unauthenticated radios.

Public safety radio networks are critical for operational communications among Emergency Services Organisations (ESOs), which in New South Wales include:

NSW Ambulance
Fire and Rescue NSW
NSW Police Force
NSW Rural Fire Service
NSW State Emergency Service.¹

Since 1993, these five ESOs have had access to a NSW Government owned and operated radio communications network, the Public Safety Network (PSN), to support their operational communications. Around 60 to 70 other entities also have access to this network, including other NSW government entities, Commonwealth government entities, local councils, community organisations, and utility companies.

Pursuant to the Government Telecommunications Act 2018 ('the Act'), the New South Wales Government Telecommunications Authority ('NSW Telco Authority') is responsible for the establishment, control, management, maintenance and operation of the PSN.²

Separate to the PSN, all ESOs and other government entities have historically maintained their own radio communication capabilities and networks. Accordingly, the PSN has been a supplementary source of operational radio communications for these entities.

These other radio networks maintained by ESOs and other entities are of varying size and capability, with many ageing and nearing their end-of-life. There was generally little or no interoperability between networks, infrastructure was often co-located and duplicative, and there were large gaps in geographic coverage.

In 2016, the NSW Telco Authority received dedicated NSW Government funding to commence the Critical Communications Enhancement Program (CCEP).

According to NSW Telco Authority's 2021–22 annual report, the CCEP is a transformation program for operational communications for NSW government agencies. The CCEP '…aims to deliver greater access to public safety standard radio communications for the State’s first responders and essential service agencies'. The objective of CCEP is to consolidate the large number of separate radio networks that are owned and operated by various NSW government entities and to enhance the state’s existing shared PSN. The program also aims to deliver increased PSN coverage throughout New South Wales.

The former NSW Government intended that as the enhanced PSN was progressively rolled-out across NSW, ESOs would migrate their radio communications to the enhanced network, before closing and decommissioning their own networks.

About this Audit

This audit assessed whether the CCEP is being effectively managed by the NSW Telco Authority to deliver an enhanced PSN that meets ESOs' requirements for operational communications.

We addressed the audit objective by answering the following two questions:

Have agreed ESO user requirements for the enhanced PSN been met under day-to-day and emergency operational conditions?
Has there been adequate transparency to the NSW Government and other stakeholders regarding whole-of-government costs related to the CCEP?

In answering the first question, we also considered how the agreed user requirements were determined. This included whether they were supported by evidence, whether they were sufficient to meet the intent of the CCEP (including in considering any role for new or alternative technologies), and whether they met any relevant technical standards and compliance obligations (including for cyber security resilience).

While other NSW government agencies and entities use the PSN, we focused on the experience of the five primary ESOs because these will be the largest users of the enhanced PSN.

Both the cost and time required to complete the CCEP roll-out have increased since 2016. While it was originally intended to be completed in 2020, this is now forecast to be 2027. Infrastructure NSW has previously assessed the reasons for the increases in time and cost. A summary of the findings made by Infrastructure NSW is presented in Chapter 1 of this report. Accordingly, as these matters had already been assessed, we did not re-examine them in this performance audit.

The auditee for this performance audit is the NSW Telco Authority, which is a statutory authority within the Department of Customer Service portfolio.

In addition to being responsible for the operation of the PSN, section 5 of the Act also prescribes that the NSW Telco Authority is:

to identify, develop and deliver upgrades and enhancements to the government telecommunications network to improve operational communications for government sector agencies
to develop policies, standards and guidelines for operational communications using telecommunications networks.

The NSW Telco Authority Advisory Board is established under section 10 of the Act. The role of the board is to advise the NSW Telco Authority and the minister on any matter relating to the telecommunications requirements of government sector agencies and on any other matter relating to the functions of the Authority. As of 2 June 2023, the responsible minister is the Minister for Customer Service and Digital Government.

The five identified ESOs are critical stakeholders of the CCEP and therefore they were consulted during this audit. However, the ESOs were not auditees for this performance audit.

Conclusion

In areas of New South Wales where the enhanced Public Safety Network has been implemented under the Critical Communications Enhancement Program, the NSW Telco Authority has delivered a radio network that meets most of the agreed requirements of Emergency Services Organisations for routine and emergency operations.

In April 2023, the enhanced Public Safety Network (PSN) was approximately 50% completed. In areas where it is used by Emergency Services Organisations (ESOs), the PSN generally meets agreed user requirements. This is demonstrated through extensive performance monitoring and reporting, which shows that agreed performance standards are generally achieved. Reviews by the NSW Government and the NSW Telco Authority found that the PSN performed effectively during major flood events in 2021 and 2022.

Where it is completed, PSN coverage is generally equal to or better than each ESO's individual pre-existing coverage. The NSW Telco Authority has a dedicated work program to address localised coverage gaps (or 'blackspots') in those areas where coverage has otherwise been substantively delivered. Available call capacity on the network far exceeds demand in everyday use. Any operational issues that may occur with the PSN are transparent to ESOs in real time.

The NSW Telco Authority consulted extensively with ESOs on requirements for the enhanced PSN, with relatively few ESO requirements not being included in the specifications for the enhanced PSN. Lessons from previous events, including the 2019–20 summer bushfires, have informed the design and implementation of the enhanced PSN (such as the need to ensure adequate backup power supply to inaccessible sites). The network is based on the Project 25 technical standards for mission-critical radio communications, which is widely-accepted in the public safety radio community throughout Australia and internationally.

There is no mechanism to ensure adequate radio coverage within new building infrastructure after the CCEP concludes, but the NSW Telco Authority and ESOs have agreed an approach to prioritise existing in-building sites for coverage for the duration of the CCEP.

The extent to which the PSN works within buildings and other built structures (such as railway tunnels) is of crucial importance to ESOs, especially the NSW Police Force, NSW Ambulance, and Fire and Rescue NSW. This is because a large proportion of their operational communications occurs within buildings.

There is no mechanism to ensure the adequacy of future in-building coverage for the PSN in new or refurbished buildings after the CCEP concludes. Planning, building, and fire regulations are silent on this issue. We note there are examples in the United States of how in-building coverage for public safety radio networks can be incorporated into building or fire safety codes.

In regard to existing buildings, it is not possible to know whether a building requires its own in-building PSN infrastructure until nearby outside radio sites, including towers and antennae, have been commissioned into the network. Only then can it be determined whether their radio transmissions are capable of penetrating inside nearby buildings. Accordingly, much of this work for in-building coverage cannot be done until outside radio sites are finished and operating.

In March 2023, the NSW Telco Authority and ESOs agreed on a list of 906 mandatory and 7,086

non-mandatory sites for in-building PSN coverage. Most of these sites will likely be able to receive radio coverage via external antennae and towers, however this cannot be confirmed until those nearby external PSN sites are completed. The parties also agreed on an approach to prioritising those sites where coverage is needed but not provided by antennae and towers. Available funding will likely only extend to ensuring coverage in sites deemed mandatory, which is nonetheless expected to meet the overall benchmark of achieving 'same or better' coverage than what ESOs had previously.

There is a risk that radio interoperability between ESOs will not be maximised because the NSW Telco Authority has not settled with ESOs how encryption will be used across the enhanced PSN.

End-to-end encryption of radio transmissions is a security feature that prevents radio transmissions being intercepted or listened to by people who are not meant to. The ability of the PSN to provide end-to-end encryption of operational communications is of critical importance to the two largest prospective users of the PSN: the NSW Police Force and NSW Ambulance. Given that encryption excludes other parties that do not have the requisite encryption keys, its use creates an obstacle to achieving a key intended benefit of the CCEP, that is a more interoperable PSN, where first responders are better able to communicate with other ESOs.

Further planning and collaboration between PSN participants are necessary to consider how these dual benefits can be achieved, including in what operational circumstances encrypted interoperability is necessary or appropriate.

The capital cost to the NSW Telco Authority of the CCEP, originally estimated at $400 million in 2016, was not made public until the 2021–22 NSW Budget disclosed an estimate of $1.325 billon.

The estimated capital cost to complete all stages of the CCEP increased over time. This increasing cost was progressively disclosed to the NSW Government through Cabinet processes between 2015–16 and 2021–22.

In 2016, the full capital cost to the NSW Telco Authority of completing the CCEP was estimated to be $400 million. This estimated cost was not publicly disclosed, nor were subsequent increases, until the cost of $1.325 billion was publicly disclosed in the 2021–22 NSW Budget (revised down in the 2022–23 NSW Budget to $1.293 billion).

There has been no transparency about the whole-of-government cost of implementing the enhanced PSN through the CCEP.

In addition to the capital costs incurred directly by the NSW Telco Authority for the CCEP, ESOs have incurred costs to maintain their own networks due to the delay in implementing the CCEP. The ESOs will continue to incur these costs until they are able to fully migrate to the enhanced PSN, which is expected to be in 2027. These costs have not been tracked or reported as part of transparently accounting for the whole-of-government cost of the enhanced PSN. This is despite Infrastructure NSW in 2019 recommending to the NSW Telco Authority that it conduct a stocktake of such costs so that a whole-of-government cost impact is available to the NSW Government.

¹The definition of 'emergency services organisation' is set out in the State Emergency and Rescue Management Act 1989 (NSW). In addition to the five ESOs discussed in this report, the definition also includes: Surf Life Saving New South Wales; New South Wales Volunteer Rescue Association Inc; Volunteer Marine Rescue NSW; an agency that manages or controls an accredited rescue unit; and a non-government agency that is prescribed by the regulations for the purposes of this definition.
²Section 15(1) of the Government Telecommunications Act 2018 (NSW).

The NSW Telco Authority established and tracked its own costs for the CCEP

Over the course of the program from 2016, the NSW Telco Authority prepared a series of business cases and program reviews that estimated its cost of implementing the program in full, including those shown in Exhibit 6 below.

Exhibit 6: Estimated costs to fully implement the CCEP
Source	Capital cost ($ million)	Operating cost ($ million)	Completion date
March 2016 business case	400	37.3	2020
November 2017 internal review	476.7	41.7	2022
March 2020 business case	950–1,050	--	2025
October 2020 business case	1,263.1	56.1	2026

Source: CCEP business cases as identified.

In response to the 2016 CCEP business case, the then NSW Government approved the NSW Telco Authority implementing the CCEP in full, with funding provided in stages. The NSW Telco Authority tracked its costs against approved funding, with monthly reports provided to the multi-agency Program Steering Committee

Throughout the program, the NSW Government was informed of increasing costs being incurred by the NSW Telco Authority for the CCEP

The various business cases, program updates, and program reviews prepared by the NSW Telco Authority were provided to the NSW Government through the required Cabinet process when seeking approval for the program proceeding and requests for both capital and operational funding. These provided clear indication of the changing overall cost of the CCEP to the NSW Telco Authority, as well as the delays that were being experienced.

There was no transparency to the Parliament and community about changes in the capital cost of the CCEP until the 2021–22 NSW Budget

As the business cases for the CCEP were not publicly available, the only sources of information about capital cost were NSW Budget papers and media releases. The information provided in the annual Budget papers prior to the 2021–22 NSW Budget provided no visibility of the estimated full capital cost to complete all stages of the CCEP. As shown in Exhibit 7 below, this information was fragmented and complex.

Media releases about the progress of the CCEP did not provide the estimated total cost to the NSW Telco Authority of $1.325 billion to complete all stages of the CCEP until June 2021. Prior to this date, media releases only provided funding for the initial stages of the program or for the stages subject to a funding announcement.

Even during the September 2019 and March 2020 Parliamentary Estimate Committee hearings where the costings and delays to the CCEP were raised, the estimated full cost of the CCEP was not revealed.

Exhibit 7: CCEP funding in NSW Budget papers from 2015–16 to 2022–23
Financial year	Type of major work	Description of expenditure	Forecast estimate to complete ($ million)	Estimated duration
2015–16	New work	Infrastructure Rationalisation Program: Planning and Pilot	18.3	2015–16
2016–17	Work in progress	CCEP Planning and Pilot	18.3	2015–17
2016–17	New work	CCEP	45	2016–17
2017–18	New work	CCEP	190.75	2017–21
2018–19	Work in progress	CCEP North Coast and State-wide Detailed Design	190.75	2017–21
2018–19	New work	CCEP Greater Metropolitan Area	236	2018–22
2019–20	Work in progress	CCEP	426.9	2018–22
2020–21	Work in progress	CCEP	664.8	2018–22
2021–22	Work in progress	CCEP	1,325	2018–26
2022–23	Work in progress	CCEP	1,292.8	2018–26

Source: NSW Treasury, Annual State Budget Papers.

The original business case for the CCEP included estimated ESO costs, though these costs were not tracked throughout the program

Estimates for ESO costs for operating and maintaining their own radio networks over the four years from 2016–17 were included in the original March 2016 business case. They included $75.2 million for capital expenditure and $95 million for one-off operating costs. These costs, as well as costs incurred by ESOs due to the delay in the program, were not subsequently tracked by the NSW Telco Authority.

In January 2017, Infrastructure NSW reviewed the CCEP business case of March 2016. In this review, Infrastructure NSW recommended that the NSW Telco Authority identify combined and apportioned costs and cashflow for all ESOs over the CCEP funding period reflecting all associated costs to deliver the CCEP. These to include additional incidental capital costs accruing to ESOs, transition and migration to the new network and the cost (capital and operational) of maintaining existing networks. This recommendation was implemented in the November 2017 program review, with ESO capital costs estimated as $183 million.

In 2019, Infrastructure NSW conducted a Deep Dive Review on the progress of the CCEP. In this review, Infrastructure NSW made what it described as a 'critical recommendation' that the NSW Telco Authority:

…coordinate a stocktake of the costs of operational bridging solutions implemented by PSAs [ESOs] as a result of the 18-month delay, so that a whole-of-government cost impact is available to the NSW Government.

It should be noted that the delay to CCEP completion now is seven years and that further ‘operational bridging solutions’ have been needed by the ESOs.

'Stay Safe and Keep Operational' costs incurred by ESOs will be significantly higher than originally estimated

Stay Safe and Keep Operational (SSKO) funding was established to provide funding to ESOs to maintain their legacy networks while the CCEP was refreshing and enhancing the PSN. This recognised that much of the network infrastructure relied on by ESOs had reached – or was reaching – obsolescence and would either require extensive maintenance or replacement before the PSN was available for ESOs to migrate to it. ESOs may apply to NSW Treasury for SSKO funding, with their specific proposals being reviewed (and endorsed, where appropriate) by the NSW Telco Authority. Accordingly, SSKO expenditure does not fall within the CCEP budget allocation.

As shown in the table below, extracted from the March 2016 CCEP business case, the total expected cost for SSKO purposes over the course of the CCEP was originally $40 million, assuming the enhanced PSN would be fully available by 2020.

Exhibit 8: Stay Safe and Keep Operational forecast costs, 2017 to 2020
Year	2017	2018	2019	2020	Total
SSKO forecast ($ million)	12.5	15	10	2.5	40

Source: March 2016 CCEP business case.

In October 2022, the expected completion date for the CCEP was re-baselined to August 2027. Accordingly, ESOs will be required to continue to maintain their radio networks using legacy equipment for seven years longer than the original 2020 forecast. This will likely become progressively more expensive and require additional SSKO funding. For example, NSW Telco Authority endorsed SSKO bids for 2022–23 exceeded $35 million for that year alone.

Compared to the original forecast made in the March 2016 CCEP business case of $40 million, we found ESOs had estimated SSKO spending to 2027 will be $292.5 million.

A refresh of paging network used by ESOs and the decommissioning of redundant sites were both removed from the original 2016 scope of the CCEP

Paging

A paging network is considered an important user requirement by the Fire and Rescue NSW, NSW Rural Fire Service, and NSW State Emergency Service. The 2016 CCEP business case included a paging network refresh within the program scope of works. This was reiterated in the November 2017 internal review of the program. These documents did not estimate a cost for this refresh. The March 2020 and October 2020 business cases excluded paging from the program scope. The audit is unable to identify when, why or by whom the decision was made to remove paging from the program scope, something that was also not well communicated to the affected ESOs.

In 2021, after representations from the affected ESOs, the NSW Telco Authority prepared a separate business case for a refresh of the paging network at an estimated capital cost of $60.31 million. This program was subsequently approved by the NSW Government and included in the 2022–23 NSW Budget.

In determining an estimated full whole-of-government cost of delivering the enhanced PSN, we have included the budgeted cost of the paging network refresh on the basis that:

it was expressly included in the original approved March 2016 business case
the capability is deemed essential to the needs of three ESOs.

Decommissioning costs

The 2016 CCEP business case included cost estimates for decommissioning surplus sites (whether ‘old’ GRN sites or sites belonging to ESOs’ own networks). These estimates were provided for both the NSW Telco Authority ($38 million) and for the ESOs ($55 million). However, while these estimates were described, they were not included as part of the NSW Telco Authority's estimated capital cost ($400 million) or (more relevantly) operating cost ($37.3 million) for the CCEP. This is despite decommissioning being included as one of eight planned activities for the rollout of the program.

In the October 2020 business case, an estimate of $201 million was included for decommissioning agency networks based on a model whereby:

funding would be coordinated by the NSW Telco Authority
scheduling and reporting through an inter-agency working group and
where appropriate, agencies would be appointed as the most appropriate decommissioning party.

This estimated cost is not included in the CCEP budget.

In determining an estimated full whole-of-government cost of the enhanced PSN, we have included the estimated cost of decommissioning on the basis that:

decommissioning was included in the 2016 CCEP business case as one of eight 'planned activities for the rollout of the program'
effective decommissioning of surplus sites and equipment (including as described in the business case as incorporating asset decommissioning, asset re-use, and site make-good) is an inherent part of the program management for an enhanced PSN
costs incurred in decommissioning are entirely a consequence of the CCEP program.

The estimated minimum cost of building an enhanced PSN consistent with the original proposal is over $2 billion

We have derived two estimated minimum whole-of-government costs for delivering an enhanced PSN. These are:

$2.04 billion when calculated from NSW Telco Authority data – shown as estimate A in Exhibit 9 below.
$2.26 billion when calculated from ESO supplied data – shown as estimate B in Exhibit 9.

Both totals include:

budgeted amounts for both CCEP capital expenditure ($1,292.8 million) and operating expenditure ($139 million)
the NSW Telco Authority's 2020 estimated cost for decommissioning ($201 million)
the NSW Telco Authority's approved funding for paging refresh ($60.3 million).

The two estimated totals primarily vary around the capital expenditure of ESOs (particularly SSKO funding). To determine these costs, we used ESO provided actual SSKO costs to date, as well as their estimates for maintaining their legacy radio networks through to 2027.

The equivalent cost estimates from the NSW Telco Authority were sourced from the November 2017 internal review and the October 2020 business case for CCEP. It should be noted that the amounts for both estimates are not audited, or verified, but do provide an indication of how whole-of-government costs have grown over the course of the program.

The increase in and reasons for the increase in total CCEP costs (capital and one-off operating) incurred or forecast by the NSW Telco Authority (from $437.3 million in 2016 to $1,431.8 million in 2022) have been provided to the NSW Government through various business cases and reviews prepared by the NSW Telco Authority, as well as by reviews conducted by Infrastructure NSW as part of its project assurance responsibilities.

However, the growth in ESO costs and other consequential costs, such as paging and decommissioning, from around $263 million in the 2016 CCEP business case to between $600 million and $800 million, has to a large degree remained invisible and unexplained to the NSW Government and other stakeholders

Exhibit 9: Estimated whole-of-government costs of the enhanced PSN
	Estimated whole-of-government cost, over time
Cost type	2016¹	2017²	2020³	2023–Estimate A⁴	2023–Estimate B⁵
Cost type	$ million	$ million	$ million	$ million	$ million
CCEP capital expenditure	400^a	476.7^b	1,263.1^c	1,292.8^d	1,292.8^d
CCEP operating expenditure	37.3^a	41.7^b	41.5^e	139^d	139^d
CCEP total	437.3	518.4	1,304.6	1,431.8	1,431.8
ESO capital expenditure	75.2^a,f	183^b,e	75.4^e	258.4^g	292.5
ESO one-off operating expenditure	93^a	n.a.^l	86.5^e	86.5^h	273
ESO total	168.2	183	161.9	344.9	565.5
Paging	n.a.ⁱ	n.a.ⁱ	n.a.^j	60.3^k	60.3^k
Decommissioning	93	n.a.^l	201.0	201^h	201
Paging and decommissioning total	93	n.a.	201	261.3	261.3
Whole-of-government total	698.5	701.4	1,667.5	2,038	2,258.6

Notes:

Financial year 2016 to Financial year 2020.
Financial year 2016 to Financial year 2021.
Financial year 2016 to Financial year 2025.
Financial year 2016 to Financial year 2026.
Financial year 2022 to Financial year 2025.
Stay Safe and Keep Operational (SSKO) costs plus terminals costs.
November 2017 internal review and October 2020 Business case.
October 2020 Business case.
Included in CCEP capital expenditure at that time.
By 2020, a refresh of the paging network had been removed from the CCEP scope.
A separate business case for a refresh of the paging network was approved by government in 2022.
Figure not included in the source document.

Sources:

March 2016 CCEP business case.
November 2017 Internal Review conducted by the NSW Telco Authority.
October 2020 CCEP business case.
Derived from business cases, with ESO costs drawn from NSW Telco Authority data.
Derived from business cases, with ESO costs based on data provided to the Audit Office of New South Wales by each of the five ESOs.

Appendix two – Trunked public safety radio networks

Appendix one – Responses from agencies

Parliamentary reference - Report number #383 - released 23 June 2023

28 February 2023

Published

Government advertising 2021–22

Finance

Education

Whole of Government

Compliance

Management and administration

Procurement

What the report is about

The Government Advertising Act 2011 requires the Auditor-General to undertake a performance audit on government advertising activities each financial year.

This audit examined whether TAFE NSW's annual advertising campaign in 2021–22:

was carried out effectively, economically, and efficiently
complied with regulatory requirements and the Government Advertising Guidelines.

What we found

TAFE NSW complied with Section 6 of the Act, prohibiting political content.

It also complied with most other advertising requirements.

An important exception was that the Managing Director certified that the campaign complied with regulatory requirements and was an efficient and cost-effective means of achieving its public purpose, before a cost-benefit analysis (CBA) was completed.

We have found issues with agencies complying with CBA requirements in previous government advertising audits. This includes the failure to complete them before signing compliance certificates.

The policy owner, the Department of Customer Service (DCS), does not consider oversight of CBAs to be within the scope of their peer review process.

TAFE NSW evaluated this advertising campaign by surveying a population significantly broader than the target audience. As such, survey results may not accurately reflect the views of the intended audience.

What we recommended

By 30 June 2023, TAFE NSW should:

implement processes that ensure:
1. CBAs are completed before the launch of campaigns over $1 million
2. compliance certificates are completed only after all regulatory requirements are met
consider adding to its current evaluation methods by surveying a population which closely reflects the age profile of its intended target audience.

By June 2023, DCS should:

improve whole‑of‑government reporting and monitoring processes to provide the NSW Government with a central view of compliance, including the completion of CBAs by agencies.

The Government Advertising Act 2011 (the Act) sets out requirements that must be followed by a government agency when it carries out a government advertising campaign. The requirements include an explicit prohibition on political advertising, as well as a need to complete a peer review and cost-benefit analysis before the campaign commences. The accompanying Government Advertising Regulation 2018 (the Regulation) and Government Advertising Guidelines (the Guidelines) address further matters of detail.

The Act also requires the Auditor-General to conduct a performance audit on the activities of one or more government agencies in relation to government advertising campaigns in each financial year. The performance audit must assess whether a government agency (or agencies) has carried out activities in relation to government advertising campaigns in an effective, economical and efficient manner. It also assesses compliance with the Act, the Regulation, other laws and the Guidelines.

This audit examined TAFE NSW's advertising campaign for the 2021–22 financial year. TAFE NSW is the NSW Government's public provider of vocational education and training. TAFE NSW carries out an advertising campaign every year. In 2021–22, it spent $15.16 million on developing and implementing advertising. TAFE NSW used channels such as television, radio, internet and social media, press, and out of home advertising in public settings such as bus stops. The advertising aimed to increase the percentage of people considering TAFE NSW for training or education, grow the percentage of people who consider TAFE NSW to be the preferred education provider in NSW, and maintain the proportion of people who are aware of TAFE NSW more generally.

There are a range of private service providers helping to deliver vocational education and training in NSW.

Conclusion

TAFE NSW’s advertising campaign for 2021–22 was for an allowed purpose under the Act and did not include political advertising. TAFE NSW complied with most of the requirements set out in the Act, the Regulation, and the Guidelines, but it failed to complete a cost-benefit analysis for the campaign or provide sufficient support for the compliance certificate signed by TAFE NSW's Managing Director.

TAFE NSW complied with the requirement to complete a peer review of its campaign, but it did not meet the requirement to complete a cost-benefit analysis, either before it launched the campaign or during its implementation throughout 2021–22. Some of TAFE NSW's advertising did not meet the requirement for statements to be clearly supported by evidence.

The Act requires the head of an agency to sign a compliance certificate stating that, among other things, the campaign complies with the Act, the Regulation, and the Guidelines, and that the campaign is an efficient and cost-effective means of achieving the public purpose. TAFE NSW's Managing Director signed a compliance certificate in May 2021. However, TAFE NSW had not prepared a cost-benefit analysis as required under the Act and therefore TAFE NSW's Managing Director could not validly sign the compliance certificate. TAFE NSW did not subsequently complete a cost-benefit analysis during the campaign.

The campaign achieved many of its objectives and other performance measures and is likely to have been impactful. It is also likely that TAFE NSW’s advertising campaign in 2021–22 represented economical, efficient, and effective spend. However, the lack of a cost-benefit analysis meant that this could not be confidently demonstrated by TAFE NSW.

TAFE NSW used internal resources to create its advertising content, such as videos, radio scripts and press advertising, and relied upon a specialist partner to arrange and place its media in the appropriate advertising channel. TAFE NSW also adjusted the advertising campaign in response to performance data and in response to changes in the educational and advertising marketplaces.

TAFE NSW evaluated the impact of its advertising and tracked its brand performance using a survey which reflected the New South Wales general population aged between 16 and 60. However, this evaluation did not match TAFE NSW's advertising spend as TAFE NSW directed significantly more of its campaign budget to influencing younger people in this cohort.

This part of the report sets out key aspects of TAFE NSW's compliance with the government advertising regulatory framework. It considers whether TAFE NSW complied with the:

Government Advertising Act 2011
Government Advertising Regulation 2018
NSW Government Advertising Guidelines 2012 and other relevant policy.

This part of the report considers whether TAFE NSW's advertising program for 2021–22 was carried out in an effective, efficient, and economical manner.

Appendix two – About the campaign

Appendix one – Response from agencies

Copyright notice

Parliamentary reference - Report number #377 - released 28 February 2023

20 December 2022

Published

Coordination of the response to COVID-19 (June to November 2021)

Premier and Cabinet

Community Services

Health

Justice

Whole of Government

Internal controls and governance

Risk

Service delivery

Shared services and collaboration

What the report is about

This audit assessed the effectiveness of NSW Government agencies’ coordination of the response to COVID-19, with a focus on the Delta variant outbreak in the Dubbo and Fairfield Local Government Areas (LGA) between June and November 2021. We audited five agencies - the Department of Premier and Cabinet, NSW Health, the NSW Police Force, Resilience NSW and the Department of Customer Service.

The audit also considered relevant planning and preparation activities that occurred prior to June 2021 to examine how emergency management and public health responses learned from previous events.

What we found

Prior to Delta, agencies developed capability to respond to COVID-19 related challenges.

However, lessons learned from prior reviews of emergency management arrangements, and from other jurisdictions, had not been implemented when Delta emerged in June 2021. As a result, agencies were not as fully prepared as they could have been to respond to the additional challenges presented by Delta.

Gaps in emergency management plans affected agencies' ability to support individuals, families and businesses impacted by restrictions to movement and gathering such as stay-at-home orders. In LGAs of concern, modest delays of a few days had a significant impact on people, especially those most vulnerable.

On 23 July 2021, the NSW Government established a cross-government coordinating approach, the Delta Microstrategy, which complemented existing emergency management arrangements, improved coordination between NSW Government agencies and led to more effective local responses.

Where possible, advice provided to government was supported by cross-government consultation, up-to-date evidence and insights. Public Health Orders were updated as the response to Delta intensified or to address unintended consequences of previous orders. The frequency of changes hampered agencies' ability to effectively communicate changes to frontline staff and the community in a rapidly evolving situation.

The NSW Government could provide greater transparency and accountability over decisions to apply Public Health Orders during a pandemic.

What we recommended

The audit made seven recommendations intended to improve transparency, accountability and preparedness for future emergency events.

This audit assessed the effectiveness of NSW Government agencies’ coordination (focused on the Department of Premier and Cabinet, NSW Health, the NSW Police Force, Resilience NSW and the Department of Customer Service) of the COVID-19 response in selected Local Government Areas (Fairfield City Council and Dubbo Regional Council) between June and November 2021.

As noted in this report, Resilience NSW was responsible for the coordination of welfare services as part of the emergency management arrangements. On 16 December 2022, the NSW Government abolished Resilience NSW.

During the audited period, Resilience NSW was tasked with supporting the needs of communities subject to stay-at-home orders or stricter restrictions and it provided secretariat support to the State Emergency Management Committee (SEMC). The SEMC was, and remains, responsible for the coordination and oversight of emergency management policy and preparedness.

Our work for this performance audit was completed on 15 November 2022, when we issued the final report to the five audited agencies. While the audit report does not make specific recommendations to Resilience NSW, it does include five recommendations to the State Emergency Management Committee. On 8 December 2022, the then Commissioner of Resilience NSW provided a response to the final report, which we include as it is the formal response from the audited entity at the time the audit was conducted.

The community of New South Wales has experienced significant emergency events during the past three years. COVID-19 first emerged in New South Wales after bushfire and flooding emergencies in 2019–20. The pandemic is now into its third year, and there have been further extreme weather and flooding events during 2021 and 2022.

Lessons taken from the experience of these events are important to informing future responses and reducing future risks to the community from emergencies.

This audit focuses on the NSW Government's response to the COVID-19 pandemic, and in particular, the Delta variant (Delta) that occurred between June and November 2021. The response to the Delta represents six months of heightened challenges for the NSW Government.

Government responses to emergencies are guided by legislation. The State Emergency and Rescue Management Act 1989 (SERM Act) establishes emergency management arrangements in New South Wales and covers:

coordination at state, regional and local levels through emergency management committees
emergency management plans, supporting plans and functional areas including the State Emergency Management Plan (EMPLAN)
operations centres and controllers at state, regional and local levels.

This audit focuses on the activities of five agencies during the audit period:

The NSW Police Force led the emergency management response and was responsible for coordinating agencies across government in providing the tactical and operational elements that supported and enhanced the health response to the pandemic. The NSW Police Force also led the compliance response which enforced Public Health Orders and included household checks on those required to isolate at home after testing positive to COVID-19. In some parts of NSW, they were supported by the Australian Defence Force in this role.
NSW Health was responsible for leading the health response which coordinated all parts of the health system, initially to prevent, and then to manage, the pandemic.
Resilience NSW coordinated welfare services as part of the emergency management arrangements and provided secretariat support to the State Emergency Management Committee (SEMC). The SEMC is responsible for the coordination and oversight of emergency management policy and preparedness. Resilience NSW was also tasked with supporting the needs of communities subject to stay-at-home orders or stricter restrictions.
The Department of Customer Service (DCS) was responsible for the statewide strategic communications response.
The Department of Premier and Cabinet (DPC) held a key role in providing policy and legal services, as well as supporting the coordination of activity across a range of functional areas and decision-making by our State’s leaders.

This audit assessed the effectiveness of NSW Government agencies’ coordination (focused on the Department of Premier and Cabinet, NSW Health, the NSW Police Force, Resilience NSW and the Department of Customer Service) of the COVID-19 response in selected Local Government Areas (LGA) (Fairfield City Council and Dubbo Regional Council) after June 2021.

The audit investigated whether:

government decisions to apply LGA-specific Public Health Orders were supported by effective crisis management governance and planning frameworks
agencies effectively coordinated in the communication (and enforcement) of Public Health Orders.

While focusing on the coordination of NSW Government agencies’ response to the Delta variant in June through to November 2021, the audit also considered relevant planning and preparation activities that occurred prior to June 2021 to examine how emergency management and public health responses learned from previous events.

This audit does not assess the effectiveness of other specific COVID-19 responses such as business support. It refers to the preparedness, planning and delivery of these activities in the context of supporting communities in selected LGAs. NSW Health's contribution to the Australian COVID-19 vaccine rollout was also subject to a separate audit titled 'New South Wales COVID-19 vaccine rollout' tabled in NSW Parliament on 7 December 2022.

This audit is part of a series of audits which have been completed, or are in progress, regarding the New South Wales COVID-19 emergency response. The Audit Office of New South Wales '2022–2025 Annual Work Program' details the ongoing focus our audits will have on providing assurance on the effectiveness of emergency responses.

In this document Aboriginal refers to the First Nations peoples of the land and waters now called Australia, and includes Aboriginal and Torres Strait Islander peoples.

Conclusion

Prior to June 2021, agencies worked effectively together to adapt and refine pre-existing emergency management arrangements to respond to COVID-19. However, lessons learned from prior reviews of emergency management arrangements, and from other jurisdictions, had not been implemented when Delta emerged in June 2021. As a result, agencies were not as fully prepared as they could have been to respond to the additional challenges presented by Delta.

In the period March 2020 to June 2021, the State's Emergency Management (EM) arrangements coordinated the New South Wales emergency response to COVID-19 with support from the Department of Premier and Cabinet (DPC) which led the cross-government COVID-19 Taskforce. NSW Government agencies enhanced the EM arrangements, which until then had typically been activated in response to natural disasters, to meet the specific circumstances of the pandemic.

However, the State Emergency Management Committee (SEMC), supported by Resilience NSW, did not address relevant recommendations arising from the 2020 Bushfires Inquiry before June 2021 and agencies did not always integrate lessons learned from other jurisdictions or scenario training exercises into emergency management plans or strategies before Delta. As a result, deficiencies in the EM arrangements, including representation of vulnerable communities on EM bodies, well-being support for multicultural communities in locked down environments and cross-agency information sharing, persisted when Delta emerged in June 2021.

It should be noted that for the purposes of this audit there is no benchmark, informed by precedent, that articulates what level of preparation would have been sufficient or proportionate. However, the steps required to address these gaps were reasonable and achievable, and the failure to do so meant that agencies were not as fully prepared as they could have been for the scale and escalation of Delta’s spread across the State.

The Delta Microstrategy complemented the EM arrangements to support greater coordination and agencies are working to improve their capability for future events

The Delta Microstrategy (the Microstrategy) led to innovations in information sharing and collaboration across the public service. Agencies involved in the response have completed, or are completing, reviews of their contribution to the response. That said, none of these reviews includes a focus on whole-of-government coordination.

On 23 July 2021, the NSW Government approved the establishment of the Microstrategy to respond to the additional challenges presented by Delta including the need to support communities most impacted by restrictions to movement and gathering in the LGAs of concern. An extensive range of government agencies were represented across eight Microstrategy workstreams, which coordinated with the existing EM arrangements to deliver targeted strategies to communities in high-risk locations and improve data and information sharing across government. This enhanced the public health, compliance, income and food support, communications and community engagement aspects of the response.

Agencies also leveraged learnings from early weeks of the Delta wave and were able to replicate those lessons in other locations. The use of pre-staging hubs in Fairfield to support food and personal hamper distribution was used a month later in Dubbo which acted as a central hub for more remote parts of the State.

Emergency management plans did not enable government to respond immediately to support vulnerable communities in high-risk LGAs or regional NSW

There are gaps in the emergency management plans relating to the support for individuals, families and businesses impacted by the stay-at-home orders and other restrictions to movement and gathering. These gaps affected agencies' ability to respond immediately when the need arose during Delta.

Emergency management plans and supporting instruments did not include provision for immediate relief for households, which meant arrangements for isolation income support and food security measures had to be designed in the early stages of Delta before it could be approved and deployed.

There were delays – sometimes only days, on occasion, weeks - in providing support to affected communities. In particular, there were delays to the provision of income support and in scaling up efforts to coordinate food and grocery hampers to households in isolation. In LGAs of concern, modest delays of a few days had a significant impact on people, especially those most vulnerable.

Although government issued stricter restrictions for workers in the Fairfield LGA on 14 July 2021, it only approved targeted income support for people in LGAs of concern on 16 August 2021.

Overall, agencies coordinated effectively to provide advice to government but there are opportunities to learn lessons to improve preparedness for future events

Agencies coordinated in providing advice to government. The advice was supported by timely public health information, although this was in the context of a pandemic, where data and information about the virus and its variants was changing regularly. However, agencies did not always consider the impact on key industries or supply chains when they provided advice to government, which meant that Public Health Orders would sometimes need to be corrected.

Public Health Orders were also updated as the response to Delta intensified or to address unintended consequences of previous orders. The frequency of changes hampered agencies' ability to effectively communicate changes to frontline staff and the community in a rapidly evolving situation.

The audit identified several occasions where there were delays, ranging from three to 21 days, between the provision of advice to government and subsequent decision-making (which we have not detailed due to the confidentiality of Cabinet deliberations). Agency officers advised of instances where they were not provided sufficient notice of changes to Public Health Orders to organise local infrastructure (such as traffic support for testing clinics) to support compliance with new requirements.

The COVID-19 pandemic arrived in Australia in late January 2020 as the bushfire and localised flooding emergencies were in their final stages. Between 2020 and mid-2021, agencies responded to the initial variants of COVID-19, managed a border closure with Victoria that lasted nearly four months and dealt with localised ‘flare-ups’ that required postcode-based restrictions on mobility in northern parts of Sydney and regional New South Wales. During this period, New South Wales had the opportunity to learn from events in Victoria which imposed strict restrictions on mobility across the State and the growing emergence of the Delta variant (Delta) across the Asia Pacific.

This section of the report assesses how emergency management and public health responses adapted to these lessons and determined preparedness for, and responses to, widespread community transmission of Delta in New South Wales.

The previous chapter discusses how agencies had refined the existing emergency management arrangements to suit the needs of a pandemic and describes some gaps that were not addressed. This chapter explores the first month of Delta (mid-June to mid-July 2021). It explores the areas where agencies were prepared and responses in place for the outbreak. It also discusses the impact of the gaps that were not addressed in the period prior to Delta and other issues that emerged.

NSW Health provided advice on the removal of restrictions based on up-to-date advice

The NSW Government discussed the gradual process for removing restrictions using the Doherty Institute modelling provided to National Cabinet on 10 August 2021. NSW Health highlighted the importance of maintaining a level of public health and safety measure bundles to further suppress case numbers. This was based on additional modelling from the Doherty Institute.

The Department of Regional NSW led discussion and planning around reopening with a range of proposal through August and September 2021. The Department of Premier and Cabinet and NSW Health jointly developed a paper to provide options on the restrictions when the State reached a level of 70% double dose vaccinations.

The roadmap to reopening was originally published on 9 September 2021. However, by 11 October 2021, the restrictions were relaxed when the 70% double dose threshold was reached to allow:

up to ten fully vaccinated visitors to a home (increased from five)
up to 30 fully vaccinated people attending outdoor gatherings (increased from 20)
weddings and funerals limits increased to 100 people (from 50)
the reopening of indoor pools for training, exercise and learning purposes only.

On the same day, the NSW Government announced further relaxation of restrictions once the 80% double dose threshold was reached. These restrictions were further relaxed on 8 November 2021. This included the removal of capacity restrictions to the number of visitors to a private residence, indoor pools to reopen for all purposes and density limits of one person for every two square metres, dancing allowed in nightclubs and 100% capacity in major stadia.

The NSW Government allowed workers in regional areas who received one vaccination dose to return to their workplace from 11 October 2021.

The Premier extended the date of easing of restrictions for unvaccinated people aged over 16 from 1 December to 15 December 2021.

Many agencies have undertaken reviews of their response to the Delta outbreak but a whole-of-government review has yet to be conducted

Various agencies and entities associated with the response to the Delta outbreak conducted after-action review processes. These processes assessed the achievements delivered, lessons learned and opportunities for improvement. However, a whole-of-government level review has not been conducted. This limits the New South Wales public service's ability to improve how it coordinates responses in future emergencies.

The agencies/entities that conducted reviews included:

South West Metropolitan region, Western NSW region, Fairfield Local Emergency Management Committee (LEMC), Dubbo Local Emergency Operations Controller (LEOCON), which were collated centrally by the State Emergency Operations Centre (SEOC)
Aboriginal Affairs NSW assessed representation and relevance of the emergency management arrangements for Aboriginal communities following the 2019 bushfires
Resilience NSW developed case studies to capture improved practice with regard to food security and supply chains
a community support and empowerment-focused after-action review undertaken by the Pillar 5 workstream of the Microstrategy.

Key lessons collated from the after-action reviews include:

the impact of variation in capability across agencies on the management of key aspects of the response including welfare support and logistics
issues with boundary differences between NSW Police Force regions, local government areas (LGA and local health districts (LHD) caused issues in delivering and coordinating services in an emergency situation
the need to improve relationships between state and local Government outside of acute emergency responses to improve service delivery
issues arising from impediments to information sharing between agencies and jurisdictions, such as:
- timeliness and accuracy of data used to direct compliance activities
- the impact of insufficient advance notice on changes to Public Health Orders
- timely access to data across public sector agencies and other jurisdictions to inform decision-making, analysis and communications
- gaps in data around ethnicity, geolocation of recent positive cases and infection/vaccination rates in Aboriginal communities.
the lack of Aboriginal community representation on many LEMCs
compared with the response to COVID-19 in 2020, improved coordination of communications with Culturally and Linguistically Diverse (CALD) populations with a reduction in overlapping messages and over-communication
improved attendance from agency representatives in LEMCs, and regional emergency operations centres (REOC) to improve interagency communications, planning, capability development and community engagement issues
deficiencies in succession planning and fatigue management practices
the potential for REOC Welfare/Well-being subgroups to be included as part of the wider efforts to community needs during emergencies.

NSW Health commenced a whole of system review of its COVID-19 response in May 2022. At the time of writing, the completion due date for the debrief is 7 November 2022. This debrief is expected to explore:

governance
engagement
innovation and technology
community impact
workforce impact
system impact and performance.

NSW Health is also undertaking a parallel Intra-Action Review that is focused on the public health aspects of the response with finalisation estimated for the end of November 2022. At the time of completing this performance audit report, NSW Health had not finalised these reviews and, as a result, we cannot validate their findings against our own observations.

Recent inquiries are likely to impact the governance of emergency management in New South Wales

In March 2022, the NSW Government established an independent inquiry to examine and report on the causes of, preparedness for, response to and recovery from the 2022 floods. The Flood Inquiry report made 28 recommendations, which the NSW Government supported in full or in principle. Some of the recommendations relate directly to the governance and leadership of emergency management arrangements in New South Wales.

The State Emergency Management Committee (SEMC) will likely be involved in, and impacted by, the recommendations arising from the Flood Inquiry with potential changes to its membership and reshaping of functional areas and agencies. At the same time, the SEMC may have a role in overseeing the changes that emerge from the SEOC consolidated after-action reviews. This can also extend to ensuring local and regional bodies have incorporated the required actions. There is a risk that the recommendations from the pandemic-based after-action reviews may not be considered due to the priority of action resulting from the Flood Inquiry.

Furthermore, there is potential for the SEMC to work with NSW Health during its system-wide review. Such an approach is likely to improve preparedness for future events.

Appendix two – Chronology 2020–2021

Copyright notice

Parliamentary reference - Report number #371 - released 20 December 2022

7 December 2022

Published

New South Wales COVID-19 vaccine rollout

Health

Internal controls and governance

Management and administration

Project management

Risk

Service delivery

What the report is about

The Australian Government led and implemented the Australian COVID-19 vaccine rollout, with the support of state and territory governments. As part of the Australian Government's vaccine rollout, NSW Health launched its vaccination program on 22 February 2021, with responsibility for distributing and administering COVID-19 vaccine stock provided by the Australian Government.

This audit examined the period 1 January 2021 to 31 December 2021 and focused on NSW Health's contribution to the Australian Government led vaccine roll out in four Local Health Districts (LHDs), in particular the administration of two doses of vaccine to people aged 16 and over.

What we found

On 16 October 2021, NSW Health, in partnership with the Australian Government's vaccination program, achieved its first objective to fully vaccinate 80% of people in NSW aged 16 and over. Demand for the vaccine reduced in December 2021, and NSW Health did not reach its target of 95% fully vaccinated for people aged 16 and over until June 2022.

Despite challenges such as uncertain supply and changes to clinical advice affecting vaccine eligibility, NSW Health's overall delivery of vaccination services was effective and efficient.

During the audit period, NSW Health implemented effective strategies to allocate vaccines and reduce wastage to optimise the number of vaccines available.

NSW Health implemented its own booking system after it identified that the Australian Government's system would not manage bookings. There were problems with NSW Health's interim vaccine booking system, and NSW Health fully resolved these issues by September 2021.

As at 19 October 2022, vaccination rates for Aboriginal peoples and culturally and linguistically diverse people remained below the 95% target.

What we recommended

By June 2023, NSW Health should conduct a comprehensive review of the COVID-19 vaccine rollout and incorporate lessons learned into pandemic response plans.

The first three cases of COVID-19 in New South Wales were diagnosed in January 2020. By 30 June 2021, 128 people were being treated in hospital and one person was in intensive care. By the end of December 2021, 187,504 total cases and 663 deaths were reported in New South Wales. As at 27 October 2022, NSW Health reported more than three million total cases and 5,430 deaths.

The COVID-19 pandemic continues to have a significant impact on the people and the health sector of New South Wales. The Australian, state, territory, and local governments have directed significant resources towards health responses and economic recovery.

On 13 November 2020, National Cabinet (comprised of the Australian, state, and territory governments) endorsed the Australian COVID-19 Vaccination Policy. Australia's vaccination program was launched on 21 February 2021 with the goal of providing safe and effective vaccines to the people who most needed them as quickly as possible, to support the physical, mental and economic wellbeing of the nation.

The Australian Government led and implemented the Australian vaccine rollout, with the support of state and territory governments. As part of the Australian Government's vaccine rollout, NSW Health launched its vaccination program on 22 February 2021, with responsibility for distributing and administering COVID-19 vaccine stock provided by the Australian Government.

The overall objective of this audit was to assess the effectiveness and efficiency of NSW Health’s contribution to the Australian COVID-19 vaccine rollout. It is important to note that in New South Wales, primary care providers (GPs and pharmacies) and aged care providers administered the majority of vaccines. Primary care providers and aged care providers are the responsibility of the Australian Government.

The audit had a particular focus on whether NSW Health:

set clear vaccination targets underpinned and/or guided by evidence
managed the rollout of the vaccination program effectively and efficiently
managed demand of vaccines effectively and efficiently.

The audit examined the period 1 January 2021 to 31 December 2021 and focused on NSW Health's contribution to the Australian Government led vaccine rollout in four Local Health Districts (LHDs), in particular the administration of two doses of vaccine to people aged 16 and over. We did not audit the subsequent rollout for ages five to 15, or the booster rollout (third and fourth doses) as these activities mostly occurred outside the date of our review.

This audit also did not assess the Australian Government’s allocation of vaccine supplies to New South Wales because we do not audit the Australian Government's activities. On 17 August 2022, the Australian National Audit Office completed a performance audit which assessed the Australian Department of Health and Aged Care's effectiveness in the planning and implementation of Australia's COVID-19 vaccine rollout.

This audit is one of a series of audits that have been completed or are in progress regarding the New South Wales COVID-19 emergency response. This includes the planned performance audit ‘Coordination of the response to COVID-19 (June to November 2021)’, and financial audit assurance activities focusing on Local Health District processes and controls to manage the receipt, distribution and inventory management of vaccine stock. The Audit Office New South Wales '2022–25 Annual Work Program' details the ongoing focus our audits will have on providing assurance on the effectiveness of emergency responses.

Conclusion

By 12 December 2021, NSW Health had administered two doses of vaccines to one third of eligible people in New South Wales aged 16 and over – contributing significantly to the achievement of the NSW Government vaccination target of 80% fully vaccinated before 31 December 2021. Despite challenges such as uncertain supply and changes to clinical advice affecting vaccine eligibility, NSW Health's overall delivery of vaccination services was effective and efficient.

Vaccination levels in some vulnerable populations remain below the 95% double dose target currently in place. Access to quality data to regularly measure vaccination rates in some vulnerable populations remains an ongoing challenge for the NSW and Australian Governments. As a result, NSW Health is unable to fully ensure it has delivered on its shared responsibility with the Australian Government to vaccinate vulnerable people.

NSW Health managed challenges regarding the uncertain supply of vaccines from the Australian Government and filled gaps beyond its agreed responsibilities in the National Partnership on COVID-19 Response. During the Delta outbreak of the pandemic, NSW Health sought to achieve the best possible public health outcome from limited vaccine supply by opening up additional vaccination clinics in highly affected areas and redistributing vaccine supplies from areas with fewer cases to highly affected local government areas in south west Sydney.

During the audit period, NSW Health implemented effective strategies to allocate vaccines and reduce wastage to optimise the number of vaccines available. Our financial audit report, 'Health 2022', includes additional information on vaccine supply stock held by NSW Health.

NSW Health demonstrated agility by using a range of strategies to promote vaccination, including direct engagement with communities to develop culturally appropriate services such as pop-up clinics. NSW Heath recruited prominent community members, such as faith leaders, elders and sportspeople, to promote vaccination within their communities. However, at the date of this report, there are still vulnerable populations with vaccination rates lower than the current 95% double dose vaccination target. There is also a lack of regularly updated data for some cohorts which prevents NSW Health from accurately monitoring vaccination rates in some populations it has identified as vulnerable.

In March 2021, NSW Health identified that the booking system provided by the Australian Government was an online directory of vaccine clinics and would not manage bookings. To overcome this, NSW Health amended an internal-use system to be publicly facing. This solution was not user-friendly for staff or those seeking to make an appointment. Between June to September 2021, NSW Health progressively resolved booking system related issues, by developing and rolling out a new purpose-built booking solution for NSW Health vaccination clinics.

Appendix two – Australian audits on the vaccine rollouts

Appendix three – Committee members

Appendix four – About the audit

Appendix five – Performance auditing

Copyright notice

Parliamentary reference - Report number #369 - released 7 December 2022

27 September 2022

Published

Student attendance

Education

Management and administration

Service delivery

What the report is about

Poor attendance at school is related to poor student outcomes, particularly once patterns of non-attendance have been established.

This report examined how the NSW Department of Education (the department) is managing student attendance in NSW government schools.

What we found

Around a third of students in Years 1–10 attended school less than 90% of the time in semester one, 2021. Missing more than 10% of school may put a student's educational outcomes at risk.

Since 2018, the department has improved the quality of student attendance data, analysis and reporting. However, there are still gaps in understanding the reasons for absence at a system level.

The department set state-wide and school-level targets to increase the proportion of students attending school at least 90% of the time. This emphasis risks diverting attention away from students with very low attendance rates.

There are gaps in central programs to support schools in lifting student attendance. Schools are taking a variety of approaches to this work.

There is a large gap in attendance between Aboriginal and non-Aboriginal students, which has increased since 2018.

What we recommended

The Department of Education should:

set new state-wide and school level attendance targets
evaluate its attendance support programs
update its attendance strategies and programs
publish the attendance level for each school in their annual reports
improve internal analysis and reporting of attendance data
finalise the review of the attendance policy, procedure and codes
review programs supporting Aboriginal student attendance and address any gaps
review the approach to enforcing compulsory school attendance.

Fast facts

90% - attending school less than 90% of the time can put a student's educational outcomes at risk
67.9% of Year 1–10 students in NSW government schools attended at least 90% of the time in semester one, 2021
42.7% of Aboriginal Year 1–10 students in NSW government schools attended school at least 90% of the time in semester one, 2021.

Regular attendance at school is important for academic and other long-term outcomes. Students who do not attend regularly are less likely to complete school and more likely to experience poorer long-term health and social outcomes. A range of factors influence student attendance including student engagement and wellbeing, family and community factors and the school environment.

The NSW Department of Education's (the department's) Strategic Plan for 2018–2022 identifies improving student attendance as a priority. It has identified 95% as its expected level of attendance. It set targets to increase the proportion of students attending school at least 90% of the time, from 79.4% to 82% in primary schools and 64.5% to 70% for secondary schools.

This report focuses on attendance data for semester one of 2018, 2019 and 2021. Unless otherwise noted, attendance data refers to Years 1–10 in alignment with national reporting conventions. Changes in recording systems and definitions mean attendance data prior to 2018 is not comparable. Attendance data for semester one of 2020 and 2022 was significantly affected by COVID-related disruptions, which prevented many students across the State from attending school. Data for semester one of 2021 is considered relatively less affected by COVID-related disruptions.

The Education Act 1990 (the Act) sets out the responsibilities of students, parents and the department for ensuring students receive compulsory schooling. The department has developed policies, procedures and guidance to assist schools in managing their responsibilities to promote regular attendance. In this report, we define 'regular' attendance as at least 90% of the time. This is equivalent to missing one day of school each fortnight or four weeks of school across a school year.

The objective of this audit was to assess whether student attendance is effectively managed in NSW government schools for students from kindergarten to Year 10. In making this assessment, the audit examined whether:

there are effective systems and policies for managing student attendance
the department effectively supports schools to manage student attendance
schools are effectively managing student attendance.

Conclusion

There are too many students in NSW Government schools who regularly miss school. In semester one of 2021, around a third of students in Years 1–10 attended school less than 90% of the time — a level that puts their educational outcomes at risk. Attendance problems are widespread. 775 of 2,200 schools in NSW had an average attendance rate below 90% in 2021. Aboriginal student attendance is significantly below non-Aboriginal students and there is no specific strategy to address this gap. The department needs to place greater attention on supporting schools to lift student attendance.

Good quality data on attendance patterns is critical to developing strategies to address the underlying reasons for absence. The quality of the department's data on student attendance has improved from 2018. This has allowed it to monitor attendance more closely throughout the year, rather than relying on a yearly collection. However, there are still gaps in capturing and analysing the reasons for absence.

The improved data collection allowed the department to begin reporting on the 'attendance level' for the first time in 2018. This measures the proportion of students attending more than 90% of the time. The department has set state-wide and school-level targets to improve the attendance level. The new targets have influenced the focus of strategies to lift attendance. There is now a greater focus on lifting students above the reportable benchmark of 90% rather than addressing more serious attendance concerns.

The School Success Model formalises the focus on achieving school-level targets. When introduced, the department stated that schools would receive targeted support as part of the rollout of the model. Targeted support for attendance was initially planned to be delivered in late 2021 but was delayed due to the impact of COVID. The two main attendance support programs do not cater to schools with fewer than 100 students and there are gaps in support due to two different methodologies being used to select schools.

The Home School Liaison Program is a longstanding program to support students with low attendance. Requests for support are rationed pending availability of case officers, which leads to younger students being prioritised. Older students are not supported because there is a lower chance of prosecution in the legal system if attendance is not restored by the program. There is insufficient monitoring of the adequacy of resources, activities and long-term outcomes of this program.

The department's Aboriginal Education Policy aims to have Aboriginal students matching or exceeding outcomes of non-Aboriginal students. In semester one, 2021 42.7% of Aboriginal students attended school regularly (at least 90% of the time) compared with 70.3% of non-Aboriginal students. The gap in attendance between Aboriginal and non-Aboriginal students has grown since 2018. There are relatively new programs supporting Aboriginal students in secondary school to attain their Higher School Certificate, but greater attention should be placed on supporting attendance for Aboriginal students in primary schools.

Schools are using a wide range of strategies to improve student attendance depending on their local contexts. Schools we spoke with told us of allocating responsibility to key staff members, closer monitoring of data, community engagement, rewards and incentives, before school sporting and breakfast programs, and partnerships with external agencies. The school planning and annual reporting process prompts schools to evaluate the impact of their strategies on progress towards their targets. The department could do more to promote evidence-based programs, showcase better practice examples from schools in NSW and identify the circumstances where these approaches are most effective.

This chapter considers the effectiveness of systems to accurately collect, analyse and report student attendance data. It also considers the effectiveness of policies and procedures to support attendance and central oversight of attendance issues.

This chapter considers the effectiveness of the department's strategies to improve student attendance and the support it provides to schools to achieve this. It also considers the effectiveness of school-level strategies and actions for students with low attendance.

Copyright notice

Parliamentary reference - Report number #368 - released 27 September 2022

15 December 2021

Published

COVID Intensive Learning Support Program

Education

Management and administration

Project management

Service delivery

Workforce and capability

What the report is about

This audit examined a state-wide program to provide small-group tuition to students disadvantaged by the move to learning from home during 2020.

The audit assessed the design and implementation of the program.

What we found

The program design was based on research and data showing learning loss during 2020.

The department rapidly planned and developed the policy design and guidelines for schools.

Governance arrangements matured during program delivery.

The department changed the models for funding schools but did not clearly explain the reasons for doing so.

Government schools with over 900 students were disadvantaged by the funding model compared to smaller schools.

Guidelines, resources and professional learning helped schools implement the program.

Staff eligibility for the program was expanded after reported difficulties in recruiting qualified teachers in some areas.

Online tuition and third-party provider options were developed throughout the program.

There were issues with the quality and timeliness of data used to monitor school progress.

Evaluation arrangements were developed early in the program.

Data limitations mean the evaluation will not be able to fully assess all program objectives.

What we recommended

Distributing funds between schools more equitably and improving communication of the funding methods.
Clearer communication about the intended targeted group of students.
Reviewing the time needed to administer the program.
Improve support for educators other than qualified teachers.
Offer the online tuition program to more schools.
Analysis of the effects of learning from home during 2021 across equity groups and geographic areas.
Working with universities to increase use of pre-service teachers in the program.

The report also identifies lessons learned for future programs.

Fast facts

$337m in total program funding. $289 million for government schools and $31 million for non government schools
12 days to develop the policy and provide costings to Treasury
290,000 targeted students in government schools and 31,000 in non government schools
80% of schools were providing small group tuition by the target start date of Week 6, Term 1
2–4 months was the estimated student learning loss from the move to learning from home during 2020
7,600 tutors engaged in the program as at September 2021.

The NSW Government announced the COVID Intensive Learning Support Program on 10 November 2020, as part of the 2020–21 NSW Budget. The primary goal of the $337 million program was to deliver intensive small group tuition for students who were disadvantaged by the move to remote and/or flexible learning, helping to close the equity gap. It included:

$306 million to provide small-group tuition for eligible students across every NSW Government primary, secondary and special purpose school
$31.0 million for around 400 non-government schools to provide small-group tuition to students with the greatest levels of need.

The objective of this audit was to assess the effectiveness of the design and implementation of the COVID Intensive Learning Support Program (the program). To address this objective, the audit assessed whether the Department of Education (the department):

effectively designed the program and supporting governance arrangements
is effectively implementing the program.

This audit focuses on activities between October 2020 and August 2021, which aimed to address the first session of learning from home in New South Wales. From August to October 2021, students in many areas of New South Wales were learning from home again, but this second period has not been a focus of this audit. On 18 October 2021, the NSW Government announced the program would be extended into 2022.

Conclusion

The COVID Intensive Learning Support Program was effectively designed to help students catch up on learning loss due to the interruptions to schooling caused by COVID-19. The department rapidly stood up a taskforce to implement the program and then developed supporting governance arrangements during implementation.

Most students in New South Wales were required to learn from home for at least seven weeks during 2020 due to the impact of the Novel-Coronavirus (COVID-19). The department researched, analysed and advised government on several options to address the learning loss that resulted. It recommended small group tuition as the preferred option as it was supported by available evidence and could be rolled out at scale with speed. It identified risks of ensuring an adequate supply of educators and options to address those risks. Consistent with its analysis of where the impact of the learning loss was most severe, the department proposed to direct funding to schools with higher concentrations of students from the most disadvantaged backgrounds.

The department established a cross-functional taskforce to conduct detailed planning and support program implementation. Short timeframes meant the taskforce initially sought approval for key decisions from the program sponsor and existing oversight bodies on an as-needed basis before dedicated program governance arrangements were formalised. Once established, the governance body met regularly to oversee program delivery.

The COVID Intensive Learning Support Program is being effectively implemented. The department has refined the program during rollout to respond to risks, issues and feedback from schools. Issues with how schools enter data into department systems have affected the timeliness and accuracy of program monitoring information.

The department provided schools with guidelines, example models of delivery, systems to record student progress and professional learning. Around 80 per cent of schools had begun delivering tuition under the program by the target date. Schools reported issues with sourcing qualified teachers as a key reason they were unable to start the program by the expected date. In response, the department expanded the type of staff schools could employ, developed an online tuition program, and allowed schools to engage third-party providers to help schools that had difficulty finding qualified teachers for the program.

The department used existing systems to monitor school progress in implementing the program. This reduced the administrative burden on schools, but there were several issues with data quality and timeliness. The program included a mid-year review point to check whether schools were on track to spend their funding. This helped focus schools on ensuring funding would be spent and allowed for redistribution between schools.

The department considered program evaluation early in policy design and planning. It embedded an evaluator on the taskforce and expanded a key assessment program to help provide evidence of impact. A process and outcome evaluation is underway which will help inform future delivery. The evaluation will examine educational impacts for students participating in the program but it has not established methods to reliably assess the extent to which the program has met a goal to help 'close the equity gap' for students.

This chapter considers how effectively the COVID Intensive Learning Support Program (the program) was designed and planned for implementation.

This chapter considers how effectively the COVID Intensive Learning Support Program was implemented over our period of review (Terms 1 and 2, 2021).

Appendix one – Response from agencies

Copyright notice

Parliamentary reference - Report number #358 - released (15 December 2021).

23 September 2021

Published

Access to health services in custody

Health

Justice

Management and administration

Service delivery

What the report is about

This audit assessed whether adults in custody have effective access to health services. The audit examined the activities of Justice Health and Corrective Services NSW.

What we found

The majority of custodial patients receive timely health care, but a small proportion of patients are not receiving care within target timeframes.

Eleven per cent of scheduled health appointments are not attended, and agencies can do more to understand the reasons for non-attendance.

Demand for mental health care exceeds service capacity and some patients are held in environments not appropriate for their needs.

Justice Health's information systems do not support the effective transfer of medical records as patients move around the prison network.

Not all patients are released from custody with a discharge plan.

Justice Health's system managers do not receive sufficiently detailed reports to understand strategic risks or opportunities to improve access to health services.

Public and private prison health operators do not report against consistent performance measures.

Justice Health is mandated to assess health services in private prisons. This conflicts with its role as a contracted provider of health services in the private prison system.

What we recommended

Enhanced reporting on patient access to health services, to identify risks and challenges across key service areas.

Identification and implementation of the improvements required for information to be shared across the custodial network and with external health providers.

Development of a framework to govern and monitor costs for patient health escorts and movements.

Development of a framework to govern responsibilities for mental health services.

Progression of infrastructure plans that address the lack of specialist accommodation for mental health patients and aged and frail patients.

Collaboration to align the performance measures to enable benchmarking between public and private prison health services.

Action to remediate the conflicting monitoring arrangements of public and private prison health operators.

Fast facts

13,063 adults in the NSW prison population at 31 March 2021
31,750 unique adult patients provided with medical care in 2020
770,000 occasions of medical care provided by Justice Health in 2020
50% of all health treatment in prisons is provided to patients who receive immediate medical attention
60,000 appointments for health care in prisons were not attended in 2020
94,810 occasions of psychology service provided by Corrective Services in 2020

Access to health services in custody

This audit examined whether adults in the New South Wales public prison system have effective access to health services. In making this assessment, we considered whether Justice Health and Corrective Services NSW effectively cooperate and coordinate so that patients have timely access to health services, systems and practices support continuity of care, and access to health services is monitored and reviewed.

As part of this audit, we assessed actions undertaken by Justice Health and Corrective Services NSW in managing the first COVID-19 outbreak in 2020. However, due to the timing of this audit report, this audit does not report on the agencies’ response to managing the current outbreak of COVID-19 in September 2021.

Health services in New South Wales prisons are delivered by both public and private operators. The public prison system is made up of 33 correctional centres and the Long Bay Hospital. All health services in the public prison system are delivered by the Justice Health and Forensic Mental Health Network (Justice Health).

In the public prison system, Justice Health is responsible for the clinical care of patients with physical and mental illnesses. Clinicians provide health assessments, treatments, medication management, and some counselling services in prison health clinics. Patients are triaged by primary health nurses and if they require treatments or medication, they are referred to prison‑based doctors including specialists or other clinicians. Patients requiring complex or emergency care are transferred to hospitals or other specialty services outside the prison complex.

Private operators deliver health services in three private prisons through contract arrangements with Corrective Services NSW. Justice Health delivers health care at one correctional centre via a contract arrangement with Corrective Services NSW. In total, contracted health service operators deliver health care to approximately 25 per cent of the New South Wales prison population.

Justice Health is required by law to monitor the performance of contracted health service providers in New South Wales prisons, including services provided at the John Morony Correctional Centre. The Auditor‑General’s mandate does not permit a direct examination of information held by private sector entities, however this audit does assess the effectiveness of Justice Health's role in monitoring health services in private prisons.

Corrective Services NSW is responsible for security in public prisons, including the facilitation of patient access to health care at prison health clinics and the transfer of patients to hospitals and other health services outside of the prison environment. Corrective Services NSW also delivers behaviour‑based psychology services. Some are delivered as behaviour modification courses that aim to reduce criminal and offending activity amongst the prison population. These programs may be linked to parole or other custodial conditions. Other psychology services include counselling for people with self‑harming or suicidal behaviours.

Research from the Australian Institute of Health and Welfare indicates that people in custody are more likely than the general population to be affected by chronic and acute illnesses, including higher rates of mental illness and communicable diseases¹. In March 2021, there were 13,063 adults in custody in New South Wales.

The objective of this performance audit was to assess whether adults in the public prison system have effective access to health services. In making this assessment, we considered whether Justice Health and Corrective Services NSW effectively cooperate and coordinate so that:

patients have timely access to health services
systems and practices support the continuity of health care
access to health services is monitored, reviewed, and reported across the network.

¹The Australian Institute of Health and Welfare, Adult Prisoners Snapshot, 11 September 2019. At: https://www.aihw.gov.au/reports/australias-welfare/adult-prisoners.

Conclusion

Justice Health delivers timely health care to adult custodial patients who need routine medications and treatment for minor medical conditions. Justice Health also delivers timely care to patients requiring urgent medical attention, including emergency transfers to hospitals. However, Justice Health does not always meet recommended timeframes to deliver health care to patients who are waitlisted for treatment from doctors and other medical specialists, or for those waiting for assessments and prescriptions.

In 2020, Justice Health provided over 770,000 instances of medical care to adults in the New South Wales prison network. Approximately half of this health care was delivered on the spot, by nurses who dispensed routine medications or treated the minor medical ailments of 'walk‑in' patients.

Doctors, specialists, and nurse clinicians delivered the other half of prison health care via scheduled health appointments. In most cases, this health care was timely, except for a proportion of patients who were waiting for time‑critical treatments, prescriptions, or assessments. In 2020, 40 per cent of patients identified as 'Priority 1' did not receive care within the recommended three‑day timeframe. Patients waiting for these appointments constitute a small proportion of all health care delivered in 2020, at about one per cent of all health care. Nevertheless, the needs of Priority 1 patients are significant, and Justice Health does not know whether the prolonged wait times led to deteriorations in health outcomes, or other adverse outcomes.

Close to 1,000 patients required emergency treatment in 2020, and were transferred to hospitals as soon as their medical condition was identified by prison health staff.

Justice Health uses multiple information management systems that are not sufficiently linked to transfer all patient medical records and appointment information when patients are moved across the prison system. Appointment schedules and patient medications are transferred through manual processes. There is also limited information sharing with community health providers when custodial patients enter or leave custody.

Justice Health has multiple and parallel information systems, including paper‑based medical records. These systems are not effective for information sharing across the prison system as patients are moved between prisons and facilities at frequent intervals. Clinical staff are not always alerted when a patient is moved from one prison to another, or released from custody after a court appearance. This impacts on the effective scheduling and management of prison health appointments, and the exchange of patient health records across the prison network.

Justice Health's information systems and protocols also do not support the effective exchange of information with external health providers. The transfer of health information is a manual process and there can be significant delays in providing or receiving information from community health providers when custodial patients enter prisons or are released.

Corrective Services NSW and Justice Health executives do not receive sufficiently detailed information or reports to understand the impediments to health service accessibility and to enable system improvements. There is also limited joint planning between the two agencies to improve patient access to health care. The governance and monitoring arrangements for public and private prison health services are flawed and create a conflict of interest for Justice Health as both a service provider and a system monitor.

Justice Health's data dashboard assists managers and clinicians to understand and manage the wait times for health appointments at the prison service level. However, reporting to senior executives on wait times for health services is insufficiently detailed to indicate risks or opportunities for strategic improvement. Corrective Services NSW does not produce sufficiently detailed reports on the costs of transferring custodial patients to health appointments outside the prison network to improve efficiencies or understand trends over time.

There is not enough system‑level planning between Corrective Services NSW and Justice Health to optimise patient attendance at health appointments. Greater collaboration is needed to improve appointment scheduling through notifications about patient movements across the prison network.

There are limitations in the performance monitoring of public and private prison health services. It is not possible to benchmark or compare public and private prison health services and outcomes because the two systems do not report against common Key Performance Indicators.

While Justice Health has taken steps to maintain independence and transparency in its legislated role as assessor of health services in private prisons, there is an inherent conflict of interest in this monitoring role, as Justice Health is also a contracted provider of health services in the private prison system.

1. Key findings

The majority of custodial patients receive timely health care, but a small proportion of patients with priority appointments are not receiving care within target timeframes

Approximately half of all health care provided by Justice Health is immediate. It is delivered to 'walk‑in' patients as soon as they present at prison health clinics. Most of these patients are receiving daily medications, while a small proportion require urgent or immediate care for injuries or illnesses. The other half of prison health care is delivered via scheduled appointments. Patients waiting for health appointments are given a priority rating according to the time within which they should be seen by a clinician.

Patients requiring the most time‑critical care are given a Priority 1 rating. These patients should receive treatment within one to three days. In December 2020, the average wait time for Priority 1 treatment was five and a half days, almost double the target. This is an improvement on wait times in June 2019, when the average wait time was just over 13 days. Justice Health does not assess or measure the impacts of delayed care on these patients.

According to Justice Health, the high numbers of ‘walk‑ins’ contribute to increased wait times for medical appointments. In addition, some specialty health clinics operate weekly, which means that patients cannot be seen by specialists within a one to three‑day timeline. Security events such as prison lockdowns can also contribute to increased wait times, as they limit the access that patients have to prison health clinics during out‑of‑cell hours.

If patients need emergency medical treatment, they are transferred to hospitals in line with Justice Health's policy. In 2020, just over 1,000 patients were transferred to hospital for emergency medical care.

A significant proportion of prison health appointments are not attended, and not enough is being done to understand the reasons, or to improve attendance rates

In 2020, 11 per cent of all scheduled health appointments in prison clinics were not attended. This amounts to approximately 60,000 appointments over the year. Non‑attended appointments have flow‑on impacts on wait times and backlogs for scheduled health appointments. Understanding why they occur is necessary to improve efficiencies in scheduling and patient access to health services.

In 2020, the most common reason for non‑attended health appointments was: 'patient unable to attend'. Justice Health clinicians use this when patients do not arrive at the prison health clinic at the scheduled time, and clinicians lack any other information to explain the non‑attendance.

The second most common recorded reason for non‑attended appointments was: 'cancelled by Corrective Services NSW'. These cancellations are due to operational or security reasons, including prison lockdowns. Data from Justice Health indicates that in 2020, there were an average of 12 lockdowns per week across New South Wales prisons.

A range of factors can impact on patient attendance at appointments, some of which are unavoidable. That said, more can be done to understand and reduce non‑attendance. For example, there is potential for Corrective Services NSW to implement tighter protocols to update information about patient availability on the daily movement lists. This might include checking whether patients are willing to attend appointments. Similarly, there is potential for Justice Health clinicians to implement tighter protocols to check patient lists ahead of scheduled appointments, and to re‑schedule appointments where patients are unavailable.

Demand for mental health care exceeds service capacity and some patients are held in environments that are not appropriate for their needs

There is a high demand for mental health services in New South Wales prisons. In March 2021, at least 143 mental health patients were waiting for access to an acute or sub‑acute mental health unit across the New South Wales prison system. The average wait time for a mental health facility was 43 days. Seventeen patients had wait times of over 100 days. Patients waiting for sub‑acute mental health services had longer wait times than those waiting for acute mental health services.

There are limited mental health beds for women across the New South Wales prison network. There are ten allocated beds for women at the Mental Health Screening Unit at Silverwater Correctional Complex, and no allocated beds for women at Long Bay Hospital.

A lack of bed availability in the Forensic Hospital means that, as of February 2021, 63 forensic patients were being held in mental health facilities in mainstream prisons, when they should have been accommodated in the Forensic Hospital. Some of these forensic patients have been held in mainstream prison facilities for decades.

Cross‑agency co‑operation and planning is required to identify and build infrastructure that will reduce wait times for mental health beds. Over several years, Justice Health has developed, reviewed, and worked to progress a strategic plan for NSW Forensic Mental Health that includes enhanced mental health bed capacity across the NSW system. The latest version of this strategic plan remains in draft and has yet to be approved by the NSW Ministry of Health.

In 2016, Corrective Services NSW commenced a Prison Bed Capacity Program. It was focussed on enhancing capacity across the prison system and did not include specialist health beds. More recently, Corrective Services NSW has been developing a business case to improve the provision of specialist health care facilities across the network, including mental health facilities.

Justice Health's clinical information systems do not support the effective transfer of health appointments or medication records as patients are moved to new prison locations

Justice Health's clinical information systems are multiple and complex. There are five health information systems that include a mix of electronic and paper‑based records. Information management systems contain clinical records, appointment information, medication records, dental records, and specialist health information. Corrective Services NSW maintain separate information systems relating to prison records and psychology treatment information.

The transfer of people across different correctional centres is a frequent occurrence. In 2020, there were over 41,000 movements between correctional centres. People are transferred for a range of reasons including for security purposes, or to be located closer to hospitals or specialist health services.

Justice Health receives a list of patient transfers one day prior to transfer. Nurses are required to prepare medications and clinical handovers for patients with complex health conditions. These handovers are verbal, however short timeframes mean that handover is not always possible.

While each patient's electronic health records are available across the network, transfer of appointment waitlists must be done manually. There is no automatic alert within the information systems to tell staff that a patient has been moved to another prison. There is a risk that if appointment records are not manually updated, or if staff at destination clinics are not contacted, then appointments will be overlooked.

Justice Health is working with eHealth NSW to develop an improved Electronic Medication Management (EMM) program with expected delivery in late 2021. The EMM has potential to improve the transfer of patient medication records, but it will not fully remediate all inefficiencies of the current systems.

Corrective Services NSW and Justice Health do not engage in sufficient joint planning to improve efficiencies in transports or escorts to health services

Corrective Services NSW and Justice Health do not engage in joint system‑level planning to mitigate the risks and the costs associated with transferring patients to health clinics in prisons, or non‑prison‑based health care. There are no protocols, and limited sharing of information to improve efficiencies in planning and coordinating patient transfers.

Corrective Services NSW does not collate or report on the costs of transporting patients to hospitals and specialist care. While there is data on the overall cost of medical escorts, estimated to be $19.9 million in 2020, Corrective Services NSW is not able to disaggregate this data to determine the reasons for transfers or the system‑level costs. For example, Corrective Services NSW does not know how many prison lockdowns occur when hospital transfers are required.

Medical escorts to specialist health services and hospitals increase the costs to the prison system and contribute to risks in prison management. Medical escorts contributed to 16 per cent of metropolitan prison lockdowns at the peak in 2018, though escort numbers have since been declining. Some Local Health Districts report significant concerns around safety incidents and assaults on staff during medical escorts to hospital.

Corrective Services NSW does not know if transport costs have increased since the 2016 Prison Bed Capacity Program which expanded prison beds in regional New South Wales. To date, there has been no assessment of the cost of taking patients to tertiary hospitals or specialist services. Corrective Services NSW has identified this as an area for improvement.

Justice Health's system managers do not receive sufficiently detailed reports on wait times for health care, to understand strategic risks or opportunities for system improvement

Justice Health's senior executives receive monthly reports on patient wait times for services in prison health clinics. These reports contain headline data about the numbers of days that patients wait for scheduled health appointments by their allocated priority level. Wait time data are averaged across all New South Wales prison health clinics. With some exceptions, almost all executive level reports describe system‑wide appointment wait times without offering further specific detail. For example, there is limited information which would allow managers to understand the performance of specialty health groups, or to make any comparative analysis of the performance of different prison facilities.

Executive reports are also not detailed enough to indicate whether prisons with particular security classifications offer greater or lesser access to health services. It is not possible to assess whether patients in metropolitan or regional prisons have different levels of health service access. This prevents managers from identifying strategic risks across the prison network, targeting resources to the areas of greatest risk, and making strategic improvements in system performance.

Trend data on wait times for the different health specialty areas is also required to enable senior managers to compare wait times across prison facilities, security classifications, and localities.

In response to the preliminary findings of this audit, Justice Health has made some improvements to its executive‑level wait time reports. This includes additional detail on health appointment wait times by prison facilities and wait times by health specialty areas.

It is not possible to compare or benchmark the performance of public and private prison health operators or to compare prison health against community health standards

It is not possible to compare or benchmark the performance of the public and private prison health operators in New South Wales using the current Key Performance Indicator (KPI) data. KPI data do not correlate across the public and private systems.

Justice Health reports to the Ministry of Health on 44 prison health KPIs. The 44 KPIs for the public prison system do not align with the seven KPIs the private health operators report against in their contracts with Corrective Services NSW. This means that public and private operators focus on different service areas. For example, private operators have a performance measure for ensuring that custodial patients are provided with release plans. Justice Health does not have a similar measure.

The KPI specifications for the private prison health system were developed by Corrective Services NSW with input from the Ministry of Health. The KPI specifications for the public prison health system were developed by the Ministry of Health in collaboration with Justice Health. There is no rationale for the difference in performance indicators across the public and private systems.

Private providers currently deliver prison services to 25 per cent of the prison population of New South Wales. This proportion has been increasing since 2016. Public and private health operators deliver comparable health services so there is scope to compare performance across the systems.

Justice Health aligns its standard for prison health services with a 'community’ standard of health care access. However, with existing health monitoring measures, it is not possible to assess how well Justice Health is tracking against community health standards with available data from most health specialties.

There is an inherent conflict of interest in Justice Health's monitoring role of health services in private prisons, as Justice Health is also a provider of health services in a private prison

There is a legislated requirement for Justice Health to monitor the performance of private health operators in New South Wales prisons. This monitoring role is described in the Crimes (Administration of Sentences) Act 1999.

Justice Health's monitoring role includes the collection and analysis of health performance data from private health operators, and periodic site visits to assess health service performance. Justice Health reports the findings of monitoring activities to Corrective Services NSW, the contract manager for private prisons.

Justice Health's monitoring role commenced in the late 1990s. In recent years, this role has expanded as the NSW Government has increased the number of privately managed prisons across the state. Justice Health now monitors health services in four private prisons, accounting for approximately one quarter of all custodial patients in the New South Wales prison system.

In 2018, Justice Health was awarded a contract to provide health services at the John Morony Correctional Centre. Justice Health also monitors the health services this Correctional Centre. The timing of the 1999 legislation did not anticipate that Justice Health would be a provider of the services it is required to monitor.

Justice Health has taken steps to maintain independence and transparency in its monitoring role by establishing a number of arms‑length governance arrangements. Justice Health set up a Commissioning Unit that operates independently from its service delivery operations. Justice Health also established an alternative reporting chain via a Board subcommittee to oversee the performance of health providers in private prisons.

Despite all actions to establish independence, the monitoring role confers dual responsibilities on the Chief Executive of Justice Health as both an operational manager of health services in a private prison and as a manager responsible for monitoring these same services. As a result, the Chief Executive of Justice Health has access to information about the overall performance of the private prison health system in New South Wales.

As a competitor for the provision of health services in privately operated prisons, Justice Health has access to information to which other private health providers do not. This potentially gives Justice Health a competitive advantage over other private health operators.

2. Recommendations

By December 2022, Justice Health should:

1. enhance reporting on patient access to health services to ensure that system managers can identify risks, challenges, and system improvements across key areas of its service profile

2. in collaboration with the NSW Ministry of Health, identify and implement the required improvements to its health information management systems that will enable effective transfers of patient clinical records and appointment information across the custodial network and with external health providers.

By December 2022, Justice Health and Corrective Services NSW should:

3. develop a joint framework to govern and monitor the costs of their common and connected responsibilities for patient health movements across the prison network and to external health services

4. develop a joint framework to govern their common and connected responsibilities for mental health services.

By December 2022, Justice Health and Corrective Services NSW, in collaboration with the NSW Ministry of Health, should:

5. progress infrastructure plans and projects that address the lack of specialist accommodation for mental health patients and aged and frail patients

6. standardise and align the key performance indicators that monitor the performance of health operators in public and private prisons so that system‑wide benchmarking is possible.

By December 2022, the NSW Ministry of Health should:

7. take action to remediate the conflicting monitoring arrangements of public and private prison health operators.