What this report is about

Results of the Education portfolio of agencies’ financial statements audits for the year ended 30 June 2023.

What we found

Unqualified audit opinions were issued for all Education portfolio agencies.

An ‘other matter’ paragraph was included in the TAFE Commission’s independent auditor’s report as it did not have a delegation or sub-delegation from the Minister for Education and Early Learning to incur expenditure on grants from other portfolio agencies.

What the key issues were

Comprehensive valuations of buildings at the Department of Education (the department) and at the TAFE Commission found that certain assumptions applied in previous years needed to be updated, resulting in prior period restatements.

The department prepaid a building contractor for early works on a project and some of the prepayment is in legal dispute.

The department duplicated a claim for project funding from Restart NSW in 2021.

New parental leave legislation increased employee liabilities for portfolio agencies. The department and the NSW Education Standards Authority (the Authority) updated their financial statements to record parental leave liabilities.

A high risk matter was raised for the Authority to improve the quality and timeliness of information to support their financial statement close process.

What we recommended

Portfolio agencies should ensure any changes to employee entitlements are assessed for their potential financial statements impact under the relevant Australian Accounting Standards.

The department should:

• improve processes to ensure project claims are not duplicated
• assess the risks associated with providing prepayments to contractors.

This report provides Parliament and other users of the Education portfolio of agencies’ financial statements with the results of our audits, analysis, conclusions and recommendations in the following areas:

• financial reporting
• audit observations.

Financial reporting is an important element of good governance. Confidence and transparency in public sector decision-making are enhanced when financial reporting is accurate and timely.

This chapter outlines our audit observations related to the financial reporting of agencies in the Education portfolio (the portfolio) for 2023.

Appropriate financial controls help ensure the efficient and effective use of resources and administration of agency policies. They are essential for quality and timely decision-making.

This chapter outlines our observations and insights from our financial statement audits of agencies in the Education portfolio.

Appendix one – Early close procedures

Appendix two – Financial data

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

What this report is about

Students in rural and remote areas of NSW face greater challenges compared to their metropolitan peers.

This report examined how the NSW Department of Education (the department) is ensuring that rural and remote students have access to the same quality of early childhood, school education, and skills pathways as metropolitan students.

What we found

A decade since the previous (2013) strategy to address educational disadvantage, there remain considerable gaps in access and outcomes between rural and remote students and metropolitan students.

The Rural and Remote Education Strategy (2021–24) is unlikely to address these longstanding and known issues of educational disadvantage in rural and remote areas.

Key enabling factors such as resourcing a dedicated team, setting performance measures, and establishing suitable governance arrangements were not put in place to support effective implementation of the 2021 strategy.

The department has programs aimed at addressing remoteness challenges, but does not know if these initiatives improve access or outcomes.

The department does not monitor or report on student access or outcomes according to geographic location.

What we recommended

The Department of Education should:

• develop a new strategy that addresses disadvantage in regional, rural and remote education
• establish and report publicly on regional, rural and remote key performance indicators
• improve data collection by using a standard remoteness classification
• improve governance arrangements for regional, rural and remote education
• review the resources provided for regional, rural and remote areas that recognises the additional costs
• develop an approach that ensures all students can access best practice modes of delivery.

In February 2021, the department of Education (the department) released the ‘Rural and Remote Education Strategy (2021–2024)’. The strategy sets a vision that ‘every child in regional New South Wales has access to the same quality of education as their metropolitan peers’. It recognises that students in rural and remote areas of New South Wales face greater challenges compared to students in metropolitan locations. These challenges contribute to regional, rural and remote students underperforming on major educational indicators compared to their metropolitan peers.

In recent years, regional, rural and remote communities experienced a series of natural disasters as well as the COVID-19 pandemic. In response to the pandemic and subsequent school closures, the department introduced new initiatives aimed at minimising the disruption to children including online learning and small group tuition.

The department established a regional, rural and remote education policy unit in 2021 to support delivery of the strategy and its vision.

The objective of this audit was to assess the effectiveness of the department’s activities to ensure that regional, rural and remote students have access to the same quality of early childhood, school education, and skills pathways as their metropolitan peers.

In making this assessment, the audit examined whether:

• The department developed and implemented a strategy that enables regional, rural and remote students to access the same quality of early childhood education, school education, and skills pathways as students in metropolitan New South Wales.
• The department has been addressing the complexities and needs of regional, rural and remote early childhood education, school education, and skills pathways.

This chapter examines the process to develop the Rural and Remote Education Strategy (2021–2024). It considers whether there was a comprehensive program of stakeholder consultation, whether relevant research and evidence was incorporated and whether an effective performance monitoring system was established.

The department made genuine efforts to consult with stakeholders on the new strategy

The department had a clear process to engage and obtain feedback from key stakeholders during the development of the new strategy. It developed a range of documents to support the consultation process including a stakeholder engagement plan, communications plan, and presentation. The department used the International Association for Public Participation (IAP2) Spectrum of Public Participation principles to help ensure that relevant stakeholders were included in the planning and decision-making process.

In late 2019, the department began its first phase of consultations with internal and external stakeholders to get their views on rural and remote education. It consulted internally with department directors, advisory groups, and learning communities, and externally with government agencies, service providers, non-government schools, and universities.

In March 2020, the department developed a stakeholder engagement paper to test the key issues from stakeholder consultations. Four focus areas were identified and included in a consultation paper that went out to key stakeholders for the second round of consultations in May 2020.

In the third consultation phase, the department conducted a workshop with stakeholders to review the earlier feedback, prioritise issues, identify gaps, and provide further input.

This consultation process enabled the department to identify issues and challenges to inform the new strategy. However, it was already aware that the blueprint was having limited success, and had already identified potential focus areas, following the evaluation of the blueprint in 2019.

The department did not consider recent research when developing the new strategy

The department's guidance materials promote the importance of considering research during policymaking. The guidelines describe the need to understand a topic, consult with stakeholders, identify gaps in existing knowledge, and ensure future work is informed by current literature.

In 2013, the department published a literature review on rural and remote education to inform the blueprint. The literature review found that students in rural and remote schools were not performing as well as their metropolitan peers, and that this performance gap was widening. The review attributed this to the higher number of children from low socio-economic backgrounds attending rural and remote schools. The review also identified several other factors that could negatively impact performance outcomes for rural and remote students. The department used the findings of the literature review to develop the key focus areas in the 2013 blueprint.

When the department began developing the new rural and remote education strategy in 2019, it recognised the need to review the literature on recent international initiatives. However, it has not yet released this review. This means that the department could have missed important new developments since it last examined the literature in 2013. Incorporating up-to-date research is important where past strategies have not met all their intended outcomes.

A national review into rural and remote education in 2018 examined Australian and international literature to inform its findings. The review made 11 recommendations to the Australian and state governments. While the NSW Government was not required to formally respond to the review, it could have considered the work done by that review when developing the new strategy. Several review recommendations are addressed in the strategy, while several others are only partly addressed. Gaps between review recommendations and specific strategy actions include improving the availability of quality accommodation, substantially reducing the waiting times for specialist assessments of students with learning difficulties and disabilities and increasing access to high quality distance education.

In 2019, the department commissioned a rural and remote project to contribute a research and evidence base to the new strategy. The main aim of the project was to help the department understand how it could better support rural and remote schools to increase educational outcomes. There was not enough time for this review to be completed prior to the release of the strategy. As of June 2023, the research project had not yet been released.

The strategy did not address all findings and recommendations from a recent evaluation

In 2020, the department's Centre for Education Statistics and Evaluation (CESE) published an evaluation of the blueprint. The evaluation examined how the actions in the blueprint were implemented. It recommended that a new strategy be developed, and made recommendations for things that should be incorporated into the strategy.

The blueprint aimed to ensure students in rural and remote areas could access the same quality of education as their metropolitan peers. The blueprint identified four focus areas to meet that aim:

• quality early childhood education
• great teachers and school leaders
• curriculum access for all
• effective partnerships and connections.

The department developed several initiatives to help meet the objectives of each of the four focus areas. These initiatives are described in Exhibit 5 below.

The evaluation found that initiatives in two of the four focus areas – Quality early childhood education and Curriculum access for all – had performed well. However, the evaluation found that initiatives in the other two focus areas – Great teachers and school leaders and Effective partnerships and connections – did not achieve intended outcomes.

On the whole, the evaluation found that the 'remoteness gap' between rural and remote students and metropolitan students had not reduced since the blueprint was introduced. It recommended that the department continue its focus on rural and remote education by developing a new evidence-based strategy that focused on student outcomes and clear measures of success.

Objectives and actions in the new strategy were similar to those in the blueprint

The 2021 strategy sets an overall vision that 'every child in regional New South Wales has access to the same quality of education as their metropolitan peers'. It also states that the department 'is committed to ensuring all rural and remote students have equitable access to educational opportunities'.

Four areas in the blueprint remained a focus in the new strategy – early childhood education, teacher recruitment and retention, curriculum, and student wellbeing support services. Each focus area identifies a goal, as well as the aims and actions that contribute to those goals.

While this shows the department identified that these areas required continued attention, most actions were to 'increase', 'expand' or 'improve' existing programs and resources. The new strategy did not propose any new ideas or solutions, despite the blueprint achieving limited success in improving outcomes for rural and remote students.

There were no baseline or target measures set to monitor progress of the new strategy

The blueprint evaluation recommended that the department develop a new evidence-based strategy which focused on improving student outcomes. It also recommended the department use a program logic methodology to ensure there was a clear definition of success, adequate measures of success, and continual monitoring to ensure success.

Program logic models are a visual representation of the various components of a program. They can be used to illustrate program priorities, inputs, activities, outputs, outcomes, and assumptions. Logic models are used to explain how a proposed solution will address a specific problem. They are important because they can help test assumptions, build business cases, and identify potential enablers or barriers that could impact the project.

The department did not complete a program logic model during development of the new strategy, nor did it define measures to monitor whether the strategy's overall vision for quality education or the commitment to equitable access was on track to be achieved.

The department has not comprehensively monitored changes in educational outcomes in regional, rural and remote areas since the evaluation of the blueprint in 2020. This evaluation had seven indicators of educational outcomes by remoteness. The measures used in the evaluation could have provided a starting point given the similarity in focus areas between the blueprint and the new strategy. Not addressing past review recommendations increases risks that issues will be repeated.

The policy unit advised it has plans to set up a dashboard to monitor performance across the department's business plan measures by remoteness. This is intended to identify areas where system-wide improvements are required. This is not a comprehensive account of the strategy outcomes because the business plan measures don't capture all the goals of the strategy.

There were no timeframes or resources identified for implementing new strategy actions

The strategy has an overall timeframe of 2021–2024 but does not clarify when it expects the vision, goals, or aims to be achieved, or actions to be implemented.

The department's guidance on policymaking sets out how projects should be transitioned between the policy and implementation teams. This guidance is intended to help ensure the policy intent and scope of the project are not lost during the delivery of the project. The guidance highlights that the policy team should establish clear project implementation timeframes. It is important to have clear timeframes because it enables teams to measure progress, manage resources, and prioritise actions to ensure project outcomes are achieved.

The strategy states that there is a further $1 billion of investment planned over the next three years for rural and remote education but does not identify how this is allocated across its focus areas. It is important to identify the resources required to support the implementation of a program so that program objectives are met in a timely and cost-effective manner. The previous blueprint identified much lower funding of $80 million but more clearly showed how it would be allocated for identified actions across the four focus areas.

In response to our requests, the department separately identified $1.286 billion in expenditure for regional, rural and remote schools referenced in the strategy. Most of this expenditure related to existing department programs and activities rather than new initiatives. The total amount included:

• $576.9 million for new and upgraded schools
• $365.8 million for upgraded information technology equipment and resources
• $120 million for school facility upgrades to be co-funded by schools
• $60 million to replace school roofs
• $60 million for the COVID Intensive Learning Support Program
• $32 million for the Early Action for Success program
• $29.7 million for staffing incentives
• $21.7 million for literacy and numeracy interventions
• $18.8 million in school location allowances
• $1.45 million for the Rural Learning Exchange Pilot
• $0.4 million for Rural and Remote Network initiatives.

This chapter examines the arrangements in place to implement the strategy. It considers whether effective governance arrangements are in place and how progress is monitored and reported.

This chapter considers the effectiveness of arrangements to ensure regional, rural and remote students have access to quality early childhood education, school education, and post‑school transitions.

This chapter considers the department's arrangements to monitor educational and wellbeing outcomes of students by remoteness. It reports on differences in outcomes between students in metropolitan areas and those in regional, rural and remote areas.

Those living in regional, rural and remote areas can have greater difficulty in accessing government services, often needing to travel long distances, or facing lower service levels than provided in major cities. This context is important when considering educational and wellbeing outcomes, given the disruptive effects of waiting or missing out on important services.

The rest of this chapter details key measures in the department's outcome and business plan.

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #385 - released 10 August 2023

What the report is about

Effective radio communications are crucial to NSW's emergency services organisations.

The Critical Communications Enhancement Program (CCEP) aims to deliver an enhanced public safety radio network to serve the five emergency services organisations (ESOs), as well as a range of other users.

This report assesses whether the NSW Telco Authority is effectively managing the CCEP.

What we found

Where it has already been delivered (about 50% of the state), the enhanced network meets most of the requirements of ESOs.

The CCEP will provide additional infrastructure for public safety radio coverage in existing buildings agreed to with ESOs. However, radio coverage inside buildings constructed after the CCEP concludes will be at risk because building and fire regulations do not address the need for in-building public safety radio coverage.

Around 98% of radios connected to the network can be authenticated to protect against cloning, though only 42% are.

The NSW Telco Authority has not settled with ESOs on how call encryption will be used across the network. This creates the risk that radio interoperability between ESOs will not be maximised.

When completed, the public safety radio network will be the only mission critical radio network for ESOs. It is unclear whether governance for the ongoing running of the network will allow ESOs to participate in future network operational decisions.

The current estimated capital cost for the NSW Telco Authority to complete the CCEP is $1.293 billion. This is up from an estimated cost of $400 million in 2016. The estimated capital cost was not publicly disclosed until $1.325 billion was shown in the 2021–22 NSW Budget Papers.

We estimate that the full cost to government, including costs to the ESOs, of implementing the enhanced network is likely to exceed $2 billion.

We made recommendations about

• The governance of the enhanced Public Safety Network (PSN) to support agency relationships.
• The need to finalise a Traffic Mitigation Plan for when the network is congested.
• The need to provide advice to the NSW Government about the regulatory gap for ensuring adequate network reach in future buildings.
• The need to clarify how encryption and interoperability will work on the enhanced network.
• The need for the NSW Telco Authority to comply with its policy on Infrastructure Capacity Reservation.
• Expediting measures to protect against the risk of cloning by unauthenticated radios.

Public safety radio networks are critical for operational communications among Emergency Services Organisations (ESOs), which in New South Wales include:

• NSW Ambulance
• Fire and Rescue NSW
• NSW Police Force
• NSW Rural Fire Service
• NSW State Emergency Service.¹

Since 1993, these five ESOs have had access to a NSW Government owned and operated radio communications network, the Public Safety Network (PSN), to support their operational communications. Around 60 to 70 other entities also have access to this network, including other NSW government entities, Commonwealth government entities, local councils, community organisations, and utility companies.

Pursuant to the Government Telecommunications Act 2018 ('the Act'), the New South Wales Government Telecommunications Authority ('NSW Telco Authority') is responsible for the establishment, control, management, maintenance and operation of the PSN.²

Separate to the PSN, all ESOs and other government entities have historically maintained their own radio communication capabilities and networks. Accordingly, the PSN has been a supplementary source of operational radio communications for these entities.

These other radio networks maintained by ESOs and other entities are of varying size and capability, with many ageing and nearing their end-of-life. There was generally little or no interoperability between networks, infrastructure was often co-located and duplicative, and there were large gaps in geographic coverage.

In 2016, the NSW Telco Authority received dedicated NSW Government funding to commence the Critical Communications Enhancement Program (CCEP).

According to NSW Telco Authority's 2021–22 annual report, the CCEP is a transformation program for operational communications for NSW government agencies. The CCEP '…aims to deliver greater access to public safety standard radio communications for the State’s first responders and essential service agencies'. The objective of CCEP is to consolidate the large number of separate radio networks that are owned and operated by various NSW government entities and to enhance the state’s existing shared PSN. The program also aims to deliver increased PSN coverage throughout New South Wales.

The former NSW Government intended that as the enhanced PSN was progressively rolled-out across NSW, ESOs would migrate their radio communications to the enhanced network, before closing and decommissioning their own networks.

About this Audit

This audit assessed whether the CCEP is being effectively managed by the NSW Telco Authority to deliver an enhanced PSN that meets ESOs' requirements for operational communications.

We addressed the audit objective by answering the following two questions:

1. Have agreed ESO user requirements for the enhanced PSN been met under day-to-day and emergency operational conditions?
2. Has there been adequate transparency to the NSW Government and other stakeholders regarding whole-of-government costs related to the CCEP?

In answering the first question, we also considered how the agreed user requirements were determined. This included whether they were supported by evidence, whether they were sufficient to meet the intent of the CCEP (including in considering any role for new or alternative technologies), and whether they met any relevant technical standards and compliance obligations (including for cyber security resilience).

While other NSW government agencies and entities use the PSN, we focused on the experience of the five primary ESOs because these will be the largest users of the enhanced PSN.

Both the cost and time required to complete the CCEP roll-out have increased since 2016. While it was originally intended to be completed in 2020, this is now forecast to be 2027. Infrastructure NSW has previously assessed the reasons for the increases in time and cost. A summary of the findings made by Infrastructure NSW is presented in Chapter 1 of this report. Accordingly, as these matters had already been assessed, we did not re-examine them in this performance audit.

The auditee for this performance audit is the NSW Telco Authority, which is a statutory authority within the Department of Customer Service portfolio.

In addition to being responsible for the operation of the PSN, section 5 of the Act also prescribes that the NSW Telco Authority is:

• to identify, develop and deliver upgrades and enhancements to the government telecommunications network to improve operational communications for government sector agencies
• to develop policies, standards and guidelines for operational communications using telecommunications networks.

The NSW Telco Authority Advisory Board is established under section 10 of the Act. The role of the board is to advise the NSW Telco Authority and the minister on any matter relating to the telecommunications requirements of government sector agencies and on any other matter relating to the functions of the Authority. As of 2 June 2023, the responsible minister is the Minister for Customer Service and Digital Government.

The five identified ESOs are critical stakeholders of the CCEP and therefore they were consulted during this audit. However, the ESOs were not auditees for this performance audit.

The NSW Telco Authority established and tracked its own costs for the CCEP

Over the course of the program from 2016, the NSW Telco Authority prepared a series of business cases and program reviews that estimated its cost of implementing the program in full, including those shown in Exhibit 6 below.

In response to the 2016 CCEP business case, the then NSW Government approved the NSW Telco Authority implementing the CCEP in full, with funding provided in stages. The NSW Telco Authority tracked its costs against approved funding, with monthly reports provided to the multi-agency Program Steering Committee

Throughout the program, the NSW Government was informed of increasing costs being incurred by the NSW Telco Authority for the CCEP

The various business cases, program updates, and program reviews prepared by the NSW Telco Authority were provided to the NSW Government through the required Cabinet process when seeking approval for the program proceeding and requests for both capital and operational funding. These provided clear indication of the changing overall cost of the CCEP to the NSW Telco Authority, as well as the delays that were being experienced.

There was no transparency to the Parliament and community about changes in the capital cost of the CCEP until the 2021–22 NSW Budget

As the business cases for the CCEP were not publicly available, the only sources of information about capital cost were NSW Budget papers and media releases. The information provided in the annual Budget papers prior to the 2021–22 NSW Budget provided no visibility of the estimated full capital cost to complete all stages of the CCEP. As shown in Exhibit 7 below, this information was fragmented and complex.

Media releases about the progress of the CCEP did not provide the estimated total cost to the NSW Telco Authority of $1.325 billion to complete all stages of the CCEP until June 2021. Prior to this date, media releases only provided funding for the initial stages of the program or for the stages subject to a funding announcement.

Even during the September 2019 and March 2020 Parliamentary Estimate Committee hearings where the costings and delays to the CCEP were raised, the estimated full cost of the CCEP was not revealed.

The original business case for the CCEP included estimated ESO costs, though these costs were not tracked throughout the program

Estimates for ESO costs for operating and maintaining their own radio networks over the four years from 2016–17 were included in the original March 2016 business case. They included $75.2 million for capital expenditure and $95 million for one-off operating costs. These costs, as well as costs incurred by ESOs due to the delay in the program, were not subsequently tracked by the NSW Telco Authority.

In January 2017, Infrastructure NSW reviewed the CCEP business case of March 2016. In this review, Infrastructure NSW recommended that the NSW Telco Authority identify combined and apportioned costs and cashflow for all ESOs over the CCEP funding period reflecting all associated costs to deliver the CCEP. These to include additional incidental capital costs accruing to ESOs, transition and migration to the new network and the cost (capital and operational) of maintaining existing networks. This recommendation was implemented in the November 2017 program review, with ESO capital costs estimated as $183 million.

In 2019, Infrastructure NSW conducted a Deep Dive Review on the progress of the CCEP. In this review, Infrastructure NSW made what it described as a 'critical recommendation' that the NSW Telco Authority:

It should be noted that the delay to CCEP completion now is seven years and that further ‘operational bridging solutions’ have been needed by the ESOs.

'Stay Safe and Keep Operational' costs incurred by ESOs will be significantly higher than originally estimated

Stay Safe and Keep Operational (SSKO) funding was established to provide funding to ESOs to maintain their legacy networks while the CCEP was refreshing and enhancing the PSN. This recognised that much of the network infrastructure relied on by ESOs had reached – or was reaching – obsolescence and would either require extensive maintenance or replacement before the PSN was available for ESOs to migrate to it. ESOs may apply to NSW Treasury for SSKO funding, with their specific proposals being reviewed (and endorsed, where appropriate) by the NSW Telco Authority. Accordingly, SSKO expenditure does not fall within the CCEP budget allocation.

As shown in the table below, extracted from the March 2016 CCEP business case, the total expected cost for SSKO purposes over the course of the CCEP was originally $40 million, assuming the enhanced PSN would be fully available by 2020.

In October 2022, the expected completion date for the CCEP was re-baselined to August 2027. Accordingly, ESOs will be required to continue to maintain their radio networks using legacy equipment for seven years longer than the original 2020 forecast. This will likely become progressively more expensive and require additional SSKO funding. For example, NSW Telco Authority endorsed SSKO bids for 2022–23 exceeded $35 million for that year alone.

Compared to the original forecast made in the March 2016 CCEP business case of $40 million, we found ESOs had estimated SSKO spending to 2027 will be $292.5 million.

A refresh of paging network used by ESOs and the decommissioning of redundant sites were both removed from the original 2016 scope of the CCEP

Paging

A paging network is considered an important user requirement by the Fire and Rescue NSW, NSW Rural Fire Service, and NSW State Emergency Service. The 2016 CCEP business case included a paging network refresh within the program scope of works. This was reiterated in the November 2017 internal review of the program. These documents did not estimate a cost for this refresh. The March 2020 and October 2020 business cases excluded paging from the program scope. The audit is unable to identify when, why or by whom the decision was made to remove paging from the program scope, something that was also not well communicated to the affected ESOs.

In 2021, after representations from the affected ESOs, the NSW Telco Authority prepared a separate business case for a refresh of the paging network at an estimated capital cost of $60.31 million. This program was subsequently approved by the NSW Government and included in the 2022–23 NSW Budget.

In determining an estimated full whole-of-government cost of delivering the enhanced PSN, we have included the budgeted cost of the paging network refresh on the basis that:

• it was expressly included in the original approved March 2016 business case
• the capability is deemed essential to the needs of three ESOs.

Decommissioning costs

The 2016 CCEP business case included cost estimates for decommissioning surplus sites (whether ‘old’ GRN sites or sites belonging to ESOs’ own networks). These estimates were provided for both the NSW Telco Authority ($38 million) and for the ESOs ($55 million). However, while these estimates were described, they were not included as part of the NSW Telco Authority's estimated capital cost ($400 million) or (more relevantly) operating cost ($37.3 million) for the CCEP. This is despite decommissioning being included as one of eight planned activities for the rollout of the program.

In the October 2020 business case, an estimate of $201 million was included for decommissioning agency networks based on a model whereby:

• funding would be coordinated by the NSW Telco Authority
• scheduling and reporting through an inter-agency working group and
• where appropriate, agencies would be appointed as the most appropriate decommissioning party.

This estimated cost is not included in the CCEP budget.

In determining an estimated full whole-of-government cost of the enhanced PSN, we have included the estimated cost of decommissioning on the basis that:

• decommissioning was included in the 2016 CCEP business case as one of eight 'planned activities for the rollout of the program'
• effective decommissioning of surplus sites and equipment (including as described in the business case as incorporating asset decommissioning, asset re-use, and site make-good) is an inherent part of the program management for an enhanced PSN
• costs incurred in decommissioning are entirely a consequence of the CCEP program.

The estimated minimum cost of building an enhanced PSN consistent with the original proposal is over $2 billion

We have derived two estimated minimum whole-of-government costs for delivering an enhanced PSN. These are:

• $2.04 billion when calculated from NSW Telco Authority data – shown as estimate A in Exhibit 9 below.
• $2.26 billion when calculated from ESO supplied data – shown as estimate B in Exhibit 9.

Both totals include:

• budgeted amounts for both CCEP capital expenditure ($1,292.8 million) and operating expenditure ($139 million)
• the NSW Telco Authority's 2020 estimated cost for decommissioning ($201 million)
• the NSW Telco Authority's approved funding for paging refresh ($60.3 million).

The two estimated totals primarily vary around the capital expenditure of ESOs (particularly SSKO funding). To determine these costs, we used ESO provided actual SSKO costs to date, as well as their estimates for maintaining their legacy radio networks through to 2027.

The equivalent cost estimates from the NSW Telco Authority were sourced from the November 2017 internal review and the October 2020 business case for CCEP. It should be noted that the amounts for both estimates are not audited, or verified, but do provide an indication of how whole-of-government costs have grown over the course of the program.

The increase in and reasons for the increase in total CCEP costs (capital and one-off operating) incurred or forecast by the NSW Telco Authority (from $437.3 million in 2016 to $1,431.8 million in 2022) have been provided to the NSW Government through various business cases and reviews prepared by the NSW Telco Authority, as well as by reviews conducted by Infrastructure NSW as part of its project assurance responsibilities.

However, the growth in ESO costs and other consequential costs, such as paging and decommissioning, from around $263 million in the 2016 CCEP business case to between $600 million and $800 million, has to a large degree remained invisible and unexplained to the NSW Government and other stakeholders

Appendix one – Response from agency

Appendix two – Trunked public safety radio networks

Appendix three – About the audit

Appendix four – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #383 - released 23 June 2023

Click here for the Easy English version of the report highlights

The Easy English version of the report highlights is intended to meet the needs of some people with lower literacy skills, some people with an intellectual disability, and some people from different cultural backgrounds.

The Easy English document is not the final audit report that has been prepared and tabled in NSW Parliament under s.38EB and s.38EC of the Government Sector Audit Act 1983. It should not be relied on or quoted from as the final audit report.

What this report is about

This audit assessed whether NSW Trustee and Guardian is effectively delivering public guardianship and financial management services in line with legislative requirements and standards.

What we found

NSW Trustee and Guardian is delivering guardianship and financial management services in line with its broad legal authority.

However, NSW Trustee and Guardian does not have sufficient oversight to ensure that its services are consistent with legislative principles which aim to promote positive client outcomes.

The agency's governance and practices could be better supported by relevant training and guidance to account for the diversity of its clients.

It does not track the actual costs of service delivery, the quality of services or client experiences and key findings from previous reviews remain unresolved.

Government funding for public guardianship services and direct financial management services for low-wealth clients has not kept pace with the growth in clients.

There is a risk that some fee-paying clients are unknowingly subsidising others.

NSW Trustee and Guardian has applied additional funding to increase frontline staff, but gaps in monitoring and IT system constraints create a risk that it will not address service quality issues, nor be able to demonstrate the impact of this new funding.

What we recommended

We recommended that NSW Trustee and Guardian:

• Broaden governance arrangements to enable input to key decisions from people with lived experience, relevant peak bodies and representatives of diverse communities.
• Implement mechanisms to seek feedback on the effectiveness and quality of services from clients under orders.
• Assess staff competency and implement regular training in effectively serving clients with disability, dementia, mental illness, cognitive impairments and other factors relevant to decision-making incapacity.
• Implement a risk-based quality framework to assess whether public guardian and financial management decisions are in line with policy and the legislative principles.
• Improve data collection and monitoring to track performance, the costs to serve, and client outcomes and report on these publicly.

NSW Trustee and Guardian is a NSW Government agency in the Stronger Communities cluster. It supports the NSW Trustee and the Public Guardian in the exercise of their statutory functions. It is accountable to the relevant Minister, the Attorney General.

The legislative responsibilities for the Public Guardian and the NSW Trustee are provided in separate statutes (NSW Trustee and Guardian Act 2009 and Guardianship Act 1987). Together, these establish a number of functions and services that NSW Trustee and Guardian as an agency is expected to deliver, including:

• acting as executor and administrator of deceased estates
• acting as a trustee responsible for managing trust property on behalf of another person or organisation in line with the trust terms
• drafting Will, Power of Attorney and Enduring Guardianship instruments, and educating the community about the importance of having these documents in place
• making decisions on behalf of people under guardianship or financial management orders as a guardian or a financial manager 'of last resort', or overseeing and assisting private financial managers.

This audit focuses on the last of these - NSW Trustee and Guardian's financial management and guardianship services.

The NSW Trustee and the Public Guardian are appointed to provide direct financial management and/or guardianship services (respectively) to over 13,300 people (as at 30 June 2022) who are deemed by a court or tribunal unable to manage their own affairs. This involves making decisions for people under a relevant court or tribunal order, within the terms of the order. The court or tribunal order enables the appointed guardian or financial manager to make decisions on behalf of the person for whom the order is made. The legislation allows the financial manager or guardian to exercise all the functions of the person under management has or would have were they not incapable of managing for themselves. From a legal perspective, these 'substitute decisions' have the same effect as if the person had made the decision themselves. While the legal presumption is that a person has capacity to care for themselves and manage their own affairs, a financial manager or guardian can be appointed without the person's consent if the court or tribunal finds the person does not have relevant decision-making capacity.

There can be a range of factors that impact on a person's decision-making capacity, including cognitive impairment, intellectual disability, dementia, mental illness and addiction. Guardianship (of both the person and their estate) developed as a response, through European and English law over hundreds of years. In Australia, it was a function of the Supreme Court of NSW before the establishment of government agencies. What is now known as substitute decision-making can sometimes be referred to as a 'protective' function because:

• it relates to decisions or actions that need to be taken, which the person under an order cannot take because they are incapable of managing their own affairs
• due to this lack of competence, the person may be disadvantaged in the conduct of their affairs (for example, their money or property may be dissipated or lost, they may enter agreements unwisely or they may be at risk of abuse or exploitation)
• substitute decisions must be made in the best interests of the person on whose behalf they are made.

An alternative model is 'supported decision-making'. This refers to processes and approaches that assist people with impaired decision-making capacity to exercise their autonomy and legal capacity by supporting them to make decisions. This approach seeks to give effect to the will and preferences of the person requiring decision-making support wherever possible, including decisions involving risk. There has been a longstanding legal and community push for Australian guardianship and administration systems to move from substituted to supported decision-making. However, the legislation in New South Wales provides for 'best interests' substitute decision-making and this is the framework against which we have audited NSW Trustee and Guardian.

The Public Guardian and the NSW Trustee may be appointed as substitute decision makers by the NSW Civil and Administrative Tribunal (NCAT) and the Supreme Court. The NSW Trustee may also be appointed by the Mental Health Review Tribunal for financial management orders only.¹ They are intended to be appointed as a 'last resort' when there is no one willing or suitable to fill the role, or there is significant family conflict regarding decision-making for the person. The Public Guardian and the NSW Trustee cannot refuse to accept a court or tribunal appointment to administer an order for guardianship or financial management.

Public Guardian decisions cover healthcare, lifestyle, accommodation and/or medical decisions such as where a person should live (for example: at home, in an aged care facility or disability group home), what disability or other support services they receive, who can have access to them (for example: through establishing visiting schedules between conflicting family members) and consent to the use of restrictive practices on the advice of independent experts (for example: seclusion, chemical restraint such as anti-psychotic medication, environmental restraints such as limiting access to knives).

Under a financial management order where the NSW Trustee is appointed as financial manager, the NSW Trustee carries out such functions as securing and collecting assets, income and entitlements, paying expenses, debts and designing budgets, investing financial assets, lodging tax returns and paying maintenance for dependents, taking or defending legal proceedings and managing other financial and legal affairs for the person. This is referred to as direct financial management.

A court or tribunal may appoint a private financial manager, such as a family member, friend, private trustee company or other commercial provider. Where a private manager is appointed, the NSW Trustee provides authorisation and directions to the private manager and oversees their performance. As at 30 June 2022, over 6,200 people had private managers.

As an agency, the majority of NSW Trustee and Guardian's overall revenue is from fees (including for services outside the scope of the audit, such as will preparation) and investments. The remainder is from the NSW Government as funding for non-commercial services including guardianship services and subsidised financial management services for low-wealth clients. Public guardian clients do not pay fees. Financial management clients pay fees, but these are subsidised where the client does not have capacity to pay full fees. NSW Trustee and Guardian is considered a self-funded agency by NSW Treasury definitions.

Demand for financial management and guardianship services, and the complexity of clients' circumstances for these services, has grown over the last decade. In November 2020, NSW Trustee and Guardian advised the Attorney General that it had run an operating deficit in 2019–20 driven by an increase in non/low fee paying customers and an increase in the complexity of matters. NSW Trustee and Guardian advised the Attorney General that government funding was no longer meeting the full cost of guardianship services, and of direct financial management services for people with low balances. NSW Trustee and Guardian's analysis had identified a shortfall in government funding of $8.4 million in 2019–20 that was expected to increase over the forward estimates. A working group was established with officers from NSW Trustee and Guardian, NSW Treasury and the Department of Communities and Justice to advise the government on options for improving the financial sustainability of NSW Trustee and Guardian overall.

NSW Trustee and Guardian subsequently received a funding boost of $41.5 million across four years in the 2021–22 State Budget. NSW Trustee and Guardian applied the majority of the budget enhancement to recruit approximately 120 new roles mostly in financial management and guardianship services.

The objective of this audit was to assess whether NSW Trustee and Guardian is effectively delivering guardianship and financial management services in line with legislative requirements and relevant non-legislative standards. These include a legislative duty to observe certain principles when exercising the relevant legislative functions, including to: give primary consideration to clients’ welfare and interests, restrict their freedom of decision and action as little as possible, take account of their views, and encourage their self-reliance.

The audit was guided by three questions:

• Does NSW Trustee and Guardian align its service delivery with its legislative functions and principles, and relevant standards?
• Does NSW Trustee and Guardian drive and monitor performance to give effect to its legislative functions and principles, and relevant standards?
• Has NSW Trustee and Guardian effectively planned the use of additional funding to improve service delivery and adherence to its legislative functions and principles, and relevant standards?

The audit review period was the five years between 1 July 2017 - 30 June 2022.

Throughout this report:

• 'client' refers to a person who is under a guardianship order and/or whose estate is under financial management, for whom the Public Guardian and/or the NSW Trustee is appointed to act or responsible to oversee their private financial manager
• 'financial management' refers to clients under financial management orders (direct and private financial management) and/or the services provided by NSW Trustee and Guardian to these clients or their private managers
• 'guardianship' refers to clients under guardianship orders where the Public Guardian is appointed, and/or the services provided by the Public Guardian to these clients
• 'frontline staff' refers to the staff responsible for engagement with, and decision-making for, clients and private managers (titled client service officers, senior client service officers and principal client service officers in NSW Trustee and Guardian)
• Aboriginal refers to the First Nations peoples of the land and waters now called Australia and includes Aboriginal and Torres Strait Islander peoples.

NSW Trustee and Guardian has only recently identified measures to track the performance of its financial management and guardianship services

Between 2021 and 2022, NSW Trustee and Guardian developed new divisional key performance indicators which aim to track the quality of services delivered to people under financial management and guardianship orders. These measures are reported quarterly to the organisation's executive leadership team. The divisions have started measuring some of these new performance indicators, but many will require changes to consumer engagement processes and IT legacy systems to collect additional data. At this stage it is unclear when these necessary changes will occur, and when relevant data will begin to be collected and analysed.

Before 2021, NSW Trustee and Guardian measured the performance of some of its financial management and guardianship operational processes. While these operational measures identify whether it is fulfilling some of its legislative functions, they are predominantly activity measures and do not inform on the quality of decision-making for direct financial management or guardianship clients, or on client experiences and outcomes.

Operational performance targets and measures have only recently been developed and used to centrally track the time elapsed between requests for certain decisions and the decisions made or relevant actions taken by relevant frontline staff. Baseline data for these measures show that target timeframes are not close to being met for minor medical decisions for people under guardianship orders, or for first customer payment, and redirection of income for people who are directly financially managed.

NSW Trustee and Guardian has proactively developed a benefits realisation framework to monitor the expected benefits from the additional funding received in 2021–22

NSW Trustee and Guardian has developed a benefits realisation framework to monitor the expected benefits from the additional funding (and other elements of the budget bid including increased fees and business improvements for efficiencies). This is not a requirement imposed by NSW Treasury, but a proactive step taken by NSW Trustee and Guardian to account for the use of the additional funding and to attempt to identify its impacts.

The benefits realisation framework includes interim and preferred measures, which reflect the things that can be tracked with existing data, and those that require new data collection, respectively. The measures are underpinned by separate program logics for direct and private financial management, and guardianship, and an overall investment logic. 'Logics' articulate the inputs, outputs and short/medium/long term outcomes expected from a project, program or investment, as well as the underpinning assumptions about how desired changes will occur (the 'mechanism' or 'theory' of change).

The targets and measures for NSW Trustee and Guardian's benefits realisation framework are the responsibility of the organisational divisions delivering guardianship and financial management services. The baseline data against which change will be measured is 30 June 2021, as the budget enhancement funds were allocated from 1 July 2021. The audit has been provided with baseline data, but not first year results (covering 2021–22) and as such, cannot assess whether any progress has been made towards the targets.

The benefits realisation framework may not provide the information needed to demonstrate the effectiveness of the budget enhancement

A lack of available data and limited measures in the benefits realisation framework may mean NSW Trustee and Guardian will not be able to meaningfully assess the impact of the additional funding.

The 22 measures in the benefits realisation framework across guardianship and financial management functions are predominantly monitoring activity and outputs which seek to track staff caseloads, the number of decisions made, the timeliness of key actions/tasks, and annual consumer engagements.

There is one service quality outcome measure: that customers, family and carers report an improved experience. The metrics for this measure will initially be monitored using the whole-of-government customer satisfaction measurement survey administered by the Department of Customer Service, until such time as other additional sources are developed. The whole-of-government survey is built around six core customer commitments relating to respondents' experiences with government services and staff - that they are: 'easy to access, act with empathy, respect my time, explain what to expect, resolve the situation and engage the community'. It is not clear whether or how the whole-of-government survey targets and engages people with impaired decision-making capacity or accessible communication needs.

Some measures in the NSW Trustee and Guardian benefits realisation framework do not yet have targets set, such as the ratio of the number of clients to the number of guardians or financial managers. Many relate to compliance with internal operational policies.

One interim measure for a direct financial management service indicator is 'increased personalised face-to-face consultations by phone or virtually'. It is intended to be replaced with the preferred measure 'ensure the client’s story is understood by staff and systems by consulting stakeholders and adding to the client’s story in the IT system'. However, the interim measure would better align with the national standards regarding regular and accessible engagement (discussed above).

A lack of availability of key data to track the preferred measures was identified by NSW Trustee and Guardian as an enterprise risk, and issues with existing data collected were identified early on, including that:

• data can be entered into systems inconsistently by staff
• current systems mask some issues – for example, a task can be completed within internal timeframes but not reflect the actual waiting time of consumers
• current systems cater to measuring outputs rather than service quality.

IT system improvements are slated in order to allow data to be collected to inform on preferred measures, but these depend on capital funding that has not yet been secured. At the time of writing, data sources were yet to be identified for three of the 22 measures, and NSW Trustee and Guardian did not have staff trained and available to run and analyse data for the benefits realisation framework.

The mechanisms of change and the underlying assumptions in the program and investment logics are also not clearly articulated in the benefits realisation framework, and nor is the underpinning evidence (such as from earlier reviews, research or pilots, or experiences elsewhere). Identifying and evidencing these would give some confidence that the assumptions are sound and that the mechanisms of change will operate as expected (for example, that a decline in frontline staff caseloads will translate into more time spent on individual matters, and improved service quality).

Given these limitations in measures, data collection and logics, there is a risk that the benefits realisation framework may not provide the performance and impact evidence necessary to assess the effectiveness of the budget enhancement, or to justify further additional funding in the future.

NSW Trustee and Guardian cannot track its financial management and guardianship service performance over time

NSW Trustee and Guardian's operational performance activity measures have changed over the audit review period, which limits NSW Trustee and Guardian’s ability to identify whether it has sustained or improved performance in its guardianship and financial management services over time.

NSW Trustee and Guardian has consistently tracked the number and themes of complaints about financial management and guardianship services, which do provide some insight into service quality and experiences. However, this is an incomplete measure as people under financial management and guardianship orders are a more vulnerable cohort than other NSW Trustee and Guardian customers and may require support to make a complaint. There is also a structural power imbalance between clients and their guardian or financial manager which may dissuade clients and their stakeholders from raising concerns. Therefore, it is not clear whether the numbers and themes in complaints received are representative of broader experiences.

Appendix one – Response

Appendix two – Client characteristics

Appendix three – Easy English, Easy Read and Plain English formats

Appendix four – Financial management fees

Appendix five – NSW Trustee and Guardian Common Funds

Appendix six – About the audit

Appendix seven – Performance auditing

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #379 - released 18 May 2023

What the report is about

Results of the Stronger Communities cluster agencies' financial statement audits for the year ended 30 June 2022.

What we found

Unqualified audit opinions were issued on all completed 30 June 2022 financial statement audits. One audit is ongoing.

All 13 cluster agencies that have accommodation arrangements with Property NSW derecognised right-of-use assets and lease liabilities of $917 million and $1 billion respectively. The agencies also collectively recorded a gain on derecognition of $136 million.

The Department of Communities and Justice (the department) assumed the responsibility for delivery of the Process and Technology Harmonisation program from the Department of Customer Service. In 2021–22, the department incurred costs of $42.8 million in relation to the project, which remains ongoing.

The number of monetary misstatements identified during the audits decreased from 50 in 2020–21 to 48 in 2021–22.

What the key issues were

Six of the 15 cluster agencies required to submit 2021–22 mandatory early close procedures did not meet the statutory deadlines. One agency did not complete all mandatory procedures.

Five high-risk findings were identified in 2021–22. They related to deficiencies in:

• user access administration at the department, NSW Rural Fire Service and New South Wales Aboriginal Land Council (NSWALC)
• segregation of duties at the NSW Trustee and Guardian and NSWALC.

Recommendations were made to those agencies to address these control deficiencies.

This report provides Parliament and other users of the Stronger Communities cluster’s financial statements with the results of our audits, analysis, conclusions and recommendations in the following areas:

• financial reporting
• audit observations.

Financial reporting is an important element of good governance. Confidence and transparency in public sector decision making are enhanced when financial reporting is accurate and timely.

This chapter outlines our audit observations related to the financial reporting of agencies in the Stronger Communities cluster (the cluster) for 2022.

Appropriate financial controls help ensure the efficient and effective use of resources and administration of agency policies. They are essential for quality and timely decision making.

This chapter outlines our observations and insights from our financial statement audits of agencies in the Stronger Communities cluster.

Appendix one – Misstatements in financial statements submitted for audit

Appendix two – Early close procedures

Appendix three – Timeliness of financial reporting

Appendix four – Financial data

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

What the report is about

In this report, we have analysed the key findings and recommendations from our audit reports over the past four years.

This analysis includes financial audits, performance audits, and compliance audits of state and local government entities that were tabled in NSW Parliament between July 2018 and February 2022.

The report is framed by recognition that the past four years have seen significant challenges and emergency events.

The scale of government responses to these events has been wide-ranging, involving emergency response coordination, service delivery, governance and policy.

The report is a resource to support public sector agencies and local government to improve future programs and activities.

What we found

Our analysis of findings and recommendations is structured around six key themes:

• Integrity and transparency
• Performance and monitoring
• Governance and oversight
• Cyber security and data
• System planning for disruption
• Resource management.

The report draws from this analysis to present recommendations for elements of good practice that government agencies should consider in relation to these themes. It also includes relevant examples from recent audit reports.

In this report we particularly call out threats to the integrity of government systems, processes and governance arrangements.

The report highlights the need for balanced advice to government on options and risks, for transparent documentation and reporting of directions and decisions, and for early and open sharing of information with integrity bodies and audit.

A number of the matters highlighted in this report are similar to those described in our previous Insights Report, (Performance Audit Insights: key findings from 2014–2018) specifically in relation to cyber and information security, to performance measurement, reporting and evaluation, and system and workforce planning and capability.

I am pleased to present the Audit Insights 2018–2022 report. This report describes key findings, trends and lessons learned from the last four years of audit. It seeks to inform the New South Wales Parliament of key risks identified and to provide insights and suggestions to the agencies we audit to improve performance across the public sector.

The report is framed by a very clear recognition that governments have been responding to significant events, in number, character and scale, over recent years. Further, it acknowledges that public servants at both state and council levels generally bring their best selves to work and diligently strive to deliver great outcomes for citizens and communities. The role of audit in this context is to provide necessary assurance over government spending, programs and services, and make suggestions for continuous improvement.

A number of the matters highlighted in this report are similar to those described in our previous Insights Report, (Performance Audit Insights: key findings from 2014–2018) specifically in relation to cyber and information security, to performance measurement, reporting and evaluation, and system and workforce planning and capability.

However, in this report we particularly call out threats to the integrity of government systems, processes and governance arrangements. We highlight the need for balanced advice to government on options and risks, for transparent documentation and reporting of directions and decisions, and for early and open sharing of information with integrity bodies and audit. Arguably, these considerations are never more important than in an increasingly complex environment and in the face of significant emergency events and they will be key areas of focus in our future audit program.

While we have acknowledged the challenges of the last few years have required rapid responses to address the short-term impacts of emergency events, there is much to be learned to improve future programs. I trust that the insights developed in this report provide a helpful resource to public sector agencies and local government across New South Wales. I would be pleased to receive any feedback you may wish to offer.

Margaret Crawford
Auditor-General for New South Wales

This report brings together a summary of key findings arising from NSW Audit Office reports tabled in the New South Wales Parliament between July 2018 and February 2022. This includes analysis of financial audits, performance audits, and compliance audits tabled over this period.

• Financial audits provide an independent opinion on the financial statements of NSW Government entities, universities and councils and identify whether they comply with accounting standards, relevant laws, regulations, and government directions.
• Performance audits determine whether government entities carry out their activities effectively, are doing so economically and efficiently, and in accordance with relevant laws. The activities examined by a performance audit may include a selected program or service, all or part of an entity, or more than one government entity. Performance audits can consider issues which affect the whole state and/or the local government sectors.
• Compliance audits and other assurance reviews are audits that assess whether specific legislation, directions, and regulations have been adhered to.

This report follows our earlier edition titled 'Performance Audit Insights: key findings from 2014–2018'. That report sought to highlight issues and themes emerging from performance audit findings, and to share lessons common across government. In this report, we have analysed the key findings and recommendations from our reports over the past four years. The full list of reports is included in Appendix 1. The analysis included findings and recommendations from 58 performance audits, as well as selected financial and compliance reports tabled between July 2018 and February 2022. The number of recommendations and key findings made across different areas of activity and the top issues are summarised at Exhibit 1.

The past four years have seen unprecedented challenges and several emergency events, and the scale of government responses to these events has been wide-ranging involving emergency response coordination, service delivery, governance and policy. While these emergencies are having a significant impact today, they are also likely to continue to have an impact into the future. There is much to learn from the response to those events that will help the government sector to prepare for and respond to future disruption. The following chapters bring together our recommendations for core elements of good practice across a number of areas of government activity, along with relevant examples from recent audit reports.

This 'Audit Insights 2018–2022' report does not make comparative analysis of trends in public sector performance since our 2018 Insights report, but instead highlights areas where government continues to face challenges, as well as new issues that our audits have identified since our 2018 report. We will continue to use the findings of our Insights analysis to shape our future audit priorities, in line with our purpose to help Parliament hold government accountable for its use of public resources in New South Wales.

Appendix one – Included reports, 2018–2022

Appendix two – About this report

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

What the report is about

This audit examined a state-wide program to provide small-group tuition to students disadvantaged by the move to learning from home during 2020.

The audit assessed the design and implementation of the program.

What we found

The program design was based on research and data showing learning loss during 2020. 

The department rapidly planned and developed the policy design and guidelines for schools. 

Governance arrangements matured during program delivery.

The department changed the models for funding schools but did not clearly explain the reasons for doing so.

Government schools with over 900 students were disadvantaged by the funding model compared to smaller schools. 

Guidelines, resources and professional learning helped schools implement the program.

Staff eligibility for the program was expanded after reported difficulties in recruiting qualified teachers in some areas. 

Online tuition and third-party provider options were developed throughout the program.

There were issues with the quality and timeliness of data used to monitor school progress. 

Evaluation arrangements were developed early in the program.

Data limitations mean the evaluation will not be able to fully assess all program objectives.

What we recommended

1. Distributing funds between schools more equitably and improving communication of the funding methods. 
2. Clearer communication about the intended targeted group of students.
3. Reviewing the time needed to administer the program.
4. Improve support for educators other than qualified teachers.
5. Offer the online tuition program to more schools.
6. Analysis of the effects of learning from home during 2021 across equity groups and geographic areas.
7. Working with universities to increase use of pre-service teachers in the program.

The report also identifies lessons learned for future programs.
 

The NSW Government announced the COVID Intensive Learning Support Program on 10 November 2020, as part of the 2020–21 NSW Budget. The primary goal of the $337 million program was to deliver intensive small group tuition for students who were disadvantaged by the move to remote and/or flexible learning, helping to close the equity gap. It included:

• $306 million to provide small-group tuition for eligible students across every NSW Government primary, secondary and special purpose school
• $31.0 million for around 400 non-government schools to provide small-group tuition to students with the greatest levels of need.

The objective of this audit was to assess the effectiveness of the design and implementation of the COVID Intensive Learning Support Program (the program). To address this objective, the audit assessed whether the Department of Education (the department):

• effectively designed the program and supporting governance arrangements
• is effectively implementing the program.

This audit focuses on activities between October 2020 and August 2021, which aimed to address the first session of learning from home in New South Wales. From August to October 2021, students in many areas of New South Wales were learning from home again, but this second period has not been a focus of this audit. On 18 October 2021, the NSW Government announced the program would be extended into 2022.

This chapter considers how effectively the COVID Intensive Learning Support Program (the program) was designed and planned for implementation.

This chapter considers how effectively the COVID Intensive Learning Support Program was implemented over our period of review (Terms 1 and 2, 2021).

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #358 - released (15 December 2021).

What the report is about

The report assessed how effectively the Department of Communities and Justice is responding to homelessness through the NSW Government’s Homelessness Strategy.

It also assessed the effectiveness of the department’s efforts to address street homelessness in its COVID-19 response.

What we found

The strategy was designed to build evidence to inform future state-wide action rather than to end homelessness.

The department received significantly less funding than it sought for the strategy.

Actions delivered under the strategy have a narrow reach in terms of locations and number of people targeted for assistance.

The strategy will have limited short-term impact on homelessness across NSW, but it is building evidence on what works to prevent and reduce homelessness.

The department effectively implemented a crisis response to assist over 4,350 people sleeping rough into temporary accommodation during the pandemic.

While there was an effective crisis response to assist people sleeping rough during the pandemic, more will need to be done to ensure a sustainable response which prevents people returning to homelessness.

What we recommend

The department should:

• provide advice to the NSW Government on sustainably addressing demand and unmet need for homelessness supports
• commence development of a comprehensive strategy to address homelessness, linked to the government’s 10-year plan for social housing and 20-year housing strategy
• enable input to key decisions on homelessness policy from partner agencies, the specialist homelessness services sector, the community housing sector, Aboriginal people, and people with lived experience of homelessness
• partner with Aboriginal stakeholders and communities to design and implement a strategy for early identification and responses to the needs of Aboriginal people vulnerable to homelessness; and build the capacity and resourcing of the Aboriginal Community Controlled Sector to deliver homelessness services
• evaluate the homelessness response to COVID-19, integrate the lessons learned into future practice, and develop protocols to inform actions in future emergencies or disasters
• regularly collect client outcomes data and feedback and use this to drive improvements to responses to homelessness.

Further information

Please contact Ian Goodwin, Deputy Auditor-General on 9275 7347 or by email.

Homelessness exists when a person does not have suitable accommodation alternatives. A person is considered to be experiencing homelessness if their current living arrangement:

• is in a dwelling that is inadequate; or
• has no tenure, or if their initial tenure is short and not extendable; or
• does not allow them to have control of, and access to space for social relations.

The number of people experiencing homelessness in New South Wales increased by 37 per cent between the last two censuses, from 27,479 in 2011, to 37,715 in 2016. New South Wales recorded the largest increase of all the states and territories in both the number of people experiencing homelessness and in the homeless rate (from 40.8 to 50.4 persons per 10,000).

The NSW Government's primary service response to homelessness is crisis, temporary and transitional accommodation, and support services, funded at more than $1.0 billion over four years from 2018–19. These are ‘commissioned services’ delivered by non‑government organisations under contracts with the Department of Communities and Justice (the Department) and out of scope for this audit. We assessed how the Department manages contracts for specialist homelessness services in our 2019 audit 'Contracting non‑government organisations'.

The policy framework for the NSW Government's response to homelessness is the NSW Homelessness Strategy 2018–23 (the Strategy), which is examined in this audit. The Department is responsible for the development, implementation, monitoring and evaluation of the Strategy. The Strategy comprises 21 actions, ten of which directly target people at risk of, or already experiencing, homelessness through measures such as:

• screening high school students for the risk of homelessness and providing supports
• assisting vulnerable people to maintain their tenancies in social housing or the private rental market
• providing purpose‑built social housing.

These ten actions comprise $160 million of the Strategy's $169 million funding.

In December 2019, the first evidence of the COVID‑19 virus emerged. People sleeping without shelter or in public places (sleeping rough) typically live in communal arrangements, with some having limited access to basic hygiene supplies or showering facilities. These factors may increase the risk of transmission of COVID‑19 amongst this population.

In response to the pandemic, the NSW Government provided additional funding for the Department to institute a range of actions aimed at preventing vulnerable people from becoming homeless, and people sleeping rough from contracting or transmitting the virus. These were informed by, but separate to, actions under the Homelessness Strategy.

This audit focused on the temporary accommodation provided to individuals experiencing street homelessness during the pandemic, and the new 'Together Home' program established in 2020 to transition people with experience or history sleeping rough from temporary accommodation into more sustainable longer‑term housing.

This audit assessed how effectively the Department is implementing the Homelessness Strategy and addressing street homelessness in its COVID‑19 response. In making this assessment, the audit examined whether the Department:

• has effectively developed an evidence‑based Strategy and established supporting arrangements to implement it
• is ensuring the Strategy is achieving its objectives and outcomes
• is effectively supporting people sleeping rough into temporary accommodation during COVID‑19 and to transition into more sustainable longer‑term housing.

1. Key findings: the Homelessness Strategy

The Strategy's geographical and client reach is limited because it is building the evidence base on what works

The Department's objectives to intervene early, provide effective supports and create an integrated person‑centred system to address homelessness are clear, but are not being pursued state‑wide.

There were existing gaps in the available evidence which made it difficult for the Department to develop a holistic, state‑wide, long‑term solution to homelessness. Some of the actions under the Strategy have a degree of supporting evidence. Other actions are intended to generate evidence through pilots and by evaluating existing programs more robustly.

At least one Strategy action is available in each of the Department's 16 districts, and there are examples of the Department rolling out practice changes from Strategy pilots across the state. However, progress towards the Strategy aims is confined to pockets where actions are being trialled.

Once fully implemented, Strategy actions will be available in only a quarter of the state's 128 local government areas and will support approximately 8,200 people ‑ which equates to around 22 per cent of the number of people who were experiencing homelessness at the time of the last census in New South Wales in 2016 more than 37,000 people. This does not include the number of people at risk of homelessness.

A key gap in Strategy actions is addressing Aboriginal homelessness.

The Department received significantly less funding than sought and designed the Strategy to build the evidence base rather than eliminate homelessness

The Department could not meet the evidence threshold for a cost benefit analysis required by a Treasury business case, given the limited evidence available locally and internationally on what works to prevent homelessness or intervene earlier. The Department sought new, targeted investment to extend a small number of initiatives with proven effect, and to build the evidence base about other measures that work, rather than the quantum of funding required to end homelessness in New South Wales.

Even so, approved funding was significantly less than that sought by the Department. It repurposed existing resources, dropped some proposed actions and scaled others down to fit within the final funding envelope. It directed 95 per cent of the total Strategy funding to supports and accommodation for people at risk of or experiencing homelessness.

The Department intends to use the gathered data from implementation of the Strategy to expand effective prevention and early intervention measures after it concludes, subject to budget approval. It expects that, over time, these initiatives will reduce the demand for crisis services.

Actions may not be scaled up at the end of the Strategy's term, perpetuating the Strategy's limited reach and narrow impact on homelessness

The Department's approach of testing interventions and building the evidence base through the Strategy was well described and provided a clear rationale in its original advice to government. An evaluation framework has been designed to generate sufficient evidence on the overall Strategy and its individual actions for a cost benefit analysis to support a future budget bid.

The Department intends to use the findings from interim evaluation reports, due by September 2021, to determine the programs and pilots with promising evidence that should continue to the end of the Strategy term. It expects this to enable more qualitative and quantitative data to be available to the evaluations, as well as to support service continuity.

However, delays in delivery of some actions under the Strategy, and the time taken for outcomes to be achieved and show up in the data, will impact on the strength of the evidence available at the mid‑term and final Strategy evaluation points. This raises a risk that future funding for a comprehensive Strategy will not be secured ‑ and prevention and early intervention activities not continued or scaled up beyond pilot sites ‑ if the evidence on effectiveness is incomplete, mixed or unclear when the Strategy concludes.

Given its limited reach, even if the existing Strategy actions were retained, and no expansion occurred, it would continue to have a narrow impact on homelessness in New South Wales. This sits against a backdrop of increasing need for housing and homelessness supports in the state that may become more acute once the full economic impacts of the COVID‑19 pandemic are felt.

2. Key findings: the COVID‑19 response to homelessness

The Department effectively planned and implemented its homelessness response to the pandemic and reduced the risk of transmission of COVID‑19 for people sleeping rough

The Department's crisis response focused on people sleeping rough due to the public health risk of COVID‑19 transmission amongst this group.

The Department engaged with the specialist homelessness services sector from mid‑March 2020 to modify service delivery, advise on infection control and plan extra supports. It explored options with temporary accommodation providers to support self‑isolation for clients, and scaled up its assertive outreach patrols by staff, specialist caseworkers and health professionals to support people sleeping rough into crisis or temporary accommodation for safety.

The Minister directed the Department to address street homelessness in the COVID‑19 response using the Government’s second stage of stimulus funding. The Department procured hotel, motel or serviced apartment accommodation for 400 people who were sleeping rough, or unable to physically distance in large crisis accommodation centres, within a week of the ministerial direction, building on existing programs. The Department provided advice to the Minister on the need to adjust existing policy settings to meet the forecast demand for temporary accommodation services.

The Department secured additional temporary accommodation when and where it was required, to accommodate the number of people sleeping rough who wanted support. Between 1 April 2020 and 31 January 2021, the Department provided temporary accommodation to 32,158 individuals, of which 4,355 people were sleeping rough, totalling more than 70,000 nights of temporary accommodation and services.

The Department met regularly with NSW homelessness peak organisations and established a Taskforce involving other government agencies, peak organisations, and service providers, to assist in quickly executing the measure and resolving issues arising. The Taskforce built on existing collaborative arrangements in place to support cross‑sectoral coordination, enabling it to respond quickly to COVID‑19.

The Department worked with NSW Health and health providers to ensure its COVID‑19 response to homelessness was in line with health guidelines. As of May 2021, just one participant in the Department's enhanced temporary accommodation program had contracted COVID‑19.

The Department does not know how many people sleeping rough who were assisted with enhanced temporary accommodation have returned to homelessness

Within metropolitan Sydney, the Department established a specialist housing team, and contracted a non‑government provider, to connect people placed in hotels with support services, provide tailored support, and to assist and monitor their transition to longer‑term housing.

The Department’s data indicates that between May 2020 and 31 January 2021, over 1,800 people who had previously been sleeping rough had been engaged in this program, more than four times the expected client numbers. Almost half moved into further accommodation when they left the program, including people supported with longer‑term housing such as social housing, community leasing under the Together Home program, and private rental arrangements.

However, the Department did not track the housing outcomes for clients who were not provided with this support, or who disengaged from services. The Department advises that this would have required additional resourcing to do so.

The Department offers assistance to people in temporary accommodation to find longer term options, and has a policy to not knowingly exit someone from temporary accommodation into homelessness. However, it does not track housing outcomes for every client if they do not engage with the Department's housing or funded support services. It intends to conduct research in the future to better understand what happens to people who leave temporary accommodation without seeking further assistance from the Department.

The Department cannot identify precisely how many people sleeping rough who were assisted during COVID‑19 have returned to rough sleeping or other forms of homelessness. The Department’s data suggests that 72 per cent of the approximately 4,000 people formerly sleeping rough who left temporary accommodation between April 2020 and April 2021 left with an unknown housing outcome. This includes people who were not eligible for social housing, were stranded due to border closures, or who disengaged from the Department or funded support services.

The Department also has limited data to understand whether the enhanced temporary accommodation program was more effective in helping to connect participants with services and support them into stable accommodation, than previous approaches.

The Together Home program was established quickly to assist people into more permanent accommodation but will not meet demand as a standalone response

The Department established the Together Home program in September 2020 to provide longer‑term accommodation to people who were sleeping rough during the pandemic. Community housing providers head‑lease properties in the private rental market for two years and sub‑lease these to clients, while ensuring they receive additional support, such as health services, to help them maintain the lease.

Under the initial tranche of funding, the Together Home program aimed to support 400 people sleeping rough. This target was met by April 2021. Due to increased rental demand in many areas of the state, there were some delays in securing properties in certain areas. In addition, people on temporary visas, or with existing public housing debt, are ineligible for this program.

A further $29.0 million was provided to this program through the 2020–21 NSW Budget, creating 400 additional program places. However, the total number of 800 Together Home places will not be sufficient to provide housing for the more than 4,000 individuals who were sleeping rough prior to entering enhanced temporary accommodation.

The Department advises it is using a range of ‘business‑as‑usual’ options to assist other people sleeping rough into stable accommodation outside of the Together Home program. These options include social housing, supported transitional accommodation, subsidised private rental, boarding houses, and referral to mental health and substance addiction rehabilitation facilities.

The Department’s latest annual state‑wide street count suggested that the number of people sleeping rough across New South Wales decreased by 13 per cent between February 2020 and February 2021. The Department has acknowledged that it could do more to monitor and support the housing outcomes for people in temporary accommodation after they exit.

The Department has plans to secure longer‑term housing options for Together Home clients after the two‑year program, through commissioned community housing and private rental assistance. However, it is not clear how this will overcome existing housing challenges given the complexity of needs amongst this client group, the limited availability of affordable rental properties and the existing scale of unmet need for social housing.

3. Recommendations

By July 2022, the Department of Communities and Justice should:

1. use data and analysis identified through the Homelessness Strategy 2018–2023 and provide advice to the NSW Government on sustainably addressing demand and unmet need for homelessness supports

2. use the evidence obtained through the Homelessness Strategy 2018–2023 to commence development of a comprehensive strategy to address homelessness, linked to the government’s ten‑year plan for social housing and 20‑year housing strategy

3. establish and sustain governance arrangements that enable input to key decisions on homelessness policy from partner agencies, the specialist homelessness services sector, the community housing sector, Aboriginal people and people with lived experience of homelessness

4. in partnership with Aboriginal stakeholders and communities, design and implement a strategy for early identification and responses to the needs of Aboriginal people vulnerable to homelessness; and build the capacity and resourcing of the Aboriginal Community Controlled Sector to deliver homelessness services

5. evaluate the homelessness response to COVID‑19 and integrate the lessons learned into future practice; and develop protocols to inform actions in future emergencies/disasters

6. establish and sustain a means to regularly collect client outcomes data and feedback; and use this to drive improvements to responses to homelessness.

This chapter considers how effectively the NSW Homelessness Strategy was developed and is currently being implemented by the Department of Communities and Justice.

This chapter examines how effectively the Department of Communities and Justice addressed homelessness in its response to the COVID‑19 pandemic, and how well it is applying lessons learned from the pandemic to future policy and service development.

Appendix one – Response from agency

Appendix two – Actions within the NSW Homelessness Strategy 2018–23

Appendix three – Reported progress on Homelessness Strategy actions to date (unaudited)

Appendix four – Key homelessness data collections

Appendix five – Temporary accommodation for people sleeping rough standard practice vs COVID 19 response

Appendix six – Key measures in the COVID 19 response to homelessness

Appendix seven – About the audit

Appendix eight – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #350 - released (4 June 2021).

The Auditor-General for New South Wales, Margaret Crawford, released a report today examining the planning and delivery of new, redeveloped and upgraded public schools.

School Infrastructure NSW has identified the need to accommodate an additional 180,000 enrolments in public schools by 2039 with a large portion of this growth expected in metropolitan Sydney. It has also identified that around 34,000 teaching spaces will require upgrading to be fit-for-purpose.

Although School Infrastructure NSW has developed a long-term strategic plan that advises government of ongoing funding requirements, it has not presented a list of priorities to meet those needs. Developing a longer-term list of priorities would help signal the areas of greatest need and allow more time to develop the best options to meet those needs.

The audit found that School Infrastructure NSW has focused on delivering existing projects, election commitments and other government announcements. This has diverted attention from identifying and delivering projects that would have better met present and future needs. 

The report makes eight recommendations to improve long-term planning for future needs, strengthen the quality of estimated project costs and benefits, and embed a continuous improvement program. 

In 2016, the Department of Education prepared a School Assets Strategic Plan (2016 SASP) which outlined long-term funding needs to support the expected growth in enrolments to 2031. Following the release of the 2016 SASP, the NSW Government substantially increased funding for new and upgraded schools from $2.4 billion in the 2016–17 State Budget to $4.2 billion in 2017–18.

In 2017, the Department of Education established School Infrastructure NSW (SINSW) to lead the delivery of the 2016 SASP and the 123 new projects announced in the 2017–18 Budget. This significantly larger program of work required rapid development of internal capacity, governance arrangements, and project management systems. This needed to be done at the same time as scoping and planning for the list of announced projects.

As there are limited funds available to meet growing needs across the State, it is important that SINSW has effective methods to prioritise projects to communities with the greatest need. To ensure that projects deliver value for money, business cases need to have robust estimates of project costs and benefits. Business cases also need to account for the inherent risks in delivering infrastructure projects. Unplanned cost escalations can reduce the number of new or modernised classrooms SINSW can deliver. Unforeseen delays may also impact families who make significant life choices based on their expectations that a school will open at the beginning of the school year.

The objective of this audit was to assess the effectiveness of planning and delivery of new, upgraded and redeveloped schools to meet demand for public school education in New South Wales. To address this objective, the audit examined whether the Department:

• has effective procedures for planning and prioritising school capital works to meet present and future demands
• develops robust business cases for school capital works that reliably inform decision-making
• has effective program/project governance and management systems that support delivering projects on-time, within budget and achievement of intended benefits.

The audit examined business cases for 12 projects as case studies. These include a mix of projects initiated before and after the establishment of SINSW.

This audit commenced in June 2020 and examined strategies and demographic projections developed prior to the emergence of COVID-19. This audit did not examine potential longer-term impacts of COVID-19 on future demands for public school education.

1. Key findings

SINSW delivered projects against an established program of works in its first years of operation

At establishment, SINSW inherited a portfolio of existing projects and 123 new projects announced as part of the 2017–18 Budget (to commence over 2017–18 and 2018–19). It has progressively worked through individual project planning to deliver against these projects.

The 2018–19 Budget funded two new projects that had not already been announced. Both projects were identified by SINSW as a priority. The 2018–19 Budget also allocated funding for 'planning' 22 new projects. Seventeen of the 22 projects had been identified by SINSW as a priority.

SINSW identified 31 new priority projects in its Capital Investment Plan for 2019–20. Thirteen of these projects were funded in that year with a further 27 projects included as election commitments. SINSW identified 20 new projects in its Capital Investment Plan for 2020–21 but only two of these were funded. SINSW advised this was due to a constrained budget environment.

There is an anticipated shortfall of classrooms based on the current funded program

Despite increased funding since 2017–18, SINSW advised the NSW Government in early 2020 that the currently funded infrastructure program would not meet forecast classroom requirements for 2023 and beyond. Accordingly, it is vital that new funding is prioritised to projects which best meet demand.

SINSW only identified specific priorities over a two-year horizon in its Capital Investment Plans for 2018–19, 2019–20 and 2020–21. The School Assets Strategic Plan 2016 and the 2020 update make the case for sustained funding for school building and redevelopment. These plans estimate annual funding requirements and show geographic areas with increasing forecast enrolments. Detailing how priorities over a ten-year timeframe fit within a ten-year capital planning limit would create more certainty about meeting growth demands.

There has been progress in formalising prioritisation frameworks, data tools and supporting governance arrangements

SINSW committed to planning for new and redeveloped schools in 'School Community Groups' in the School Assets Strategic Plan 2016. This is a new way of planning which considers the educational needs over a defined geographical area. It has developed a planning tool to prioritise School Community Groups based on weighted criteria. It has also established governance frameworks to improve transparency over decisions to reprioritise this list.

SINSW has refined its approach to planning in School Community Groups over the past four years. It now prepares Service Needs Reports to investigate needs, identify projects, prioritise, determine scope and timing, and assess non-capital options. SINSW has yet to finalise arrangements for how needs identified in Service Needs Reports progress to the strategic business case stage.

Projects announced prior to developing a business case have less opportunity to consider a range of options to meet the service needs

Business cases for projects already announced by government (or announced for planning) go through the same process of determining the service need and impacts on surrounding schools. However, for some announced projects, the range of options considered in the business case is influenced by the parameters of the announcement. This makes it more difficult to genuinely pursue alternate options that could better meet the identified service need.

Projects identified by SINSW have a more rigorous process of considering options. Service Needs Reports explore a wide range of asset and non-asset interventions across the School Community Group. Options are narrowed as the projects move through the strategic and final business case stages. SINSW uses its Investment Review Committee to engage key stakeholders early in the process so that they are informed about how non-asset solutions have been considered and why SINSW is progressing the business case for a capital solution for particular projects.

Several business cases underestimated project costs and risks, leading to scope and budget increases

Several business cases we reviewed did not adequately identify the initial scope requirements, project-specific risks or the likely project cost. For two business cases, this appeared to be due to an attempt to fit the project within a predetermined amount. Announcing a project’s scope, budget and timeframe before proper planning increases risks to successful delivery against expectations.

Several of the projects we examined required drawdowns on contingency funds due to inadequate consideration of scope, costs and project risks at the planning stage. Contingency funds are intended for unanticipated extra costs rather than those that could have or should have been identified at the planning stage.

Guidance on benefit calculations has provided a consistent framework for business cases

Business cases we examined presented a consistent set of benefits based on guidance developed in partnership with NSW Treasury. Following this guidance helps to compare cost-benefit analyses across business cases. However, the evidence for the estimated benefits is based on contexts outside of NSW. SINSW has the tools and data sources to calculate benefits more suited to the context of particular schools. Doing so would improve the accuracy of cost-benefit analyses. SINSW advised that it is currently updating the guidance in partnership with NSW Treasury.

SINSW involves school principals, executives and teaching staff in developing education rationales when commencing projects. These documents help align projects with education outcomes. They also provide a baseline for post-occupancy evaluation, which is important to determine whether the new school infrastructure is being used in the ways that were anticipated in the business case.

SINSW could elevate its existing assurance review process to consolidate lessons learned

SINSW engages external peer reviewers to conduct assurance reviews on its projects at multiple stages of planning and delivery. It has established a Community of Practice for external reviewers to keep them up to date on new developments and requirements. Higher value projects are also subject to review by Infrastructure NSW under the Investor Assurance Framework.

By looking at all projects at all stages, assurance reviews can identify systematic issues across the full portfolio of projects. A recent assurance review analysed common findings from reviews of strategic and final business cases. This provides a helpful way to improve internal processes. SINSW advised that it is implementing a continuous improvement program, which will be able to take findings from assurance reviews to build organisational capabilities.

2. Recommendations

By September 2021, the Department of Education should:

1. finalise the investment prioritisation approach with agreement from key stakeholders
2. finalise and update on an ongoing basis a ten-year list of priorities to meet the forecast demand for new classrooms and contemporary fit for purpose learning environments, which identifies individual projects and programs in the short-term and priority geographic areas and programs in the medium-term
3. seek a ten-year Capital Planning Limit from NSW Treasury to ensure the needs identified in the ten-year list of priorities are met and are coordinated with the forward capital programs of other agencies
4. improve the quality of data on cost benchmarks that underpin the annual ten-year Capital Investment Plan and updates to the School Assets Strategic Plan
5. embed an evidence-based cost benefit analysis framework for school investment, in consultation with NSW Treasury, by:
   • validating benefits estimated in previous business cases with actual results
   • building the evidence base in relation to contemporary learning environments
6. regularly share data on forecast needs with relevant planning agencies to promote strategic opportunities for servicing education needs
7. implement the continuous improvement program for service planning, options assessment, business case development, project delivery and handover. The program should be informed by findings from assurance reviews, post-occupancy evaluations and project lessons learned
8. establish benefits realisation processes and practices that:
   • ensure business cases set baselines and targets for benefits
   • review benefits during delivery, prior to handover and as part of Post Occupancy Evaluations
   • identify which part(s) of the Department are best placed to develop, manage and evaluate benefits on an ongoing basis.

There have been significant increases in funding for education infrastructure since the 2017–18 Budget and further growth in demand for places in schools is forecast. SINSW has the challenge, not only of meeting the need for new classrooms due to population growth, but also upgrading facilities to enable modern teaching techniques. In addition, community expectations of what constitutes a vibrant and successful school community continues to increase.

Given growing demand and budget constraints, projects must be selected to best meet the needs of the community and planning and prioritisation are vital. SINSW has been progressing planning for announced projects as well as implementing a new type of strategic state-wide planning and prioritisation, cluster planning, where options are developed for School Community Groups.

The primary role of a business case is to reliably inform an investment and/or policy decision. Over the period of review, the NSW Government's guidelines for business cases have established this requires recommendations based on convincing arguments, sufficient evidence, and accurate costing of alternatives and expected benefits. Business case guidelines are underpinned by guides for economic appraisal and cost-benefit analysis.

As SINSW moves to prioritise business cases for interventions in School Community Groups, it will increasingly need to demonstrate rigour in its assessment of all options. It will also need to ensure that scope identification, cost and risk planning and the setting of contingencies are accurate. This will help decision-makers better understand, plan for and manage the investment required to meet the demand for school infrastructure.

For this audit, we examined business cases and related documentation for 12 projects. Several of these projects were developed before School Infrastructure NSW was established in mid-2017.

Over the period of review, NSW Government policies for business case development and submission have emphasised that effective governance arrangements are critical to a proposal's successful implementation.

SINSW's guidance similarly highlight the importance of effective governance and project management for achieving good outcomes. It prescribes a general governance structure managed by SINSW that can be tailored to the planning and delivery of school infrastructure projects.

Appendix one – Response from agency
 
Appendix two – About the audit 

Appendix three – Performance auditing 

Copyright Notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #347 - released (8 April 2021).

Auditor-General’s Report to Parliament on Delivering School Infrastructure 

This corrigendum has been prepared to amend the following text within my Auditor-General’s Report to Parliament on Delivering School Infrastructure, dated 8 April 2021. 

On page two, the original text was as follows: 

Further NSW Government announcements in the 2018–19 Budget and election commitments in the 2019–20 Budget made up the majority of new projects, rather than projects prioritised by SINSW. 

The original text has now been changed to 

Further NSW Government announcements in the 2018–19 Budget, election commitments in the 2019–20 Budget, and announcements in the 2020–21 Budget, made up the majority of new projects, rather than projects prioritised by SINSW. 

On page three, the original text was as follows: 

The 2018–19 Budget funded three new projects that had not already been announced. One of the three projects was identified by SINSW as a priority. 

The original text has now been changed to: 

The 2018–19 Budget funded two new projects that had not already been announced. Both projects were identified by SINSW as a priority. 

On page three the original text was as follows: 

SINSW identified 33 priority projects in its Capital Investment Plan for 2019–20.

The original text has now been changed to  

SINSW identified 31 new priority projects in its Capital Investment Plan for 2019–20. 

On page eleven, in Exhibit 4, the original text was as follows: 

The 2018–19 NSW Budget announced funding for an additional 43 new and upgraded schools to commence works in 2018–19. Of the 43 projects: 

•    1 was identified by SINSW as a priority in its Capital Investment Plan (SINSW requested funding for one new project)
•    40 had already been announced
•    2 were new announcements (not identified as a priority by SINSW in its Capital Investment Plan).

The original text has now been changed to: 

The 2018–19 NSW Budget announced funding for an additional 42 new and upgraded schools to commence works in 2018–19. Of the 42 projects: 

•    2 were identified by SINSW as a priority in its Capital Investment Plan (SINSW requested funding for two new projects)
•    40 had already been announced.

On page eleven, the original text was as follows: 

The 2019–20 NSW Budget announced funding for an additional 40 new and upgraded schools as election commitments. Of the 40 election commitment projects: 

•    13 were identified by SINSW as priorities in its Capital Investment Plan (SINSW requested funding for a total of 33 new projects)
•    27 were new announcements (not identified as a priority by SINSW in its Capital Investment Plan).

The original text has now been changed to: 

The 2019–20 NSW Budget announced funding for an additional 40 new and upgraded schools as election commitments. Of the 40 election commitment projects: 

•    13 were identified by SINSW as priorities in its Capital Investment Plan (SINSW requested funding for a total of 31 new projects)
•    27 were new announcements (not identified as a priority by SINSW in its Capital Investment Plan).

The above changes will be reflected in the version of the report published on the Audit Office website and should be considered the true and accurate version.  

The Auditor-General for New South Wales, Margaret Crawford, released a report today examining the management of the One TAFE NSW modernisation program.

In 2016, the Government released 'A Vision for TAFE NSW' which stated that TAFE NSW needed to become more flexible, efficient and competitive. It set out the need to progressively reduce significant cost inefficiencies, including by moving away from separate institutes to a single institute model. TAFE NSW established the One TAFE NSW modernisation program to deliver on that vision.

The Auditor General found that the One TAFE NSW modernisation program did not deliver against its key objectives within planned timeframes. The modernisation program originally aimed to realise $250 million in annual savings from 2018–19. Because of project delays and higher than expected transition costs, TAFE NSW did not meet the original savings target. TAFE NSW has made progress on key elements of the program and anticipates that savings will be realised in coming years.

The report makes two recommendations to improve governance arrangements for delivering on commercial objectives and increasing transparency of non commercial activities. 

The report also identifies a series of lessons for future government transformation programs.

TAFE NSW is the public provider of Vocational Education and Training (VET) in New South Wales. In 2018, TAFE NSW enrolled 436,000 students in more than 1,200 courses at around 130 locations across the State.

There have been major policy changes impacting TAFE NSW over the past decade. Under the Smart and Skilled reform, TAFE NSW started to compete with other Registered Training Organisations (RTOs) for a share of the student market.

In 2016, the NSW Government released 'A Vision for TAFE NSW'. The Vision stated that a failure to adapt to market circumstances had left TAFE NSW with unsustainable costs and inefficiencies. To address this, TAFE NSW needed to become more flexible, efficient and competitive. It set out that TAFE NSW must progressively reduce significant cost inefficiencies, including by moving away from a model of separate institutes to a One  TAFE NSW model. The NSW Government set TAFE NSW a target to achieve savings through implementing the Vision.

TAFE NSW established the One TAFE NSW modernisation program to deliver on that vision. The program initially aimed to deliver savings of $250 million per year from 2018–19, but this target was reviewed and updated as the program was being delivered.

This audit assessed whether TAFE NSW effectively managed the One TAFE NSW modernisation program to deliver on the NSW Government's vision for TAFE NSW. In making this assessment, the audit examined whether:

• delivery of the program was well planned
• the program was driven by sound governance arrangements
• TAFE NSW is making progress against the intended outcomes of the program.

The audit focused on the effectiveness of planning, governance and reporting arrangements. It examined five projects within the overall modernisation program as case studies.

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #346 - released 17 December 2020