Refine search Expand filter

Reports

Published

Actions for Police responses to domestic and family violence

Police responses to domestic and family violence

Community Services
Justice
Service delivery

What the report is about

This audit assessed whether the NSW Police Force has effective systems, processes, resources, and capability to respond to domestic and family violence events in New South Wales.

What we found

The NSW Police Force has almost doubled its domestic violence specialist workforce in the past five years and is conducting higher levels of risk monitoring to check that frontline police comply with domestic and family violence policing procedures.

However, a lack of workload monitoring at a whole of agency level is limiting the ability of the NSW Police Force to assess whether specialist and frontline police are sufficient to manage domestic and family violence demands across all 57 local commands.

Rates of compliance checking of domestic violence events vary across local commands, and there is a lack of system level policy or oversight to guide this activity.

While the NSW Police Force has structured training for probationary constables on domestic and family violence policing practices, it does not monitor training or skill levels of the broader workforce to understand levels of expertise in domestic violence policing.

The NSW Police Force does not have regular or consistent methods for seeking feedback and it has a limited understanding of its service quality from the perspective of victim survivors of domestic and family violence.

Performance reporting on domestic and family violence is limited, with most measures focused on activity counts rather than service quality or outcomes.

What we recommended

Improve workforce and workload data collections, analysis and reporting on domestic and family violence workload volumes and allocations of specialist and frontline police to meet demands.

Structure and resource the domestic and family violence strategic policy function to a level commensurate with workload volumes and risks associated with domestic violence policing.

Review debriefing protocols, procedures, and resources for police after domestic and family violence incidents.

Improve databases and information systems for recording domestic violence events so that related events and individuals are automatically connected.

Design a procedure to collect, collate, and analyse service user and stakeholder feedback about police responses to domestic and family violence.

Review existing activity measures and targets for domestic and family violence and expand to include performance measures, service quality measures and outcomes reporting.

Review the process for investigating allegations of domestic and family violence against current and former serving police personnel and implement procedures to ensure processes are independent of interested parties and mitigate conflicts of interest.

Fast facts

  • 140,000 calls to police each year for assistance in relation to domestic and family violence
  • 280 domestic violence specialist police in NSW
  • A 145% increase in police compliance checks of Apprehended Domestic Violence Orders from 2018 to 2020.

The NSW Police Force describes domestic and family violence as a significantly under-reported and complex crime that is mainly perpetrated by men in intimate partner relationships. It is a crime that can include one or more of the following behaviours: emotional and psychological abuse, intimidation, harassment, stalking, physical and sexual assault.

The NSW Police Force responds to over 140,000 domestic and family violence calls for assistance every year. This equates to one call every four minutes. According to NSW Bureau of Crime Statistics and Research statistics, the number and volume of domestic and family violence crime types have increased from October 2016 to September 2021.

The NSW Police Force's responses to domestic and family violence are prescribed in legislation and its own procedural guidance. Principally, the NSW Police Force is required to:

  • investigate incidents of domestic and family violence
  • take out Apprehended Domestic Violence Orders on behalf of victims and children
  • provide safety and support to victims, including taking offenders away from victims
  • place alleged perpetrators before the courts
  • investigate breaches of Apprehended Domestic Violence Orders and target repeat offenders
  • work with local service providers to reduce incidents of domestic and family violence.

Domestic and family violence incident dispatches are attended by general duties police – also described in this report as frontline police.

The objective of this audit was to assess the effectiveness of the NSW Police Force in responding to domestic and family violence. To do this, we assessed whether the NSW Police Force:

  • conducts capability planning to ensure its workforce can effectively respond to domestic and family violence incidents and support victim-survivors
  • resources its workforce with the required systems, skills, knowledge, and administrative support to monitor, record and respond to domestic and family violence events
  • assesses the effectiveness of police responses to domestic and family violence events and the effectiveness of support for victim-survivors.
Where to get help

If you or someone you know is experiencing violence or abuse, you can contact 1800 RESPECT (1800respect.org.au or 1800 737 732).

Conclusion

The NSW Police Force has almost doubled its domestic violence specialist workforce in the past five years. This has enabled higher levels of risk monitoring, and increased levels of support for general duties frontline police. However, a lack of workforce and workload monitoring at the system level, has limited the ability of the NSW Police Force to assess whether specialist and frontline police are sufficient in numbers to manage workload demands in all local commands.

The NSW Police Force does not measure the types or categories of police work that constitute the workload profiles of general duties frontline police. This limits the ability of the NSW Police Force to understand the proportion of police time that is spent managing domestic and family violence incidents and allocate resources accordingly.

While the NSW Police Force has increased the numbers of specialist domestic violence personnel, it lacks accurate data to assess whether the distribution of specialist personnel is adequate in number to support workload volumes across the different local commands. The NSW Police Force is currently expanding its use of a workforce modelling tool - Capacity Planning for Policing. This tool has the functionality to assess the distribution of the police workforce against incident dispatches by crime type, and other workload metrics.

There is potential for the NSW Police Force to use this tool to take a more proactive approach to domestic and family violence workforce planning. This could include enhanced monitoring and reporting of the domestic and family violence incident dispatches in each local command, and the levels of domestic violence specialist staff in these commands. Enhanced data reporting will assist local commanders to assess their staffing levels against crime statistics, compare to commands with similar activity levels, and ensure that staffing allocations are appropriate for workload demands.

The NSW Police Force has dedicated additional resources to improve the levels of monitoring of police compliance with domestic and family violence policing procedures. However, rates of compliance checking of domestic violence events vary across local commands, and there is a lack of system level policy or oversight to guide this activity.

The NSW Police Force has enhanced its quality control measures to improve domestic violence policing through a range of checking mechanisms to monitor compliance with standard operating procedures. However, there is significant variability in the levels of compliance checking across local commands and no system level data about the levels of quality assurance across commands. Some commands attempt to check 100% of domestic violence events, while others check far fewer, depending on their local workload requirements. The NSW Police Force does not provide advice about what constitutes minimum or optimal levels of compliance checking, and there is no centralised reporting on this activity.

The NSW Police Force provides a structured training program for probationary constables on domestic and family violence policing but does not monitor the training or skill levels of the broader workforce. This limits the ability of NSW Police Force managers to understand whether the workforce has the required skills and knowledge in this area.

During pre-service training probationary constables are provided with procedural knowledge and a structured skill development program in preparation for domestic and family violence policing. They develop further proficiency and skills through mentoring and on the job experience.

The NSW Police Force has processes to ensure that probationary police officers are monitored and mentored in domestic violence procedures and practices. However, it is unable to ensure that the broader workforce is completing targeted professional development to improve and update skills and knowledge levels over time. The NSW Police Force does not consistently assess workforce capabilities or gaps in workforce skills and knowledge about domestic violence policing. 

The NSW Police Force does not have regular or consistent methods for seeking feedback from service users. As a result, it has a limited understanding of its service quality from the perspective of victim-survivors of domestic and family violence.

The NSW Police Force is guided by its Domestic and Family Violence Code of Practice and Customer Service Guidelines to provide 'timely and appropriate victim support and referral'. These guidelines require victim follow-up within seven days of an incident where an offence is detected. The NSW Police Force has limited information to understand whether it is complying with these requirements for domestic violence incidents.

The NSW Police Force is not able to separate complaints about domestic and family violence service quality from other complaints. While the NSW Police Force participates in forums where it can receive feedback from stakeholder groups, there remains the risk that processes are not systematised, and are dependent on the commitment of local commands.

Police participation in Aboriginal and Torres Strait Islander feedback forums show significant variability in the levels of engagement across police regions. Through its Multicultural Plan, the NSW Police Force collects information about culturally and linguistically diverse communities. However, reporting is not specific to domestic violence, and only occurs every four years.

Performance reporting on domestic and family violence is limited, with most measures focused on activity counts rather than service quality or outcomes. Six of the seven NSW Police Force indicators for domestic and family violence are counts of incident types, rather than measures of police performance or outcomes.

Appendix one – Response from agency 

Appendix two – Workload and workforce numbers in 2020–21 supporting Exhibits 4, 6 and 7 

Appendix three – Key NSW Police Force initiatives, July 2016–present 

Appendix four – About the audit 

Appendix five – Performance auditing 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #363 - released 4 April 2022.

Published

Actions for Local government business and service continuity arrangements for natural disasters

Local government business and service continuity arrangements for natural disasters

Local Government
Internal controls and governance
Management and administration
Project management
Risk
Service delivery

What the report is about

Natural disaster events, including bushfires and floods, have directly impacted some local councils in New South Wales over recent years. It is important for local councils to effectively plan so that they can continue operations through natural disasters and other disruptions.

This audit assessed the effectiveness of Bega Valley Shire Council and Snowy Valleys Council’s approaches to business and service continuity arrangements for natural disasters.

What we found

Bega Valley Shire Council has a documented approach to planning for business and service continuity that provides for clear decision making processes and accountability.

Bega Valley Shire Council has prepared for identified natural disaster risks to business and service continuity but can do more to monitor how it has implemented controls responding to these risks.

Bega Valley Shire Council did not follow all aspects of its business continuity plan in responding to the 2019–20 bushfires.

Bega Valley Shire Council can do more to ensure its business continuity management approach is regularly reviewed and updated, and that staff are regularly trained in its implementation.

Snowy Valleys Council did not have a finalised approach to ensure business and service continuity until October 2020. Now in place, this approach identifies governance, assigns roles and responsibilities, and includes procedures to retain or resume services. That said, the Council has not adequately documented key elements of its business continuity management approach.

Snowy Valleys Council's strategic risk register identifies that natural disasters may impact its ability to deliver services, but the Council has not identified controls to respond to these risks.

During the 2019–20 bushfires, in the absence of a business continuity plan, Snowy Valleys Council relied on the local knowledge of its staff to manage service continuity in line with directions from the Local Emergency Operations Controller and the combat agency (the Rural Fire Service).

Both councils advised that, during the 2019–20 bushfires, services were maintained, sometimes with adaptation and sometimes with support from other councils, NSW Government and Australian Government agencies.

What we recommended

Bega Valley Shire Council should update and regularly review its business continuity plans, provide business continuity training, and improve its monitoring of risk controls and actions, including for natural disaster impacts.

Snowy Valleys Council should document and monitor all disruption-related risks and controls, regularly review and update its business continuity plans, and progress planned actions to increase staff awareness of business continuity plans.

Across both councils, we recommended that recordkeeping relating to service delivery during natural disasters should be adequate to inform post incident reviews and future updates to business continuity.

Fast facts

  • Multiple natural disasters affected the audited councils in 2019–20:
    • bushfires in 2019–20
    • storms and floods in January 2020
    • storms and floods in July and August 2020
    • storms and floods in October 2020.
  • 6,279kmSize of Bega Valley Shire Council (area)
  • 2,203kmArea burnt within Bega Valley Shire Council in 2019–20 bushfires
  • 8,959kmSize of Snowy Valleys Council (area)
  • 3,339kmArea burnt within Snowy Valleys Council in 2019–20 bushfires.

Natural disaster events, including bushfires and floods, have directly impacted some local councils in New South Wales over recent years. Given their important role in delivering essential services to their communities, it is important for local councils to effectively plan so that they can continue operations through natural disasters and other disruptions.

Business continuity plans are a widespread mechanism used by governments and private sector organisations to ensure they are prepared to respond effectively to disruptions. In New South Wales, business continuity plans are widely used by local councils to help ensure continuity of service delivery, safety and availability of staff, availability of information technology systems and other systems, financial management and governance. There are no current sector-wide requirements or policies for business continuity management issued by the Department of Planning and Environment (DPE)1 for NSW councils. As such, councils can develop their own business continuity management frameworks.

Our 'Report on Local Government 2020' considered the financial and governance impacts from recent natural disaster events on local councils in New South Wales. It also considered sector-wide trends in business continuity planning, including how many councils enacted or updated their business continuity plans in 2019–20.

The report found that all councils were impacted by emergency events, and that some councils changed their governance, policies, systems, and processes to respond to the emergency events. Sixty-five per cent of councils updated their business continuity plan as a response to recent emergency events, and 43 per cent of councils updated their disaster recovery plan.

This audit follows on from the 'Report on Local Government 2020' with a detailed examination of the effectiveness of business and service continuity arrangements for natural disasters in two councils.

The selected councils for this audit were Bega Valley Shire Council and Snowy Valleys Council. They were selected because they had been heavily impacted by the 2019–20 bushfires and other natural disaster events, such as storms and floods between December 2018 to December 2020.

The objective of this performance audit was to assess the effectiveness of the councils' approaches to business and service continuity arrangements for natural disasters. In making this assessment, we considered whether the selected councils:

  • had documented approaches for identifying, mitigating, and responding to disaster-related risks to business and service continuity
  • effectively implemented strategies to prepare for identified disaster-related impacts
  • responses during selected disasters were effective in managing business and service continuity.

Conclusion - Bega Valley Shire Council

Bega Valley Shire Council has a documented approach to planning for business and service continuity that provides for clear decision-making processes and accountability.

Since 2018, the council has prepared for identified natural disaster risks to business and service continuity, but can do more to monitor how it has implemented controls responding to these risks.

Bega Valley Shire Council did not follow all aspects of its business continuity plan in responding to the 2019–20 bushfires.

The council can do more to ensure its business continuity management approach is regularly reviewed and updated, and that staff are regularly trained in its implementation.

Bega Valley Shire Council has a documented approach to business continuity management that is integrated with its broader approach to enterprise risk management and is supported by clear decision-making processes and accountability. This includes a business continuity plan (BCP), BCP subplans, and a business impact analysis (BIA). The council made changes to its BIA in 2019 following the 2018 Tathra bushfires within its local government area (LGA), but its BCP and BCP subplans have not been updated since 2016 and key information is out of date.

Bega Valley Shire Council has identified high-level controls and strategies to mitigate disaster-related risks and undertakes post incident reviews to capture lessons following a disaster, but many high-risk actions resulting from those reviews remain outstanding.

Bega Valley Shire Council identified risks, controls, and actions to prepare for natural disaster impacts between 2018 to 2020. However, the council has not effectively monitored implementation of the identified controls. Bega Valley Shire Council has only partially implemented the actions and recommendations from internal reviews that identified gaps in its business continuity management approach.

Bega Valley Shire Council did not follow all aspects of its business continuity plan in responding to the 2019–20 bushfires, instead relying on the local knowledge of its staff. The council has not provided BCP scenario training since 2015 and has not monitored completion rates of its online business continuity management training for staff.

Bega Valley Shire Council did not keep records of its decision of whether to enact its BCP during the 2019–20 bushfires, but advised its ability to follow the BCP was not possible due to the scale and impact of the bushfires surpassing the expectations included in its BCP and BCP subplans.

The council advised that essential council-led services were largely maintained during the disaster, sometimes with adaptation of services, and sometimes with support from other councils, NSW Government and Australian Government agencies.

As Bega Valley Shire Council did not maintain formal records of service disruptions for most services, did not follow all aspects of its BCP during the 2019–20 bushfires, and because it requested and received support from other agencies, we are unable to assess the impact of its planning and preparation activities on the continuity of services.

Bega Valley Shire Council took actions during the 2019–20 bushfires to communicate key service changes to staff, residents, and stakeholders, and regularly sought feedback on residents' experiences.

Bega Valley Shire Council could improve the effectiveness of its business continuity management approach by undertaking regular staff training (including scenario training) and ensuring that its business continuity management framework is routinely updated to reflect current practice and current staff. 

 

Conclusion - Snowy Valleys Council

Snowy Valleys Council did not have a finalised approach to ensure business and service continuity until October 2020. Now in place, this approach identifies governance, assigns roles and responsibilities and includes procedures to retain or resume services. That said, the council has not adequately documented key elements of its business continuity management approach.

Snowy Valleys Council's risk register identifies that natural disasters may impact its ability to deliver services, but the council has not identified controls to respond to these risks.

During the 2019–20 bushfires, in the absence of a business continuity plan (BCP) or BCP subplans, the council relied on the local knowledge of its staff to manage service continuity in line with directions from the Local Emergency Operations Controller and the combat agency (the Rural Fire Service).

Snowy Valleys Council did not have a finalised BCP, BCP subplans, or BIA until after the 2019–20 bushfires. The council finalised most of its business continuity management framework in late 2020 and this framework now establishes governance, including assigning roles and responsibilities, and identifies contingencies and procedures to retain or resume critical services.

There are gaps in how Snowy Valleys Council has documented key elements of its business continuity management approach. The council advised it has completed a BIA, but has not retained the completed version of this document as it was not managed under Snowy Valleys Council's record management procedures. Some of the council's BCP subplans have gaps in process information and contact details which means BCP subplan owners and other potential users may not have access to accurate, up to date information when responding to a disruption event.

The council advised it provided BCP scenario training in 2016, 2018, and 2021, but was unable to provide any evidence of the 2018 training. As the current BCP and BCP subplans were only finalised in 2021, the 2016 and 2018 training were based on the previous BCP framework, developed under the former Tumut Shire Council. Additionally, the council advised it has developed BCP awareness training for staff as part of induction training, but has not provided a clear timeframe for implementing this training.

The council undertakes post incident reviews after most service disruption events, but has not undertaken a post incident review of the 2019–20 bushfires, despite its significant impact within the Snowy Valleys Council LGA.

Snowy Valleys Council advised that it identifies and mitigates or controls for disaster related risks within broader enterprise-wide risk assessments. Snowy Valleys Council’s strategic risk register identifies the risk of natural disasters to service delivery, but does not identify preventative controls or resilience strategies to mitigate these risks. The council monitors and improves the resilience of some assets as part of its regular operations of maintaining assets but does not clearly link such actions to how they contribute to reducing the risk of natural disaster related impacts. Snowy Valleys Council advises it works with other agencies, such as the Rural Fire Service and the local Bush Fire Management Committee, to plan for bushfire risks.

In the absence of a BCP or BCP subplans, Snowy Valleys Council relied on individual team members to manage service continuity during the 2019–20 bushfires based on directions by the local Emergency Operations Controller, and the Rural Fire Service. The council advised that the delivery of essential council-led services was largely maintained during the 2019–20 bushfires, sometimes with adaptation and support from other NSW Government and Australian Government agencies. Snowy Valleys Council took actions during the 2019–20 bushfires to communicate key service changes to staff, residents, and stakeholders, and regularly sought feedback on residents' experiences.

As Snowy Valleys Council did not maintain formal records of any service disruptions and did not have a finalised business continuity management approach in place to guide its response during the 2019–20 bushfires, we are unable to assess the impact of its planning and preparation activities on the continuity of services.

 

 1 At the time of this audit, the Department of Planning and Environment is responsible for supporting and regulating local councils in New South Wales through the Office of Local Government. Prior to 21 December 2021, the Department of Planning and Environment was named the Department of Planning, Industry and Environment.

Appendix one – Responses from councils and the Department of Planning and Environment 

Appendix two – Emergency management arrangements for local councils 

Appendix three – About the audit 

Appendix four – Performance auditing 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #362 - released 17 February 2022.

Published

Actions for Integrity of grant program administration

Integrity of grant program administration

Local Government
Premier and Cabinet
Internal controls and governance
Management and administration

What the report is about

This report assessed the integrity of the assessment and approval processes for two grant programs:

  • Stronger Communities Fund Round 2 (tied grants round), which was administered by the former Office of Local Government (OLG) and provided $252 million to newly amalgamated councils and other councils that had been subject to a merger proposal during 2017–18 and 2018–19.
  • Regional Cultural Fund, which was administered by Create NSW (now within the Department of Premier and Cabinet) and awarded $100 million for cultural projects in regional NSW.

What we found

The assessment and approval process for Round 2 of the Stronger Communities Fund lacked integrity. The government decided to prioritise funds for councils that had worked constructively with the government through the 2016 merger process. 

However, this information was not included in the program guidelines. The program guidelines were not published and did not contain details of selection and assessment processes. Councils and projects were instead identified by the former Premier, Deputy Premier and Minister for Local Government and communicated to OLG with little or no information about the basis for the council or project selection. There was no merit assessment of identified projects. This process resulted in 96 per cent of funds allocated to coalition state seats.

The assessment process that Create NSW used for the Regional Cultural Fund was robust and produced transparent and defensible recommendations to the minister. However, the former Minister for the Arts, in consultation with the former Deputy Premier, did not follow the recommendations of the independent assessment panel in 22 per cent of cases. Reasons for these changes were not documented by Create NSW.

What we recommended

The Department of Premier and Cabinet should develop a model for grant administration that must be used for all grant programs administered in NSW that:

  • is based on ethical principles such as impartiality, equity and transparency 
  • ensures assessments and decisions can be made against clear eligibility criteria
  • ensures accountability for decisions and actions of all those who are involved in the program 
  • includes minimum mandatory administration and documentation standards
  • requires any ministerial override of recommendations to be documented. 

The Department of Planning and Environment should ensure that guidelines prepared for all grant programs are published and include a governance framework that includes accountabilities and key assessment steps.

Fast facts    

Stronger Communities Fund Round 2

  • $252m allocated to 24 councils    
  • 96% allocated to council projects in coalition state seats
  • 36% of the funding ($90m) was allocated to a single council
  • $8m in projects identified before the program guidelines were finalised

Regional Cultural Fund

  • 405 applications received across three funding rounds
  • $99m awarded for 147 cultural projects in regional NSW 
  • 22% panel recommendations not followed by ministers  
  • $9.3m awarded to projects not recommended by panel

Grants are frequently used by the state government to deliver funds to councils and community organisations to provide infrastructure and services important to their local communities. Grant programs are administered by NSW Government agencies in line with priorities and objectives set by the government.

Guidance for agencies administering grant programs is available in the Good Practice Guide to Grants Administration (the 'DPC Guide') which is maintained by the Department of Premier and Cabinet (DPC). In addition to this guide, some agencies maintain their own grant program policies and guidelines. More broadly, public servants are required to comply with financial legislation and the Government Sector Employment Act 2013 which include requirements to be transparent, fiscally responsible and focus on the efficient, effective and prudent use of resources.

The objective of this performance audit is to assess the integrity of the assessment and approval processes for NSW Government grant programs.

The audit focuses on two grant programs, both administered during the 2017–18 and 2018–19 financial years. The Stronger Communities Fund (round two tied grants round) was administered by the former Office of Local Government (OLG), now referred to as the Local Government Group within the Department of Planning and Environment (DPE). The fund awarded $252 million to 24 councils that had amalgamated in 2016 or which had been the subject of a merger proposal. The Regional Cultural Fund was administered by Create NSW, now within the Department of Premier and Cabinet (DPC). The fund awarded $100 million to organisations in regional New South Wales to support the development of cultural infrastructure in regional areas.

The audit comments upon the role played by the then Premier, Deputy Premier, ministers and their staff in the audited grant programs to provide context. The Audit Office of NSW cannot compel those individuals to participate in the audit or provide documents. In all cases, reference to the Premier, Deputy Premier, ministers, MPs and their staff refers to the individuals who were in those roles at the time the grant programs were administered unless otherwise noted.

Conclusion

Stronger Communities Fund

The assessment and approval processes for round two of the Stronger Communities Fund (SCF) lacked integrity. The program guidelines developed by the Office of Local Government (OLG) were deficient in a number of aspects and were not used to guide the selection of councils or projects for funding. Of the 55 councils that met the eligibility criteria in the guidelines, 24 received funding. Ninety-six per cent of available SCF funding was allocated to projects in coalition-held state government electorates. Funding for councils was determined by the then Premier, Deputy Premier and Minister for Local Government and communicated by their staff through emails to OLG with little or no information about the basis for the council or project selection. OLG administered payment of these funds without questioning or recording the basis for selection. For the 22 councils where funding allocations were determined by the former Premier and Deputy Premier, the only record of their approval is a series of emails from their staff. The exclusion of key information from the program guidelines and the lack of formality in approving 22 of the 24 funding allocations prevent accountability and transparency over the government's approach to selecting councils for funding.

In July 2017, the NSW Government established priorities for how the remaining SCF funds should be used. The funds were to be used to cover costs associated with councils' legal action relating to amalgamation, to reimburse costs incurred by councils that were unable to merge but had participated constructively in the merger process, and to fund community initiatives in council areas that had amalgamated in 2016.

OLG developed the initial grant program guidelines between July 2017 and September 2017 in consultation with the then Premier, Deputy Premier and Minister for Local Government and their staff. These were then revised in June 2018. Neither version of the guidelines made reference to the type of projects that were to be prioritised and did not set out how the funds should be administered in accordance with these priorities. The guidelines also did not include information about how councils and projects would be selected and made no provision for an assessment of identified projects against the criteria for eligible projects in the guidelines. OLG did not publish the guidelines and the process adopted by the Premier, Deputy Premier and Minister for Local Government to select projects did not reference the criteria for eligible projects in the guidelines. The selection of councils and funded projects resulted in 96 per cent of available funding being allocated to projects in coalition-held state government electorates.

The Minister for Local Government was responsible for distributing the SCF funds but only approved funding for projects at two of 24 councils, both paid in November 2017. Projects at the other 22 councils were identified by the former Premier and Deputy Premier between June 2018 and June 2019 in consultation with other coalition Members of Parliament and communicated to OLG through emails from Premier and Deputy Premier's staff. When making payments in response to email instructions from staff in the offices of the Premier, Deputy Premier and Minister for Local Government, OLG did not seek to ensure that identified projects were consistent with the guidelines and made payments to selected councils with little or no information to justify them. With the exception of the two funding allocations approved by the then Minister for Local Government, OLG also did not ensure that formal records were in place to document approval for the remaining 22 funding allocations.

Regional Cultural Fund

The assessment process that Create NSW used for the Regional Cultural Fund was robust and produced transparent and defensible recommendations to the then Minister for the Arts. However, the integrity of the approval process for funding allocations was compromised because the minister, in consultation with the then Deputy Premier, did not follow the recommendations of the independent assessment panel in multiple cases and the reasons for making changes were not documented by the minister's office or Create NSW.

All projects that received funding were assessed by Create NSW as eligible for funding under the program. An independent assessment panel assessed applications against the program objective and criteria. This process was designed in line with good practice in grants administration and was implemented consistently. The then Minister for the Arts, in consultation with the former Deputy Premier, did not follow the panel's recommendations for 22 per cent, or more than one in five, of the applications assessed for funding. Thirty-four applications that were recommended by the independent panel did not receive any funding. In the second funding round, seven of the top ten ranked applications were not funded.

The Minister for the Arts approved funding for 22 applications that were not recommended by the independent panel. This resulted in around $9.3 million being awarded to applicants that were not rated highest by the independent panel, including six applicants that received grants of $500,000 or more. Most did not meet one or more assessment criteria and received low ratings.

The then minister did not provide reasons for not approving funding in line with the recommendations of the panel. This did not breach any legislation or guidelines in New South Wales, but it compromised Create NSW's ability to demonstrate integrity and value for money in the RCF approval process. It creates a clear perception that factors other than the merits of the projects influenced funding decisions.

Create NSW's administration of the Regional Cultural Fund was based on relevant legislative requirements and good practice guidance. The objectives of the program were defined clearly and the guidelines and criteria were consistent with the program objectives. The governance and probity framework was appropriate for the size and nature of the program.

Appendix one – Response from agencies

Appendix two – List of funded projects - Stronger Communities Fund Round 2

Appendix three – List of funded projects - Regional Cultural Fund

Appendix four – About the audit

Appendix five – Performance auditing

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #361 - released 8 February 2022.

Published

Actions for Government advertising 2020-21

Government advertising 2020-21

Premier and Cabinet
Compliance
Management and administration

What the report is about

The Government Advertising Act 2011 requires the Auditor General to conduct a performance audit on government advertising activities each financial year.

This audit looked at whether three campaigns run by Destination NSW (DNSW) during 2020–21 were carried out in an effective, economical and efficient manner:

  • Love Sydney (comprising two sub campaigns being ‘Sydney - Love It Like You Mean It’ and ‘Get Your Sydney On’)
  • Love NSW
  • Road Trips. 

What we found

DNSW complied with section 6 of the Government Advertising Act 2011 (the Act), prohibiting political content.

The Act requires the head of an agency to sign a compliance certificate that certifies that the campaign complies with the Act and is an efficient and cost effective means of achieving its public purpose. 

When the Acting Chief Executive of DNSW signed DNSW’s compliance certificate, evidence to support this certification was not available.

The Act requires a peer review and cost benefit analysis for campaigns over $1.0 million. DNSW did not complete the peer review or cost-benefit analysis for the audited advertising campaigns before they had concluded. 

The Department of Customer Service (DCS), which manages the peer review process, did not escalate the issue of the outstanding peer review documentation to senior DNSW staff. 

DNSW did not set targets for all measures established for the campaigns. This limits the ability to assess their effectiveness.

The impact of the COVID-19 pandemic likely contributed to the campaigns not meeting a substantial proportion of established outcome and impact targets.

None of the audited campaigns met the minimum requirement of 7.5 per cent for the allocation of the media budget for communications with Culturally and Linguistically Diverse and Aboriginal audiences.

What we recommended

DNSW should:

  • implement processes for planning and delivering advertising campaigns delivered in urgent circumstances to bring them in line with NSW Government practice
  • ensure that it establishes measurements and targets for outcomes and impacts of its advertising campaigns consistent with NSW Government evaluation frameworks and guidance.

The Department of Customer Service should:

  • establish a policy and procedure for ensuring that campaign documentation is completed in a timely manner in the case of urgent campaigns, including establishing expectations around timeframes for the completion of peer review
  • establish a procedure for escalating issues of outstanding documentation to ensure that the peer review is completed in line with reasonable expectations and timeframes.

Fast Facts

  • $9.6m is the total money spent on the three audited campaigns
  • $91.2m is the total amount of money spent by the NSW Government on advertising in 2020–21.

The Government Advertising Act 2011 (the Act) requires the Auditor-General to conduct a performance audit on the activities of one or more government agencies in relation to government advertising campaigns in each financial year. The performance audit assesses whether a government agency or agencies have carried out activities in relation to government advertising in an effective, economical and efficient manner and in compliance with the Act, the regulations, other laws and the Government Advertising Guidelines (the Guidelines). This audit examined three campaigns run by Destination NSW during the 2020–21 financial year:

  • Love Sydney (comprising two sub-campaigns being ‘Sydney - Love It Like You Mean It’ and ‘Get Your Sydney On’), focussing on increasing visitor activity in Sydney
  • Love NSW, focussing on increasing visitor activity in regional New South Wales
  • Road Trips, focussing on encouraging visitor activity on iconic road trips in regional New South Wales.

Section 6 of the Act prohibits political advertising. Under this section, material that is part of a government advertising campaign must not contain the name, voice or image of a minister, member of Parliament or a candidate nominated for election to Parliament or the name, logo or any slogan of a political party. Further, a campaign must not be designed to influence (directly or indirectly) support for a political party.

The Act and associated regulations and the Guidelines also establish an accountability and compliance framework around the investment in advertising by NSW Government agencies.

The government's operating circumstances at the commencement of the 2020–21 financial year were highly challenging, with the 2019–20 bushfires being followed by the COVID-19 pandemic. This created new demands across a range of government services, and without any clear view on the severity of the pandemic and when it would end. This was the case for Destination NSW, which had to plan for its advertising activities in the context of an uncertain future for national border closures (impacting international in-bound travel) and lockdowns across Australia, including in New South Wales (impacting domestic travel). Further, the sudden nature of outbreaks and lockdowns meant that Destination NSW often was required to change the targeting of its campaigns and, in some situations, had to cease particular advertising activities until specific lockdowns had ended.

Conclusion

The three Destination NSW campaigns subject to this audit were consistent with the allowed purposes of government advertising and did not include political advertising.

Destination NSW did not comply with the requirement to complete a peer review of campaigns, nor did it complete a cost-benefit analysis before or during the conduct of each of the audited campaigns. These requirements of the Act are designed to provide reasonable assurance that the advertising campaigns represented efficient, effective and economical uses of government funds.

Two of the three campaigns achieved some of their objectives relating to influencing consumers. The effects of the COVID-19 pandemic likely contributed to all of the campaigns not meeting a substantial proportion of established outcome and impact targets, with the impact of COVID-19 varying across campaigns and performance measures. It is particularly difficult to determine the impact of COVID-19 where measures or targets have not been set, as was the case with some of the measures for these campaigns. The impact of the COVID-19 pandemic also meant Destination NSW needed to make media placement changes when lockdown resulted in pauses or re-directions of media activities. This led to some unforeseen expenditure, but was an unavoidable consequence of needing to make changes at short notice.

Destination NSW was only able to present evidence that two of the campaigns ('Sydney - Love It Like You Mean It' and 'Love NSW') represented a positive benefit-cost ratio.

The Act requires the head of an agency to sign a compliance certificate stating that, among other things, the campaign complies with the Act, the regulations and the Guidelines, and that the campaign is an efficient and cost-effective means of achieving the public purpose. The Acting Chief Executive of Destination NSW signed the required compliance certificate associated with all of its 2020–21 advertising campaigns in February 2020, before they had been designed and planned, and before the associated expenditure had been approved.

Destination NSW did not complete required cost-benefit analyses before the campaigns commenced or while the campaigns were airing and did not establish complete suites of measures and targets for impact and outcomes of the advertising campaigns to inform the campaign.

Destination NSW did not ensure that the required peer review process was completed in a timely manner. The Department of Customer Service (DCS) supported Destination NSW's decision to commence the campaigns while the peer review was completed simultaneously. The Act allows this for urgent campaigns, and Destination NSW and DCS agreed that the need for this campaign to support driving economic activity in New South Wales after months of reduced activity brought on initially by the 2019–20 bushfires and then by the pandemic warranted this approach. As the campaigns progressed, DCS provided reminders to complete the peer review process, but this was not done. DCS did not escalate the issue of the incomplete peer review during this time. In September 2021 it advised Destination NSW officially that it would not consider further submissions for peer review with regard to the completed campaigns.

Destination NSW could not demonstrate how its campaign designs or media placements effectively supported the cultural needs and issues of culturally and linguistically diverse populations, consistent with the requirements of the 'Culturally and Linguistically Diverse (CALD) and Aboriginal Advertising Policy'.

Destination NSW did not establish comprehensive suites of measures and targets to allow for robust assessments of whether the campaigns achieved the intended outcomes from the campaigns. This limited the effectiveness of these measures as an accountability tool as intended by the NSW Government evaluation framework. 

All three advertising campaigns complied with the political advertising prohibitions in the Act and were for an allowed purpose.

The Acting Chief Executive of Destination NSW signed the required compliance certificate associated with all of its 2020–21 advertising campaigns in February 2020, before the campaigns had been designed and planned, and before the associated expenditure had been approved. This means that the assertions in the certification could not be supported. It is therefore not a reliable certification of compliance with the Act. A more reliable approach to completion of the compliance certificate, and an approach that is more typical across other NSW Government advertising campaigns, is to complete the certification after all planning and designs work is done, after the peer review is complete, and immediately prior to the launch of the campaign.

Destination NSW did not complete the peer review of campaigns, nor a cost-benefit analysis before or during the conduct of the audited campaigns. This is inconsistent with key aspects of accountability within the NSW Government's framework for advertising. As the campaigns progressed, DCS provided reminders to complete the peer review process, but this was not done by Destination NSW prior to the end of the campaigns. DCS did not escalate the issue of the incomplete peer review during this time. In September 2021 DCS advised Destination NSW officially that it would not consider further submissions with regard to the completed campaigns.

Destination NSW could not demonstrate how its campaign designs or media placements effectively supported the cultural needs and issues of culturally and linguistically diverse populations, consistent with the requirements of the 'CALD and Aboriginal Advertising Policy'. 

Campaign materials we reviewed did not contain political content

The audit team reviewed campaign materials developed as part of each of the paid advertising campaigns including radio transcripts, digital videos and display. See Appendix two for examples of campaign materials for this campaign.

Section 6 of the Act prohibits political advertising as part of a government advertising campaign. A government advertising campaign must not:

  • be designed to influence (directly or indirectly) support for a political party
  • contain the name, voice or image of a minister, a member of parliament or a candidate nominated for election to parliament
  • contain the name, logo, slogan or any other reference to a political party.

The audit found no breaches of section 6 of the Act in the campaign material reviewed.

All reviewed campaigns were for purposes permitted by section 1.2 of the Guidelines

Section 4 of the Act states that government advertising campaigns are 'the dissemination to members of the public of information about a government program, policy or initiative, or about any public health or safety or other matter'. To support this, section 1.2 of the NSW Government Advertising Guidelines states that government advertising campaigns may only be used to achieve certain objectives. One of these objectives is to encourage changed behaviours or attitudes that will lead to improved public health and safety or quality of life.

The audit team considers that each of the reviewed advertising campaigns was consistent with this objective. This reflects the intent of each of the campaigns to increase economic activity driven by tourism activity in New South Wales, that contributes to improved quality of life for New South Wales residents.

The Acting Chief Executive signed Destination NSW's compliance certificate without supporting evidence

The Acting Chief Executive of Destination NSW signed a single compliance certificate for all Destination NSW campaigns for 2020–21 (including the three campaigns that are considered by this audit) on 28 February 2020. Evidence was not available at this date to support the statements included in the compliance certificate for the campaigns that were considered by this audit.

The compliance certificate is required by section 8 of the Act and states that the head of the agency confirms that a proposed government advertising campaign:

  • complies with the Act, the regulations and the Guidelines, and
  • contains accurate information, and
  • is necessary to achieve a public purpose and is supported by analysis and research, and
  • is an efficient and cost-effective means of achieving that public purpose.

At the time of signing the certificate in February 2020, Destination NSW had not conceived, designed or planned any of the campaigns that are considered by this audit, nor had it developed the relevant supporting information that would enable the agency to support these statements. As noted above, peer review had not commenced prior to this date. Further, Destination NSW had not completed a cost-benefit analysis or equivalent analysis.

Without any form of cost-benefit analysis or other evaluation for any of the campaigns prior to the date of signing of the compliance certificate, the Acting Chief Executive had no evidence that could support the certification that the campaigns were 'an efficient and effective means of achieving the public purpose'. The absence of peer review or a cost-benefit analysis also means that the Acting Chief Executive could not certify that the campaigns complied with the Act, the regulations or the Guidelines, nor that the campaign was supported by analysis and research.

Destination NSW did not complete peer reviews for the advertising campaigns before they ended, limiting assurance over campaign effectiveness, efficiency and economy

As all the campaigns subject to this audit were valued at over $250,000, each campaign was required to undergo peer review. The peer review is an independent review of the need for the proposed advertising campaign, the creative and media strategy (including objectives and target audiences) and how the agency will manage the campaign. Ordinarily, a peer review would be completed prior to a campaign commencing, however section 7(4) of the Act permits agencies to carry out a peer review after the advertising campaign commences 'if the head of the government agency concerned is satisfied that the campaign relates to an urgent public health or safety matter or is required in other urgent circumstances'.

DCS supported Destination NSW's assessment that these were urgent campaigns and that it would accept consideration of peer review components in parallel with the roll-out of the advertising campaigns, given the urgency of the need to generate economic activity, initially after the 2019–20 bushfires and then after the challenging circumstances brought on by the COVID-19 pandemic. This is in line with section 7(4) of the Act.

Destination NSW presented and obtained clearance on creative materials and media planning on a timely basis for two of the three campaigns (but not for the Road Trips campaign), which would ordinarily form part of peer review. However, for all campaigns, the peer reviews were not completed or signed off by DCS prior to the completion of advertising campaigns. In particular, Destination NSW did not submit material related to the accountability for campaign effectiveness, including the campaign objectives and measures before the end of the campaigns.

The absence of peer review of much of the material prior to completion of the campaigns reduces the ability of the agency and government to be confident that the advertising expenditure was consistent with NSW Government requirements, or represented efficient, effective and economical use of funds.

Destination NSW noted that section 7(4) of the Act allows the peer review to be completed after the commencement of a campaign in urgent circumstances but places no requirement on it to be completed before the end of the campaign. The audit has determined that for the peer review to meet its intended purpose, being to inform the design and delivery of the advertising campaign, it needs to be completed prior to the end of the campaign, even in urgent circumstances. DCS has supported this intent of the framework.

By the end of September 2021, DCS advised Destination NSW that it would not consider any further material for peer review related to the 2020–21 advertising campaigns. At this time, DCS closed the peer review for the Love NSW and Road Trips campaigns and assessed them as incomplete. DCS assessed the Love Sydney peer review as complete, despite noting that the campaign evaluation was not complete and with no details or confirmation of meeting culturally and linguistically diverse (CALD) advertising requirements, including for Aboriginal communities.

DCS did not escalate the issue of outstanding peer review materials

DCS worked at officer level to remind Destination NSW that peer review material was outstanding during the year. While this is appropriate as an initial point of escalation, at no time was the issue of non-compliance escalated to higher levels of management. DCS also never sent formal correspondence requesting the materials needed to ensure the completion of peer review.

DCS does not have a process for ensuring the timely completion of peer review in situations where urgency exemptions are used. There is an opportunity to formalise this process to ensure that there are appropriate escalation points and to ensure that compliance obligations are fulfilled in future.

Destination NSW did not meet the minimum requirement for allocation of the media budget for communications with CALD and Aboriginal audiences

The NSW Government 'CALD and Aboriginal Advertising Policy' stipulates that at least 7.5 per cent of an advertising campaign media budget is to be spent on direct communications to multicultural and Aboriginal audiences. Spend may be on media or non-media communication activities (e.g. events, participation at cultural festivals, direct mail, competitions and websites).

Destination NSW spent only 1.6 per cent of its media spend on culturally and linguistically diverse specific media placement on the 'Sydney - Love It Like You Mean It' campaign and none of its media placement for the other audited campaigns. This level of expenditure is substantially below the requirement.

Destination NSW could not demonstrate how its campaign designs or media placements effectively supported the cultural needs and issues of culturally and linguistically diverse populations. In connection with the 'Sydney - Love It Like You Mean It' campaign, it was noted that timeframes and production issues limited the ability to incorporate culturally diverse individuals in imagery.

Destination NSW advised that it believes the application of a 7.5 per cent threshold for specific audiences is not an effective way to reach these audiences. Destination NSW advised that its advertising was targeted at audiences with a propensity to travel, which did not necessarily include culturally diverse audiences, and its media channel research influenced its decision not to target specific CALD-focussed media channels.

None of the above factors negate Destination NSW's responsibility to ensure that the 'CALD and Aboriginal Advertising Policy' requirements are met.

In addition, Destination NSW also noted a number of non-media activities that supported culturally and linguistically diverse audiences, including translations on the sydney.com website, capturing of culturally and linguistically diverse audiences in production shooting and the production of a range of other collateral for culturally and linguistically diverse audiences. Despite these non-media activities, which Destination NSW did not quantify, the requirement for minimum expenditure in the reviewed campaigns for CALD audiences was not met by Destination NSW.

Destination NSW advised that it believes that the 7.5 per cent requirement does not apply to advertising outside of New South Wales, which the 'Get Your Sydney On', Love NSW and Road Trips campaigns targeted in whole or in part. The 'CALD and Aboriginal Advertising Policy' does not specifically limit its application to advertising for New South Wales residents.

Destination NSW did not establish comprehensive suites of measures and targets to allow for robust assessments of whether the campaigns achieved the intended outcomes from the campaigns. This limited the effectiveness of these measures as an accountability tool as intended by the NSW Government Evaluation Framework.

None of the campaigns met the majority of the targets which had been established. This means that the campaigns did not have the market impact that was committed at the time of making the investment. Despite this, the Love NSW campaign did have a positive return on investment. The 'Get Your Sydney On' campaign was not required to undergo a cost-benefit analysis as it fell below the threshold, and the Road Trips campaign had not been assessed for return on investment at the time of the audit. This indicates a measure of cost-efficiency in the delivery of one of the campaigns, and a positive impact on the New South Wales economy. For the 'Sydney - Love It Like You Mean It' campaign, both the benefit-to-cost ratio and the return on investment were considerably below reasonable benchmarks, indicating a poor cost-efficiency outcome from the investment.

In all procurement of research, production and media services, Destination NSW complied with relevant procurement requirements, providing support to achieving value for money in relevant expenditure. 

Appendix one – Response to Destination NSW

Appendix two – Response from agencies

Appendix three – About the campaigns

Appendix four – About the audit

Appendix five – Performance auditing

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #360 - released (23 December 2021).

Published

Actions for Machinery of government changes

Machinery of government changes

Premier and Cabinet
Treasury
Whole of Government
Management and administration
Project management

What the report is about

The term ‘machinery of government’ refers to the way government functions and responsibilities are organised.

The decision to make machinery of government changes is made by the Premier. Changes may be made for a range of reasons, including to support the policy and/or political objectives of the government of the day.

Larger machinery of government changes typically occur after an election or a change of Premier.

This report assessed how effectively the Department of Planning, Industry and Environment (DPIE) and the Department of Regional NSW (DRNSW) managed their 2019 and 2020 machinery of government changes, respectively. It also considered the role of the Department of Premier and Cabinet (DPC) and NSW Treasury in overseeing machinery of government changes.

What we found

The anticipated benefits of the changes were not articulated in sufficient detail and the achievement of benefits has not been monitored. The costs of the changes were not tracked or reported.

DPC and NSW Treasury provided principles to guide implementation but did not require departments to collect or report information about the benefits or costs of the changes.

The implementation of the machinery of government changes was completed within the set timeframes, and operations for the new departments commenced as scheduled.

Major implementation challenges included negotiation about the allocation of corporate support staff and the integration of complex corporate and ICT systems.

What we recommended

DPC and NSW Treasury should:

  • consolidate existing guidance on machinery of government changes into a single document that is available to all departments and agencies
  • provide guidance for departments and agencies to use when negotiating corporate services staff transfers as a part of machinery of government changes, including a standard rate for calculating corporate services requirements
  • progress work to develop and implement common processes and systems for corporate services in order to support more efficient movement of staff between departments and agencies.

Fast facts

  • $23.7m is the estimated minimum direct cost of the 2019 DPIE changes to date, noting additional ICT costs will be incurred
  • $4.0m is the estimated minimum direct cost of the 2020 DRNSW changes, with an estimated $2.7 million ongoing annual cost
  • 40+ NSW Government entities affected by the 2019 machinery of government changes

The term ‘machinery of government’ refers to the way government functions and responsibilities are allocated and structured across government departments and agencies. A machinery of government change is the reorganisation of these structures. This can involve establishing, merging or abolishing departments and agencies and transferring functions and responsibilities from one department or agency to another.

The decision to make machinery of government changes is made by the Premier. These changes may be made for a range of reasons, including to support the policy and/or political objectives of the government of the day. Machinery of government changes are formally set out in Administrative Arrangements Orders, which are prepared by the Department of Premier and Cabinet, as instructed by the Premier, and issued as legislative instruments under the Constitution Act 1902.

The heads of agencies subject to machinery of government changes are responsible for implementing them. For more complex changes, central agencies are also involved in providing guidance and monitoring progress.

The NSW Government announced major machinery of government changes after the 2019 state government election. These changes took place between April and June 2019 and involved abolishing five departments (Industry; Planning and Environment; Family and Community Services; Justice; and Finance, Services and Innovation) and creating three new departments (Planning, Industry and Environment; Communities and Justice; and Customer Service). This also resulted in changes to the 'clusters' associated with departments. The NSW Government uses clusters to group certain agencies and entities with related departments for administrative and financial management. Clusters do not have legal status. Most other departments that were not abolished had some functions added or removed as a part of these machinery of government changes. For example, the functions relating to regional policy and service delivery in the Department of Premier and Cabinet were moved to the new Department of Planning, Industry and Environment.

Our Report on State Finances 2019, tabled in October 2019, outlined these changes and identified several issues that can arise from machinery of government changes if risks are not identified early and properly managed. These include: challenges measuring the costs and benefits of machinery of government changes; disruption to services due to unclear roles and responsibilities; and disruption to control environments due to staff, system and process changes.

In April 2020, the Department of Regional NSW was created in a separate machinery of government change. This involved moving functions and agencies related to regional policy and service delivery from the Department of Planning, Industry and Environment into a standalone department.

This audit assessed how effectively the Department of Planning, Industry and Environment (DPIE) and the Department of Regional NSW (DRNSW) managed their 2019 and 2020 machinery of government changes, respectively. It also considered the role of the Department of Premier and Cabinet and NSW Treasury in overseeing machinery of government changes. The audit investigated whether:

  • DPIE and DRNSW have integrated new responsibilities and functions in an effective and timely manner
  • DPIE and DRNSW can demonstrate the costs of the machinery of government changes
  • The machinery of government changes have achieved or are achieving intended outcomes and benefits.
Conclusion

It is unclear whether the benefits of the machinery of government changes that created the Department of Planning, Industry and Environment (DPIE) and the Department of Regional NSW (DRNSW) outweigh the costs. The anticipated benefits of the changes were not articulated in sufficient detail and the achievement of directly attributable benefits has not been monitored. The costs of the changes were not tracked or reported. The benefits and costs of the machinery of government changes were not tracked because the Department of Premier and Cabinet (DPC) and NSW Treasury did not require departments to collect or report this information. The implementation of the machinery of government changes was completed within the set timeframes, and operations for the new departments commenced as scheduled. This was achieved despite short timelines and no additional budget allocation for the implementation of the changes.

The rationale for establishing DPIE was not documented at the time of the 2019 machinery of government changes and the anticipated benefits of the change were not defined by the government or the department. For DRNSW, the government’s stated purpose was to provide better representation and support for regional areas, but no prior analysis was conducted to quantify any problems or set targets for improvement. Both departments reported some anecdotal benefits linked to the machinery of government changes. However, improvements in these areas are difficult to attribute because neither department set specific measures or targets to align with these intended benefits. Since the machinery of government changes were completed, limited data has been gathered to allow comparisons of performance before and after the changes.

DPC and NSW Treasury advised that they did not define the purpose and benefits of the machinery of government changes, or request affected departments to do so, because these were decisions of the government and the role of the public service was to implement the decisions.

We have attempted to quantify some of the costs of the DPIE and DRNSW changes based on the information the audited agencies could provide. This information does not capture the full costs of the changes because some costs, such as the impact of disruption on staff, are very difficult to quantify, and the costs of ICT separation and integration work may continue for several more years. Noting these limitations, we estimate the initial costs of these machinery of government changes are at least $23.7 million for DPIE and $4.0 million for DRNSW. For DPIE, this is predominantly made up of ICT costs and redundancy payments made around the time of the machinery of government change. For DRNSW it includes ICT costs and an increase in senior executive costs for a standalone department, which we estimate is an ongoing cost of at least $1.9 million per year.

For the DPIE machinery of government change, there were risks associated with placing functions and agencies that represent potentially competing policy interests within the same 'cluster', such as environment protection and industry. We did not see evidence of plans to manage these issues being considered by DPIE as a part of the machinery of government change process.

The efficiency of machinery of government changes could be improved in several ways. This includes providing additional standardised guidance on the allocation of corporate functions and resources when agencies are being merged or separated, and consolidating guidance on defining, measuring and monitoring the benefits and costs of machinery of government changes.

Appendix one – Response from agencies

Appendix two – About the audit

Appendix three – Performance auditing

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #359 - released (17 December 2021).

Published

Actions for COVID Intensive Learning Support Program

COVID Intensive Learning Support Program

Education
Management and administration
Project management
Service delivery
Workforce and capability

What the report is about

This audit examined a state-wide program to provide small-group tuition to students disadvantaged by the move to learning from home during 2020.

The audit assessed the design and implementation of the program.

What we found

The program design was based on research and data showing learning loss during 2020. 

The department rapidly planned and developed the policy design and guidelines for schools. 

Governance arrangements matured during program delivery.

The department changed the models for funding schools but did not clearly explain the reasons for doing so.

Government schools with over 900 students were disadvantaged by the funding model compared to smaller schools. 

Guidelines, resources and professional learning helped schools implement the program.

Staff eligibility for the program was expanded after reported difficulties in recruiting qualified teachers in some areas. 

Online tuition and third-party provider options were developed throughout the program.

There were issues with the quality and timeliness of data used to monitor school progress. 

Evaluation arrangements were developed early in the program.

Data limitations mean the evaluation will not be able to fully assess all program objectives.

What we recommended

  1. Distributing funds between schools more equitably and improving communication of the funding methods. 
  2. Clearer communication about the intended targeted group of students.
  3. Reviewing the time needed to administer the program.
  4. Improve support for educators other than qualified teachers.
  5. Offer the online tuition program to more schools.
  6. Analysis of the effects of learning from home during 2021 across equity groups and geographic areas.
  7. Working with universities to increase use of pre-service teachers in the program.

The report also identifies lessons learned for future programs.
 

Fast facts

  • $337m in total program funding. $289 million for government schools and $31 million for non government schools
  • 12 days to develop the policy and provide costings to Treasury 
  • 290,000 targeted students in government schools and 31,000 in non government schools
  • 80% of schools were providing small group tuition by the target start date of Week 6, Term 1
  • 2–4 months was the estimated student learning loss from the move to learning from home during 2020
  • 7,600 tutors engaged in the program as at September 2021.

The NSW Government announced the COVID Intensive Learning Support Program on 10 November 2020, as part of the 2020–21 NSW Budget. The primary goal of the $337 million program was to deliver intensive small group tuition for students who were disadvantaged by the move to remote and/or flexible learning, helping to close the equity gap. It included:

  • $306 million to provide small-group tuition for eligible students across every NSW Government primary, secondary and special purpose school
  • $31.0 million for around 400 non-government schools to provide small-group tuition to students with the greatest levels of need.

The objective of this audit was to assess the effectiveness of the design and implementation of the COVID Intensive Learning Support Program (the program). To address this objective, the audit assessed whether the Department of Education (the department):

  • effectively designed the program and supporting governance arrangements
  • is effectively implementing the program.

This audit focuses on activities between October 2020 and August 2021, which aimed to address the first session of learning from home in New South Wales. From August to October 2021, students in many areas of New South Wales were learning from home again, but this second period has not been a focus of this audit. On 18 October 2021, the NSW Government announced the program would be extended into 2022.

Conclusion

The COVID Intensive Learning Support Program was effectively designed to help students catch up on learning loss due to the interruptions to schooling caused by COVID-19. The department rapidly stood up a taskforce to implement the program and then developed supporting governance arrangements during implementation.

Most students in New South Wales were required to learn from home for at least seven weeks during 2020 due to the impact of the Novel-Coronavirus (COVID-19). The department researched, analysed and advised government on several options to address the learning loss that resulted. It recommended small group tuition as the preferred option as it was supported by available evidence and could be rolled out at scale with speed. It identified risks of ensuring an adequate supply of educators and options to address those risks. Consistent with its analysis of where the impact of the learning loss was most severe, the department proposed to direct funding to schools with higher concentrations of students from the most disadvantaged backgrounds.

The department established a cross-functional taskforce to conduct detailed planning and support program implementation. Short timeframes meant the taskforce initially sought approval for key decisions from the program sponsor and existing oversight bodies on an as-needed basis before dedicated program governance arrangements were formalised. Once established, the governance body met regularly to oversee program delivery.

The COVID Intensive Learning Support Program is being effectively implemented. The department has refined the program during rollout to respond to risks, issues and feedback from schools. Issues with how schools enter data into department systems have affected the timeliness and accuracy of program monitoring information.

The department provided schools with guidelines, example models of delivery, systems to record student progress and professional learning. Around 80 per cent of schools had begun delivering tuition under the program by the target date. Schools reported issues with sourcing qualified teachers as a key reason they were unable to start the program by the expected date. In response, the department expanded the type of staff schools could employ, developed an online tuition program, and allowed schools to engage third-party providers to help schools that had difficulty finding qualified teachers for the program.

The department used existing systems to monitor school progress in implementing the program. This reduced the administrative burden on schools, but there were several issues with data quality and timeliness. The program included a mid-year review point to check whether schools were on track to spend their funding. This helped focus schools on ensuring funding would be spent and allowed for redistribution between schools.

The department considered program evaluation early in policy design and planning. It embedded an evaluator on the taskforce and expanded a key assessment program to help provide evidence of impact. A process and outcome evaluation is underway which will help inform future delivery. The evaluation will examine educational impacts for students participating in the program but it has not established methods to reliably assess the extent to which the program has met a goal to help 'close the equity gap' for students.

This chapter considers how effectively the COVID Intensive Learning Support Program (the program) was designed and planned for implementation.

This chapter considers how effectively the COVID Intensive Learning Support Program was implemented over our period of review (Terms 1 and 2, 2021).

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #358 - released (15 December 2021).

Published

Actions for Compliance with the NSW Cyber Security Policy

Compliance with the NSW Cyber Security Policy

Whole of Government
Compliance
Cyber security
Information technology

What the report is about

This audit assessed nine agencies’ compliance with the NSW Cyber Security Policy (CSP) including whether, during the year to 30 June 2020, the participating agencies:

  • met their reporting obligations under the CSP
  • reported accurate self-assessments of their level of maturity implementing the CSP’s requirements including the Australian Cyber Security Centre’s (ACSC) Essential 8.

What we found

Key elements to strengthen cyber security governance, controls and culture are not sufficiently robust and not consistently applied. The CSP is not achieving the objectives of improved cyber governance, controls and culture because:

  • the CSP does not specify a minimum level for agencies to achieve in implementing the 'mandatory requirements' or the Essential 8
  • the CSP does not require agencies to report their target levels, nor does it require risk acceptance decisions to be documented or formally endorsed
  • each participating agency had implemented one or more of the mandatory requirements in an ad hoc or inconsistent basis
  • none of the participating agencies had implemented all of the Essential 8 controls
  • agencies tended to over-assess their cyber security maturity - all nine participating agencies were unable to support all of their self-assessments with evidence
  • there is no monitoring of the adequacy or accuracy of agencies' self-assessments.

What we recommended

In this report, we repeat recommendations made in the 2019 and 2020 Central Agencies reports, that Cyber Security NSW and NSW Government agencies need to prioritise improvements to cyber security resilience as a matter of urgency.

Cyber Security NSW should:

  • monitor and report compliance with the CSP
  • require agencies to report the target and achieved levels of maturity
  • require agencies to justify why it is appropriate to target a low level of maturity
  • require the agency head to formally accept the residual risk
  • challenge agencies' target maturity levels.

Agencies should resolve discrepancies between their reported level of maturity and the level they are able to support with evidence.

Separately, the agencies we audited requested that we not disclose our audit findings. We reluctantly agreed to anonymise our findings, even though they are more than 12 months old. We are of the view that transparency and accountability to the Parliament of New South Wales are part of the solution, not the problem.

The poor levels of agency cyber security maturity are a significant concern. Improvement requires leadership and resourcing.

Fast facts

The NSW Cyber Security Policy requires agencies to report their level of maturity implementing the mandatory requirements, which includes the ACSC's Essential 8.

  • 100% of audited agencies failed to reach level one maturity for at least three of the Essential 8 controls.

  • 53% of mandatory requirements implemented in an ad hoc or inconsistent manner, or not at all.

  • 89 of the 104 reporting agencies across government met the reporting deadline of 31 August.

This report assesses whether state government agencies are complying with the NSW Cyber Security Policy. The audit was based on the level of compliance reported at 30 June 2020.

Our audit identified non-compliance and significant weaknesses against the government’s policy.

Audited agencies have requested that we not report the findings of this audit to the Parliament of New South Wales, even though the findings are more than 12 months old, believing that the audit report would expose their weaknesses to threat actors.

I have reluctantly agreed to modify my report to anonymise agencies and their specific failings because the vulnerabilities identified have not yet been remedied. Time, leadership and prioritised action should have been sufficient for agencies to improve their cyber safeguards. I am of the view that transparency and accountability to the Parliament is part of the solution, not the problem.

The poor levels of cyber security maturity are a significant concern. Improvement requires dedicated leadership and resourcing. To comply with some elements of the government’s policy agencies will have to invest in technical uplift and some measures may take time to implement. However, other elements of the policy do not require any investment in technology. They simply require leadership and management commitment to improve cyber literacy and culture. And they require accountability and transparency. Transparent reporting of performance is a key means to improve performance.

Cyber security is increasingly a focus of governments around Australia. The Australian Cyber Security Centre (ACSC) is the Australian Government’s lead agency for cyber security and is part of the Australian Signals Directorate, a statutory authority within the Australian Government’s Defence portfolio. The ACSC has advised that government agencies at all levels, as well as individuals and other organisations were increasingly targeted over the 2021 financial year1. The ACSC received over 67,500 cybercrime reports, a 13 per cent increase on the previous year. This equates to one reported cyber attack every eight minutes. They also noted that attacks by cyber criminals and state actors are becoming increasingly sophisticated and complex and that the attacks are increasingly likely to be categorised as ‘substantial’ in impact.

High profile attacks in Australia and overseas have included a sustained malware campaign targeted at the health sector2, a phishing campaign deploying emotet malware, spear phishing campaigns targeting people with administrator or other high-level access, and denial of service attacks. The continuing trend towards digital delivery of government services has increased the vulnerability of organisations to cyber threats.

The COVID-19 pandemic has increased these risks. It has increased Australian dependence on the internet – to work remotely, to access services and information, and to communicate and continue our daily lives. Traditional security policies within an organisation’s perimeter are harder to enforce in networks made up of home and other private networks, and assets the organisation does not manage. This has increased the cyber risks for NSW Government agencies.

In March 2020, Service NSW suffered two cyber security incidents in short succession. Technical analysis undertaken by the Department of Customer Service (DCS) concluded that these cyber breaches resulted from a phishing exercise through which external threat actors gained access to the email accounts of 47 staff members. These attacks resulted in the breach of a large amount of personal customer information contained in these email accounts. These attacks were the subject of the Auditor-General's report on Service NSW's handling of personal information tabled on 18 December 2020.

This audit also follows two significant performance audits. Managing cyber risks, tabled on 13 July 2021 found Transport for NSW and Sydney Trains were not effectively managing their cyber security risks. Integrity of data in the Births, Deaths and Marriages Register, tabled 7 April 2020 found that although there are controls in place to prevent and detect unauthorised access to, and activity in the register, there were significant gaps in these controls.

The NSW Cyber Security Policy (CSP) was issued by Cyber Security NSW, a business unit within the Department of Customer Service, and took effect from 1 February 2019. It applies to all NSW Government departments and public service agencies, including statutory authorities. Of the 104 agencies in the NSW public sector that self-assessed their maturity implementing the mandatory requirements, only five assessed their maturity at level three or above (on the five point maturity scale). This means that, according to their own self-assessments, 99 agencies practiced requirements within the framework in what the CSP’s maturity model describes as an ad hoc manner, or they did not practice the requirement at all. Cyber Security NSW and NSW Government agencies need to prioritise improvements to their cybersecurity and resilience as a matter of priority.

This audit looks specifically at the compliance of nine key agencies with the CSP. It looks at their achievement implementing the requirements of the policy, the accuracy of their self-assessments and the attestations they made as to their compliance with the CSP.

The CSP outlines the mandatory requirements to which all NSW Government departments and public service agencies must adhere. It seeks to ensure cyber security risks to agencies’ information and systems are appropriately managed. The key areas of responsibility for agencies are:

  • Lead - Agencies must implement cyber security planning and governance and report against the requirements outlined in the CSP and other cyber security measures.
  • Prepare - Agencies must build and support a cyber security culture across their agency and NSW Government more broadly.
  • Prevent - Agencies must manage cyber security risks to safeguard and secure their information and systems.
  • Detect/Respond/Recover - Agencies must improve their resilience including their ability to rapidly detect cyber incidents and respond appropriately.
  • Report - Agencies must report against the requirements outlined in the CSP and other cyber security measures.

DCS has only recommended, but not mandated the CSP for state owned corporations, local councils and universities.

NSW Government agencies must include an attestation on cyber security in their annual report and provide a copy to Cyber Security NSW by 31 August each year stating whether, for the preceding financial year, the agency has:

  • assessed its cyber security risks
  • appropriately addressed cyber security at agency governance forums
  • a cyber incident response plan that is integrated with the security components of business continuity arrangements, and the response plan has been tested during the previous 12 months (involving senior business executives)
  • certified the agency’s Information Security Management System (ISMS) or confirmed the agency’s Cyber Security Framework (CSF)
  • a plan to continuously improve the management of cyber security governance and resilience.

The purpose of the attestation is to focus the agency's attention on its cyber risks and the mitigation of those risks.

Agencies assess their level of compliance in accordance with a maturity model. The CSP does not mandate a minimum maturity threshold for any requirement, including implementation of the Australian Cyber Security Centre's (ACSC) Essential 8 Strategies to Mitigate Cyber Security Incidents (Essential 8).

Agencies are required to set a target maturity level based on their risk appetite for each requirement, seek continual improvement in their maturity, and annually assess their maturity on an ascending scale of one to five for all requirements (refer to Appendix two for the maturity model). Each control within the Essential 8 is assessed on an ascending scale of zero to three reflecting the agency's level of alignment with the strategy (refer to Appendix three for the maturity model).

Scope of this audit

We assessed whether agencies had provided accurate reporting on their level of maturity implementing the requirements of the CSP in a documented way and covering all their systems.

The scope of this audit covered nine agencies (the participating agencies). These agencies were selected because they are the lead agency in their cluster, or have a significant digital presence within their respective cluster. The list of participating agencies is in section 1.2. The audit aimed to determine whether, during the year to 30th June 2020, the participating agencies:

  • met their reporting obligations under the CSP
  • provided accurate reporting in self-assessments against the CSP’s mandatory requirements, including their implementation of the Australian Cyber Security Centre’s (ACSC) Essential 8
  • achieved implementation of mandatory requirements at maturity levels which meet or exceed the ‘level three - defined’ threshold (i.e. are documented and practiced on a regular and consistent basis).

While the audit does assess the accuracy of agency self-assessed ratings, the audit did not assess the appropriateness of the maturity ratings.

Conclusion

Key elements to strengthen cyber security governance, controls and culture are not sufficiently robust and not consistently applied. There has been insufficient progress to improve cyber security safeguards across NSW Government agencies.
The NSW CSP replaced the NSW Digital Information Security Policy from 1 February 2019. New requirements of the CSP were, inter alia, to strengthen cyber security governance, strengthen cyber security controls and improve cyber security culture.
The CSP is not achieving the objective of improved cyber governance, controls and culture because:
  • The CSP does not specify a minimum level for agencies to achieve in implementing the 'mandatory requirements' or the Essential 8 Strategies to Mitigate Cyber Security Incidents.
  • The CSP does not require agencies to report their target levels, nor does it require risk acceptance decisions to be documented or formally endorsed.
  • All of the participating agencies had implemented one or more of the mandatory requirements in an ad hoc or inconsistent basis.
  • None of the participating agencies had implemented all of the Essential 8 controls to at least level one.
  • Agencies tended to over-assess their cyber security maturity, with all nine participating agencies unable to support some of their self-assessments of compliance with one or more mandatory criteria. Optimistic assessment of the current state of cyber resilience undermines effective decision making and risk management in responding to cyber risks.
  • There is no systematised and formal monitoring, by either Cyber Security NSW or another agency, of the adequacy or accuracy of agencies' cyber self-assessment processes.

 

1. Key findings

The CSP allows agencies to determine their own level of maturity to implement the 'mandatory requirements', which can include not practicing a policy requirement or implementing a policy requirement on an ad hoc basis. These determinations do not need to be justified

Agencies can decide not to implement requirements of the CSP, or they can decide to implement them only in an informal or ad-hoc manner. The CSP allows agencies to determine their desired level of maturity in implementing the requirements on a scale of one to five - level one being 'initial – not practiced' and level five being 'optimised'. The desired level of maturity is determined by the agency based on their own assessment of the risk of the services they provide and the information they hold.

The reporting template for the 2019 version of the CSP stated that level three maturity - where a policy requirement is practiced on a regular and consistent basis and its processes are documented - was required for compliance with the CSP. This requirement was removed in the 2020 revision of the reporting template.

This CSP does not require the decisions on risk tolerance, or the timeframes agencies have set to implement requirements to be documented or formally endorsed by the agency head. There is no requirement to report these decisions to Cyber Security NSW.

Some comparable jurisdictions require formal risk acceptance decisions where requirements are not implemented. The NSW CSP does not have a similar formal requirement

Some jurisdictions, with a similar policy framework to NSW, require agencies to demonstrate reasons for not implementing requirements, and require agency heads to formally acknowledge the residual risk. The NSW CSP does not require these considerations to be documented, nor does it require an explicit acknowledgement and acceptance of the residual risk by the agency head or Cyber Security NSW. The NSW CSP does not require that the records of how agencies considered and decided which measures to adopt to be documented and auditable, limiting transparency and accountability of decisions made.

All of the participating agencies had implemented one or more of the mandatory requirements in an ad hoc or inconsistent basis

All of the participating agencies had implemented one or more of the mandatory requirements at level one or two. Maturity below level three typically means not all elements of the requirement have been implemented, or the requirements have been implemented on an ad-hoc or inconsistent basis.

None of the participating agencies has implemented all of the Essential 8 controls at level one – that is, only partly aligned with the intent of the mitigation strategy

Eight of the nine agencies we audited had not implemented any of the Essential 8 strategies to level three – that is, fully aligned with the intent of the mitigation strategy. At the time of this audit the ACSC advised that:

as a baseline organisations should aim to reach to reach Maturity Level Three for each mitigation strategy3.

The Australian Signals Directorate4 currently advises that, with respect to the Essential 8:

[even] level three maturity will not stop adversaries willing and able to invest enough time, money and effort to compromise a target. As such, organisations still need to consider the remainder of the mitigation strategies from the Strategies to Mitigate Cyber Security Incidents and the Australian Government Information Security Manual

All agencies failed to reach even level one maturity for at least three of the Essential 8.

Cyber Security NSW modified the ACSC model for implementation of the Essential 8

The NSW maturity model used for the Essential 8 does not fully align with the ACSC’s model. At the time of this audit the major difference was the inclusion of level zero in the NSW CSP maturity scale. Level zero broadly means that the relevant cyber mitigation strategy is not implemented or is not applied consistently. Level zero had been removed by the ACSC in February 2019 and was not part of the framework at the time of this audit. It was re-introduced in July 2021 when the ACSC revised the detailed criteria for each element of the essential 8 maturity model. The indicators to reach level one on the new ACSC model are more detailed, specific and rigorous than those currently prescribed for NSW Government agencies. Cyber Security NSW asserted the level zero on the CSP maturity scale:

is not identical to the level zero of the ACSC’s previous Essential 8 maturity model, but is a NSW-specific inclusion designed to prevent agencies incorrectly assessing as level one when they have not achieved that level.

Attestations did not accurately reflect whether agencies implemented the requirements

Of the nine participating agencies, seven did not modify the proforma wording in their attestation to reflect their actual situation. Despite known gaps in their implementation of mandatory requirements, these agencies stated that they had 'managed cyber security risks in a manner consistent with the Mandatory Requirements set out in the NSW Government Cyber Security Policy'. Only two agencies modified the wording of the attestation to reflect their actual situation.

Attestations should be accurate so that agencies’ and the government’s response to the risk of cyber attack is properly informed by an understanding of the gaps in agency implementation of the policy requirements and the Essential 8. Without accurate information about these gaps, subsequent decisions as to prioritisation of effort and deployment of resources are unlikely to effectively mitigate the risks faced by NSW Government agencies.

Participating agencies were not able to support all of their self-assessments with evidence and had overstated their maturity assessments, limiting the effectiveness of agency risk management approaches

Seven of the nine participating agencies reported levels of maturity against both the mandatory requirements and the Essential 8 that were not supported by evidence.

Each of the nine participating agencies for this audit had overstated their level of maturity against at least one of the 20 mandatory requirements. Seven agencies were not able to provide evidence to support their self-assessed ratings for the Essential 8 controls.

Where agency staff over-assess the current state of their cyber resilience, it can undermine the effectiveness of subsequent decision making by Agency Heads and those charged with governance. It means that actions taken in mitigating cyber risks are less likely to be appropriate and that gaps in implementing cyber security measures will remain, exposing them to cyber attack.

Agencies' self-assessments across government exposed poor levels of maturity in implementing the mandatory requirements and the Essential 8 controls

We reviewed the data 104 NSW agencies provided to Cyber Security NSW. The 104 agencies includes nine audited agencies referred to in more detail in this report. Our review of the 104 agency self-assessment returns submitted to Cyber Security NSW highlighted that, consistent with previous years, there remains reported poor levels of cyber security maturity. We reported the previous years’ self-assessments in the Central Agencies 2019 Report to Parliament and the Central Agencies 2020 Report to Parliament.

Only five out of the 104 agencies self-assessed that they had implemented all of the mandatory requirements at level three or above (against the five point scale). Fourteen agencies self-assessed that they had implemented each of the Essential 8 controls at level one maturity or higher (using Cyber NSW’s four point scale). The remainder reported at level zero for implementation of one or more of the Essential 8 controls, meaning that for the majority of agencies the cyber mitigation strategy has not been implemented, or is applied inconsistently.

Where agencies had reported in both 2019 and 2020, agencies’ self-assessments showed little improvement over the previous year’s self-assessments:

  • 14 agencies reported improvement across both the Essential 8 and the mandatory requirements
  • 8 agencies reported a net decline in both the Essential 8 and the mandatory requirements.

The poor levels of maturity in implementing the Essential 8 over the last couple of years is an area of significant concern that requires better leadership and resourcing to prioritise the required significant improvement in agency cyber security measures.

2. Recommendations

Cyber Security NSW should:

1. monitor and report compliance with the CSP by:

  • obtaining objective assurance over the accuracy of self-assessments
  • requiring agencies to resolve inaccurate or anomalous self-assessments where these are apparent

2. require agencies to report:

  • the target level of maturity for each mandatory requirement they have determined appropriate for their agency
  • the agency head's acceptance of the residual risk where the target levels are low

3. identify and challenge discrepancies between agencies' target maturity levels and the risks of the information they hold and services they provide

4. more closely align their policy with the most current version of the ACSC model.

Participating agencies should:

5. resolve the discrepancies between their reported level of maturity and the level they are able to demonstrate with evidence, and:

  • compile and retain in accessible form the artefacts that demonstrate the basis of their self-assessments
  • refer to the CSP guidance when determining their current level of maturity
  • ensure the attestations they make refer to departures from the CSP
  • have processes whereby the agency head and those charged with governance formally accept the residual cyber risks.

Repeat recommendation from the 2019 Central Agencies report and the 2020 Central Agencies report

6. Cyber Security NSW and NSW Government agencies need to prioritise improvements to their cyber security and resilience as a matter of urgency.


The objective of the CSP is to ensure cyber security risks are appropriately managed. However, meeting this objective depends on the requirements being implemented at all agencies to a level of maturity that addresses their specific cyber security risks. Agency systems and data are increasingly interconnected. If an agency does not implement the requirements, or implements them only in an ad-hoc or informal way, an agency is more susceptible to their systems and data being compromised, which may affect the confidentiality of citizens' data and the reliability of services, including critical infrastructure services.

Agencies determine their own target level of maturity, which may mean the requirement is not addressed, or is addressed in an ad hoc or inconsistent way

While the CSP is mandatory for all agencies, it does not set a minimum maturity threshold for agencies to meet.

The reporting template issued in 2019 stated that agencies were required to reach level three maturity in order to comply with the CSP. The 2020 revision6 of the CSP and guidance indicates that level three maturity may not be sufficient to mitigate risks. It advises the agency may determine the level to which it believes it is suitable to implement the requirements, and allows for an agency to aim for a target level of maturity less than level three. The agency can set its optimal maturity level with reference to its risk tolerance with the objective that that aim ‘to be as high as possible’. However, ‘as high as possible’ does not necessarily mean ‘fully implemented’. The CSP contemplates that a lower level of maturity is sufficient if it aligns with the agency's risk tolerance.

2019 reporting template 2020 reporting template
‘A Mandatory Requirement is considered met if a maturity level of three is achieved. The Agency may choose to pursue a higher maturity level if required.

There is no mandated level for the Essential 8 Maturity reporting’.

‘There is no mandated maturity level for either the Mandatory Requirement reporting or Essential 8 reporting. Agencies need to risk-assess their optimal maturity and aim to be 'as high as possible’.
Source: Maturity Reporting Template v4.0, February 2019.
Source: CSP Reporting Template 2020, May 2020.

The Department of Customer Service asserts that while the quotes above were part of their annual templates and policy documents, their documents were incorrect. They assert that the policy has never required a minimum level of maturity to be reached. They have responded to our enquiries that:

…a level three maturity was not a requirement of the Policy or Maturity Model’ and ‘it is misleading to suggest it was a requirement of the Policy.

This audit found that, based on the 2020 reporting template there is no established minimum baseline. Consequently, because the Department of Customer Service had not established a minimum baseline agencies are able to target lower levels (providing they were within the agency’s own risk appetite), which includes targeting to not practice a CSP policy requirement, or to practice a CSP policy requirement on an ad hoc basis.

Where requirements are not implemented, documentation of formal acceptance of the residual risks by the agency head is not required

The New Zealand Government has an approach that is not dissimilar to NSW, in that it also identifies 20 mandatory requirements and allows for a risk based approach to implementation. However, the New Zealand approach puts more rigor around risk acceptance decisions.

The New Zealand Government requires that agencies that do not implement the requirements must demonstrate that a measure is not relevant for them. It requires agencies to document the rationale for not implementing the measure, including explicit acknowledgement of the residual risk by the agency head. They require these records to be auditable.

A security measure with a ‘must’ or ‘must not’ compliance requirement is mandatory. You must implement or follow mandatory security measures unless you can demonstrate that a measure is not relevant in your context.

Not using a security measure without due consideration may increase residual risk for your organisation. This residual risk needs to be agreed and acknowledged by your organisation head.

A formal auditable record of how you considered and decided which measures to adopt is required as part of the governance and assurance processes within your organisation.

Source: Overview of Protective Security Requirements, New Zealand Government (PSR-Overview-booklet.pdf (protectivesecurity.govt.nz).

The NSW CSP does not require these considerations to be documented or auditable and does not require an explicit acknowledgement or acceptance of the residual risk by the agency head.

None of the participating agencies achieved level three implementation for all mandatory risk prevention and mitigation requirements

Maturity level three is the minimum level whereby an agency has implemented documented processes that are practiced on a regular basis across their environment. An agency has not reached level three if the requirement is implemented on an ad-hoc or inconsistent basis, or if not all elements of the requirement have been implemented.

None of the participating agencies achieved level three implementation for all mandatory requirements.

The requirements of the CSP are organised into five sections. Agency implementation of these requirements is discussed in the next five sections of this report.

  • Lead: Planning and governance requirements. Section 2.1
  • Prepare: Cyber security culture requirements. Section 2.2
  • Prevent: Managing cyber incident prevention requirements. Section 2.3
  • Detect/Respond/Recover: Resilience requirements. Section 2.4
  • Report: Reporting requirements. Section 2.5.

 


6The reporting template issued in 2019 required agencies to reach level three, but that guidance was removed in the 2020 revision.

Appendix one – Response from agencies

Appendix two – The maturity model for the mandatory requirements

Appendix three – Essential 8 maturity model

Appendix four – About the audit

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Rail freight and Greater Sydney

Rail freight and Greater Sydney

Transport
Information technology
Infrastructure
Management and administration
Project management
Service delivery

What the report is about

The movement of freight contributes $66 billion annually to the NSW economy. Two thirds of all freight in NSW moves through Greater Sydney, and the volume of freight moving through Greater Sydney is expected to increase by 48 per cent by 2036.

This audit assessed the effectiveness of transport agencies in improving the use of rail freight capacity in Greater Sydney, and to meet current and future freight demand.

What we found

Transport agencies do not have strategies or targets in place to improve the efficiency or capacity of the metropolitan shared rail network for freight.

The transport agencies acknowledge that they do not have sufficient information to achieve the most efficient freight outcomes and they do not know how to use the shared rail network to maximise freight capacity without compromising passenger rail services.

The Freight and Ports Plan 2018-2023 contains one target for rail freight - to increase the use of rail at Port Botany to 28 per cent by 2021. However, Transport for NSW (TfNSW)'s data indicates this target will not be met.

Sydney Trains records data on train movements and collects some data on delays and incidents. TfNSW collects data for the construction of the Standard Working Timetable and third-party contracts.

However, a lack of clarity around what data is gathered and who has ownership of the data makes data sharing difficult and limits its analysis and reporting.

The Freight and Ports Plan 2018-2023 includes the goal of 'Reducing avoidable rail freight delays', but the transport agencies do not have any definition for an avoidable delay and, as a result, do not measure or report them.

TfNSW and Sydney Trains are appointed to manage and deliver the Transport Asset Holding Entity of New South Wales (TAHE)'s obligations to allow rail freight operators to use the shared rail network. There are no performance measures in rail freight operator contracts or inter-agency agreements. This limits transport agencies' ability to improve performance.

TfNSW’s Freight Branch is working on four freight-specific strategies; a review of the Plan, a freight rail strategy, a port efficiency strategy and a freight data strategy.

TfNSW has not yet determined the timeframes or intended outcomes of these strategies.

What we recommended

Transport agencies should:

  • commit, as part of the review of Future Transport 2056, to delivering the freight-specific strategies currently in development and develop whole-of-cluster accountability for this work including timeframes, specific targets and clear roles and responsibilities 
  • improve the collection and sharing of freight data
  • develop a plan to reduce avoidable freight delays
  • systematically collect data on the management of all delays involving and/or impacting rail-freight
  • develop and implement key performance indicators for the agreements between the transport agencies.

Fast facts    

  • 288 million tonnes of freight volume predicted to pass through Greater Sydney in 2036, up from 194 million in 2016 (an increase of 48%)

  • 54 trucks that can be replaced by one 600 m long port shuttle freight train    

  • 26,671 freight trains that passed through the metropolitan shared rail network between 1 July 2020 and 30 June 2021

The movement of freight contributes $66.0 billion annually to the New South Wales economy — or 13 per cent of the Gross State Product. Two thirds of all freight in New South Wales moves through Greater Sydney, and the volume of freight moving through Greater Sydney is expected to increase by 48 per cent by 2036. This increasing demand is driven by increasing population and economic growth.

The sequence of activities required to move goods from their point of origin to the eventual consumer (the supply chain) is what matters most to shippers and consumers. Road can provide a single-mode door-to-door service, whereas conveying goods by rail typically involves moving freight onto road at some point. In Greater Sydney, 80 per cent of all freight is moved on road. Freight often passes through intermodal terminals (IMTs) as it transitions from one mode of transport to the next.

In 2016, Transport for NSW (TfNSW) released Future Transport 2056 - the NSW Government's 40-year vision for transport in New South Wales, which is intended to guide investment over the longer term. In Future Transport 2056, TfNSW noted that New South Wales will struggle to meet increasing demand for freight movements unless rail plays a larger role in the movement of freight.

Sydney Trains manages the metropolitan shared rail network, which is made up of rail lines that are used by both passenger and freight trains. The Transport Administration Act 1988 requires that, for the purposes of network control and timetabling, NSW Government transport agencies give ‘reasonable priority’ to passenger trains on shared lines. As the Greater Sydney population and rail patronage continue to grow, so too will competition for access to the shared rail network. See Appendix two for details of the area encompassed by Greater Sydney.

Freight operators can also use dedicated rail freight lines operated by the Australian Rail Track Corporation (ARTC - an Australian Government statutory-owned corporation). As the metropolitan shared rail network connects with dedicated freight lines, freight operators often use both to complete a journey.

TfNSW, Sydney Trains and the Transport Asset Holding Entity (TAHE) work in conjunction with other rail infrastructure owners and private sector entities, including port operators, privately operated IMTs and freight-shipping companies. TfNSW and Sydney Trains are responsible for managing the movement of freight across the metropolitan shared rail network. TAHE is the owner of the rail infrastructure that makes up the metropolitan shared rail network. The NSW Government established TAHE, a NSW Government state-owned corporation, on 1 July 2020 to replace the former rail infrastructure owner - RailCorp. The Auditor-General for New South Wales has commenced a performance audit on TAHE which is expected to table in 2022.

On 1 July 2021, TAHE entered into new agreements with TfNSW and Sydney Trains to operate, manage and maintain the metropolitan shared rail network. Until 30 June 2021, and in accordance with TAHE's Implementation Deed, TAHE operated under the terms of RailCorp's existing arrangements and agreements.

This audit assessed the effectiveness of TfNSW, Sydney Trains and TAHE in improving the use of rail freight capacity in Greater Sydney, and to meet current and future freight demand.

The audit focused on:

  • the monitoring of access to shared rail lines
  • the management of avoidable delays of rail freight movements
  • steps to increase the use of rail freight capacity in Greater Sydney.

Conclusion

Transport agencies do not have clear strategies or targets in place to improve the freight efficiency or capacity of the metropolitan shared rail network. They also do not know how to make best use the rail network to achieve the efficient use of its rail freight capacity. These factors expose the risk that rail freight capacity will not meet anticipated increases in freight demand.

Future Transport 2056 notes that opportunities exist to shift more freight onto rail, and that making this change remains an important priority for the NSW Government. However, the transport agencies acknowledge that they do not have sufficient information to achieve the most efficient freight outcomes. In particular, transport agencies do not know how to use the shared rail network in a way that maximises freight capacity without compromising passenger rail services.

Neither Future Transport 2056 nor the Freight and Ports Plan 2018–2023 give any guidance on how transport agencies will improve the efficiency or capacity of the shared rail network. Other than a target for rail freight movements to and from Port Botany, which TfNSW's data indicates will not be met, there are no targets for improving rail freight capacity across the shared network. The lack of specific strategies, objectives and targets reduces accountability and makes it difficult for transport agencies to effectively improve the use of rail freight capacity in line with their commitment to do so.

Sydney Trains and Transport for NSW do not effectively use data to improve rail freight performance and capacity.

To drive performance improvement when planning for the future, transport agencies need good quality data on freight management and movements. Sydney Trains records data on train movements in real-time and collects some data on delays and incidents. TfNSW collects data for the construction of the Standard Working Timetable (SWTT) and third-party contracts. However, the different types of data gathered and the separation between the teams responsible mean that there is a lack of clarity around what data is gathered and who has ownership it. This lack of coordination prevents best use of the data to develop a single picture of how well the network is operating or how performance could be improved.

Sydney Trains' ability to evaluate the effectiveness of its incident and delay mitigation strategies is also limited by a lack of information on its management of rail-freight related delays or incidents. While Sydney Trains collects data on major incidents, it can only use this to conduct event-specific analysis on the causes of an incident, and to review the operational and management response. The use of complete and accurate incident data would assist to define, identify and reduce avoidable delays. Reducing avoidable delays is a goal of the Freight and Ports Plan 2018–2023. More complete data on all incidents would help TfNSW to have more effective performance discussions with rail freight operators to help improve performance.

TfNSW has started developing strategies to identify how it can use rail freight capacity to achieve efficient freight outcomes, but it has not committed to implementation timeframes for this work.

TfNSW’s Freight Branch has started work on four freight-specific strategies to improve freight efficiency: a review of the Plan, a freight rail strategy, a port efficiency strategy and a freight data strategy. However, none of these strategies will be fully developed before the end of 2022. TfNSW has not yet determined the implementation timeframes or intended outcomes of these strategies, although TfNSW reports that it is taking an iterative approach and some recommendations and initiatives will be developed during 2022. 

Appendix one - Response from agencies

Appendix two - The Greater Sydney region

Appendix three - TfNSW strategic projects 

Appendix four - Sydney Trains path priority principles 

Appendix five - Sydney Trains delay management

Appendix six - About the audit 

Appendix seven - Performance auditing
 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

 

Parliamentary reference - Report number #357 - released (19 October 2021).

Published

Actions for Access to health services in custody

Access to health services in custody

Health
Justice
Management and administration
Service delivery

What the report is about

This audit assessed whether adults in custody have effective access to health services. The audit examined the activities of Justice Health and Corrective Services NSW.

What we found

The majority of custodial patients receive timely health care, but a small proportion of patients are not receiving care within target timeframes.

Eleven per cent of scheduled health appointments are not attended, and agencies can do more to understand the reasons for non-attendance.

Demand for mental health care exceeds service capacity and some patients are held in environments not appropriate for their needs.

Justice Health's information systems do not support the effective transfer of medical records as patients move around the prison network.

Not all patients are released from custody with a discharge plan.

Justice Health's system managers do not receive sufficiently detailed reports to understand strategic risks or opportunities to improve access to health services.

Public and private prison health operators do not report against consistent performance measures.

Justice Health is mandated to assess health services in private prisons. This conflicts with its role as a contracted provider of health services in the private prison system.

What we recommended

Enhanced reporting on patient access to health services, to identify risks and challenges across key service areas.

Identification and implementation of the improvements required for information to be shared across the custodial network and with external health providers.

Development of a framework to govern and monitor costs for patient health escorts and movements.

Development of a framework to govern responsibilities for mental health services.

Progression of infrastructure plans that address the lack of specialist accommodation for mental health patients and aged and frail patients.

Collaboration to align the performance measures to enable benchmarking between public and private prison health services.

Action to remediate the conflicting monitoring arrangements of public and private prison health operators.

Fast facts

  • 13,063 adults in the NSW prison population at 31 March 2021
  • 31,750 unique adult patients provided with medical care in 2020
  • 770,000 occasions of medical care provided by Justice Health in 2020
  • 50% of all health treatment in prisons is provided to patients who receive immediate medical attention
  • 60,000 appointments for health care in prisons were not attended in 2020
  • 94,810 occasions of psychology service provided by Corrective Services in 2020

Access to health services in custody

This audit examined whether adults in the New South Wales public prison system have effective access to health services. In making this assessment, we considered whether Justice Health and Corrective Services NSW effectively cooperate and coordinate so that patients have timely access to health services, systems and practices support continuity of care, and access to health services is monitored and reviewed.

As part of this audit, we assessed actions undertaken by Justice Health and Corrective Services NSW in managing the first COVID-19 outbreak in 2020. However, due to the timing of this audit report, this audit does not report on the agencies’ response to managing the current outbreak of COVID-19 in September 2021.

Health services in New South Wales prisons are delivered by both public and private operators. The public prison system is made up of 33 correctional centres and the Long Bay Hospital. All health services in the public prison system are delivered by the Justice Health and Forensic Mental Health Network (Justice Health).

In the public prison system, Justice Health is responsible for the clinical care of patients with physical and mental illnesses. Clinicians provide health assessments, treatments, medication management, and some counselling services in prison health clinics. Patients are triaged by primary health nurses and if they require treatments or medication, they are referred to prison‑based doctors including specialists or other clinicians. Patients requiring complex or emergency care are transferred to hospitals or other specialty services outside the prison complex.

Private operators deliver health services in three private prisons through contract arrangements with Corrective Services NSW. Justice Health delivers health care at one correctional centre via a contract arrangement with Corrective Services NSW. In total, contracted health service operators deliver health care to approximately 25 per cent of the New South Wales prison population.

Justice Health is required by law to monitor the performance of contracted health service providers in New South Wales prisons, including services provided at the John Morony Correctional Centre. The Auditor‑General’s mandate does not permit a direct examination of information held by private sector entities, however this audit does assess the effectiveness of Justice Health's role in monitoring health services in private prisons.

Corrective Services NSW is responsible for security in public prisons, including the facilitation of patient access to health care at prison health clinics and the transfer of patients to hospitals and other health services outside of the prison environment. Corrective Services NSW also delivers behaviour‑based psychology services. Some are delivered as behaviour modification courses that aim to reduce criminal and offending activity amongst the prison population. These programs may be linked to parole or other custodial conditions. Other psychology services include counselling for people with self‑harming or suicidal behaviours.

Research from the Australian Institute of Health and Welfare indicates that people in custody are more likely than the general population to be affected by chronic and acute illnesses, including higher rates of mental illness and communicable diseases1. In March 2021, there were 13,063 adults in custody in New South Wales.

The objective of this performance audit was to assess whether adults in the public prison system have effective access to health services. In making this assessment, we considered whether Justice Health and Corrective Services NSW effectively cooperate and coordinate so that:

  • patients have timely access to health services
  • systems and practices support the continuity of health care
  • access to health services is monitored, reviewed, and reported across the network. 

1The Australian Institute of Health and Welfare, Adult Prisoners Snapshot, 11 September 2019. At: https://www.aihw.gov.au/reports/australias-welfare/adult-prisoners.
 

Conclusion

Justice Health delivers timely health care to adult custodial patients who need routine medications and treatment for minor medical conditions. Justice Health also delivers timely care to patients requiring urgent medical attention, including emergency transfers to hospitals. However, Justice Health does not always meet recommended timeframes to deliver health care to patients who are waitlisted for treatment from doctors and other medical specialists, or for those waiting for assessments and prescriptions.

In 2020, Justice Health provided over 770,000 instances of medical care to adults in the New South Wales prison network. Approximately half of this health care was delivered on the spot, by nurses who dispensed routine medications or treated the minor medical ailments of 'walk‑in' patients.

Doctors, specialists, and nurse clinicians delivered the other half of prison health care via scheduled health appointments. In most cases, this health care was timely, except for a proportion of patients who were waiting for time‑critical treatments, prescriptions, or assessments. In 2020, 40 per cent of patients identified as 'Priority 1' did not receive care within the recommended three‑day timeframe. Patients waiting for these appointments constitute a small proportion of all health care delivered in 2020, at about one per cent of all health care. Nevertheless, the needs of Priority 1 patients are significant, and Justice Health does not know whether the prolonged wait times led to deteriorations in health outcomes, or other adverse outcomes.

Close to 1,000 patients required emergency treatment in 2020, and were transferred to hospitals as soon as their medical condition was identified by prison health staff.

Justice Health uses multiple information management systems that are not sufficiently linked to transfer all patient medical records and appointment information when patients are moved across the prison system. Appointment schedules and patient medications are transferred through manual processes. There is also limited information sharing with community health providers when custodial patients enter or leave custody.

Justice Health has multiple and parallel information systems, including paper‑based medical records. These systems are not effective for information sharing across the prison system as patients are moved between prisons and facilities at frequent intervals. Clinical staff are not always alerted when a patient is moved from one prison to another, or released from custody after a court appearance. This impacts on the effective scheduling and management of prison health appointments, and the exchange of patient health records across the prison network.

Justice Health's information systems and protocols also do not support the effective exchange of information with external health providers. The transfer of health information is a manual process and there can be significant delays in providing or receiving information from community health providers when custodial patients enter prisons or are released.

Corrective Services NSW and Justice Health executives do not receive sufficiently detailed information or reports to understand the impediments to health service accessibility and to enable system improvements. There is also limited joint planning between the two agencies to improve patient access to health care. The governance and monitoring arrangements for public and private prison health services are flawed and create a conflict of interest for Justice Health as both a service provider and a system monitor.

Justice Health's data dashboard assists managers and clinicians to understand and manage the wait times for health appointments at the prison service level. However, reporting to senior executives on wait times for health services is insufficiently detailed to indicate risks or opportunities for strategic improvement. Corrective Services NSW does not produce sufficiently detailed reports on the costs of transferring custodial patients to health appointments outside the prison network to improve efficiencies or understand trends over time.

There is not enough system‑level planning between Corrective Services NSW and Justice Health to optimise patient attendance at health appointments. Greater collaboration is needed to improve appointment scheduling through notifications about patient movements across the prison network.

There are limitations in the performance monitoring of public and private prison health services. It is not possible to benchmark or compare public and private prison health services and outcomes because the two systems do not report against common Key Performance Indicators.

While Justice Health has taken steps to maintain independence and transparency in its legislated role as assessor of health services in private prisons, there is an inherent conflict of interest in this monitoring role, as Justice Health is also a contracted provider of health services in the private prison system.

1. Key findings

The majority of custodial patients receive timely health care, but a small proportion of patients with priority appointments are not receiving care within target timeframes

Approximately half of all health care provided by Justice Health is immediate. It is delivered to 'walk‑in' patients as soon as they present at prison health clinics. Most of these patients are receiving daily medications, while a small proportion require urgent or immediate care for injuries or illnesses. The other half of prison health care is delivered via scheduled appointments. Patients waiting for health appointments are given a priority rating according to the time within which they should be seen by a clinician.

Patients requiring the most time‑critical care are given a Priority 1 rating. These patients should receive treatment within one to three days. In December 2020, the average wait time for Priority 1 treatment was five and a half days, almost double the target. This is an improvement on wait times in June 2019, when the average wait time was just over 13 days. Justice Health does not assess or measure the impacts of delayed care on these patients.

According to Justice Health, the high numbers of ‘walk‑ins’ contribute to increased wait times for medical appointments. In addition, some specialty health clinics operate weekly, which means that patients cannot be seen by specialists within a one to three‑day timeline. Security events such as prison lockdowns can also contribute to increased wait times, as they limit the access that patients have to prison health clinics during out‑of‑cell hours.

If patients need emergency medical treatment, they are transferred to hospitals in line with Justice Health's policy. In 2020, just over 1,000 patients were transferred to hospital for emergency medical care.

A significant proportion of prison health appointments are not attended, and not enough is being done to understand the reasons, or to improve attendance rates

In 2020, 11 per cent of all scheduled health appointments in prison clinics were not attended. This amounts to approximately 60,000 appointments over the year. Non‑attended appointments have flow‑on impacts on wait times and backlogs for scheduled health appointments. Understanding why they occur is necessary to improve efficiencies in scheduling and patient access to health services.

In 2020, the most common reason for non‑attended health appointments was: 'patient unable to attend'. Justice Health clinicians use this when patients do not arrive at the prison health clinic at the scheduled time, and clinicians lack any other information to explain the non‑attendance.

The second most common recorded reason for non‑attended appointments was: 'cancelled by Corrective Services NSW'. These cancellations are due to operational or security reasons, including prison lockdowns. Data from Justice Health indicates that in 2020, there were an average of 12 lockdowns per week across New South Wales prisons.

A range of factors can impact on patient attendance at appointments, some of which are unavoidable. That said, more can be done to understand and reduce non‑attendance. For example, there is potential for Corrective Services NSW to implement tighter protocols to update information about patient availability on the daily movement lists. This might include checking whether patients are willing to attend appointments. Similarly, there is potential for Justice Health clinicians to implement tighter protocols to check patient lists ahead of scheduled appointments, and to re‑schedule appointments where patients are unavailable.

Demand for mental health care exceeds service capacity and some patients are held in environments that are not appropriate for their needs

There is a high demand for mental health services in New South Wales prisons. In March 2021, at least 143 mental health patients were waiting for access to an acute or sub‑acute mental health unit across the New South Wales prison system. The average wait time for a mental health facility was 43 days. Seventeen patients had wait times of over 100 days. Patients waiting for sub‑acute mental health services had longer wait times than those waiting for acute mental health services.

There are limited mental health beds for women across the New South Wales prison network. There are ten allocated beds for women at the Mental Health Screening Unit at Silverwater Correctional Complex, and no allocated beds for women at Long Bay Hospital.

A lack of bed availability in the Forensic Hospital means that, as of February 2021, 63 forensic patients were being held in mental health facilities in mainstream prisons, when they should have been accommodated in the Forensic Hospital. Some of these forensic patients have been held in mainstream prison facilities for decades.

Cross‑agency co‑operation and planning is required to identify and build infrastructure that will reduce wait times for mental health beds. Over several years, Justice Health has developed, reviewed, and worked to progress a strategic plan for NSW Forensic Mental Health that includes enhanced mental health bed capacity across the NSW system. The latest version of this strategic plan remains in draft and has yet to be approved by the NSW Ministry of Health.

In 2016, Corrective Services NSW commenced a Prison Bed Capacity Program. It was focussed on enhancing capacity across the prison system and did not include specialist health beds. More recently, Corrective Services NSW has been developing a business case to improve the provision of specialist health care facilities across the network, including mental health facilities.

Justice Health's clinical information systems do not support the effective transfer of health appointments or medication records as patients are moved to new prison locations

Justice Health's clinical information systems are multiple and complex. There are five health information systems that include a mix of electronic and paper‑based records. Information management systems contain clinical records, appointment information, medication records, dental records, and specialist health information. Corrective Services NSW maintain separate information systems relating to prison records and psychology treatment information.

The transfer of people across different correctional centres is a frequent occurrence. In 2020, there were over 41,000 movements between correctional centres. People are transferred for a range of reasons including for security purposes, or to be located closer to hospitals or specialist health services.

Justice Health receives a list of patient transfers one day prior to transfer. Nurses are required to prepare medications and clinical handovers for patients with complex health conditions. These handovers are verbal, however short timeframes mean that handover is not always possible.

While each patient's electronic health records are available across the network, transfer of appointment waitlists must be done manually. There is no automatic alert within the information systems to tell staff that a patient has been moved to another prison. There is a risk that if appointment records are not manually updated, or if staff at destination clinics are not contacted, then appointments will be overlooked.

Justice Health is working with eHealth NSW to develop an improved Electronic Medication Management (EMM) program with expected delivery in late 2021. The EMM has potential to improve the transfer of patient medication records, but it will not fully remediate all inefficiencies of the current systems.

Corrective Services NSW and Justice Health do not engage in sufficient joint planning to improve efficiencies in transports or escorts to health services

Corrective Services NSW and Justice Health do not engage in joint system‑level planning to mitigate the risks and the costs associated with transferring patients to health clinics in prisons, or non‑prison‑based health care. There are no protocols, and limited sharing of information to improve efficiencies in planning and coordinating patient transfers.

Corrective Services NSW does not collate or report on the costs of transporting patients to hospitals and specialist care. While there is data on the overall cost of medical escorts, estimated to be $19.9 million in 2020, Corrective Services NSW is not able to disaggregate this data to determine the reasons for transfers or the system‑level costs. For example, Corrective Services NSW does not know how many prison lockdowns occur when hospital transfers are required.

Medical escorts to specialist health services and hospitals increase the costs to the prison system and contribute to risks in prison management. Medical escorts contributed to 16 per cent of metropolitan prison lockdowns at the peak in 2018, though escort numbers have since been declining. Some Local Health Districts report significant concerns around safety incidents and assaults on staff during medical escorts to hospital.

Corrective Services NSW does not know if transport costs have increased since the 2016 Prison Bed Capacity Program which expanded prison beds in regional New South Wales. To date, there has been no assessment of the cost of taking patients to tertiary hospitals or specialist services. Corrective Services NSW has identified this as an area for improvement.

Justice Health's system managers do not receive sufficiently detailed reports on wait times for health care, to understand strategic risks or opportunities for system improvement

Justice Health's senior executives receive monthly reports on patient wait times for services in prison health clinics. These reports contain headline data about the numbers of days that patients wait for scheduled health appointments by their allocated priority level. Wait time data are averaged across all New South Wales prison health clinics. With some exceptions, almost all executive level reports describe system‑wide appointment wait times without offering further specific detail. For example, there is limited information which would allow managers to understand the performance of specialty health groups, or to make any comparative analysis of the performance of different prison facilities.

Executive reports are also not detailed enough to indicate whether prisons with particular security classifications offer greater or lesser access to health services. It is not possible to assess whether patients in metropolitan or regional prisons have different levels of health service access. This prevents managers from identifying strategic risks across the prison network, targeting resources to the areas of greatest risk, and making strategic improvements in system performance.

Trend data on wait times for the different health specialty areas is also required to enable senior managers to compare wait times across prison facilities, security classifications, and localities.

In response to the preliminary findings of this audit, Justice Health has made some improvements to its executive‑level wait time reports. This includes additional detail on health appointment wait times by prison facilities and wait times by health specialty areas.

It is not possible to compare or benchmark the performance of public and private prison health operators or to compare prison health against community health standards

It is not possible to compare or benchmark the performance of the public and private prison health operators in New South Wales using the current Key Performance Indicator (KPI) data. KPI data do not correlate across the public and private systems.

Justice Health reports to the Ministry of Health on 44 prison health KPIs. The 44 KPIs for the public prison system do not align with the seven KPIs the private health operators report against in their contracts with Corrective Services NSW. This means that public and private operators focus on different service areas. For example, private operators have a performance measure for ensuring that custodial patients are provided with release plans. Justice Health does not have a similar measure.

The KPI specifications for the private prison health system were developed by Corrective Services NSW with input from the Ministry of Health. The KPI specifications for the public prison health system were developed by the Ministry of Health in collaboration with Justice Health. There is no rationale for the difference in performance indicators across the public and private systems.

Private providers currently deliver prison services to 25 per cent of the prison population of New South Wales. This proportion has been increasing since 2016. Public and private health operators deliver comparable health services so there is scope to compare performance across the systems.

Justice Health aligns its standard for prison health services with a 'community’ standard of health care access. However, with existing health monitoring measures, it is not possible to assess how well Justice Health is tracking against community health standards with available data from most health specialties.

There is an inherent conflict of interest in Justice Health's monitoring role of health services in private prisons, as Justice Health is also a provider of health services in a private prison

There is a legislated requirement for Justice Health to monitor the performance of private health operators in New South Wales prisons. This monitoring role is described in the Crimes (Administration of Sentences) Act 1999.

Justice Health's monitoring role includes the collection and analysis of health performance data from private health operators, and periodic site visits to assess health service performance. Justice Health reports the findings of monitoring activities to Corrective Services NSW, the contract manager for private prisons.

Justice Health's monitoring role commenced in the late 1990s. In recent years, this role has expanded as the NSW Government has increased the number of privately managed prisons across the state. Justice Health now monitors health services in four private prisons, accounting for approximately one quarter of all custodial patients in the New South Wales prison system.

In 2018, Justice Health was awarded a contract to provide health services at the John Morony Correctional Centre. Justice Health also monitors the health services this Correctional Centre. The timing of the 1999 legislation did not anticipate that Justice Health would be a provider of the services it is required to monitor.

Justice Health has taken steps to maintain independence and transparency in its monitoring role by establishing a number of arms‑length governance arrangements. Justice Health set up a Commissioning Unit that operates independently from its service delivery operations. Justice Health also established an alternative reporting chain via a Board subcommittee to oversee the performance of health providers in private prisons.

Despite all actions to establish independence, the monitoring role confers dual responsibilities on the Chief Executive of Justice Health as both an operational manager of health services in a private prison and as a manager responsible for monitoring these same services. As a result, the Chief Executive of Justice Health has access to information about the overall performance of the private prison health system in New South Wales.

As a competitor for the provision of health services in privately operated prisons, Justice Health has access to information to which other private health providers do not. This potentially gives Justice Health a competitive advantage over other private health operators.

2. Recommendations

By December 2022, Justice Health should:

1. enhance reporting on patient access to health services to ensure that system managers can identify risks, challenges, and system improvements across key areas of its service profile

2. in collaboration with the NSW Ministry of Health, identify and implement the required improvements to its health information management systems that will enable effective transfers of patient clinical records and appointment information across the custodial network and with external health providers.

By December 2022, Justice Health and Corrective Services NSW should:

3. develop a joint framework to govern and monitor the costs of their common and connected responsibilities for patient health movements across the prison network and to external health services

4. develop a joint framework to govern their common and connected responsibilities for mental health services.

By December 2022, Justice Health and Corrective Services NSW, in collaboration with the NSW Ministry of Health, should:

5. progress infrastructure plans and projects that address the lack of specialist accommodation for mental health patients and aged and frail patients

6. standardise and align the key performance indicators that monitor the performance of health operators in public and private prisons so that system‑wide benchmarking is possible.

By December 2022, the NSW Ministry of Health should:

7. take action to remediate the conflicting monitoring arrangements of public and private prison health operators.

Appendix one – Response from agencies

Appendix two – About the audit

Appendix three – Performance auditing

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #356 - released (23 September 2021).

Published

Actions for Managing climate risks to assets and services

Managing climate risks to assets and services

Planning
Environment
Treasury
Industry
Infrastructure
Management and administration
Risk
Service delivery

What the report is about

This report assessed how effectively the Department of Planning, Industry and Environment (DPIE) and NSW Treasury have supported state agencies to manage climate risks to their assets and services.

Climate risks that can impact on state agencies' assets and services include flooding, bushfires, and extreme temperatures. Impacts can include damage to transport, communications and energy infrastructure, increases in hospital admissions, and making social housing or school buildings unsuitable.

NSW Treasury estimates these risks could have significant costs.

What we found

DPIE and NSW Treasury’s support to agencies to manage climate risks to their assets and services has been insufficient.

In 2021, key agencies with critical assets and services have not conducted climate risk assessments, and most lack adaptation plans.

DPIE has not delivered on the NSW Government commitment to develop a state-wide climate change adaptation action plan. This was to be complete in 2017.

There is also no adaptation strategy for the state. These have been released in all other Australian jurisdictions. The NSW Government’s draft strategic plan for its Climate Change Fund was also never finalised.

DPIE’s approach to developing climate projections is robust, but it hasn’t effectively educated agencies in how to use this information to assess climate risk.

NSW Treasury did not consistently apply dedicated resourcing to support agencies' climate risk management until late 2019.

In March 2021, DPIE and NSW Treasury released the Climate Risk Ready NSW Guide and Course. These are designed to improve support to agencies.

What we recommended

DPIE and NSW Treasury should, in partnership:

  • enhance the coordination of climate risk management across agencies
  • implement climate risk management across their clusters.

DPIE should:

  • update information and strengthen education to agencies, and monitor progress
  • review relevant land-use planning, development and building guidance
  • deliver a climate change adaptation action plan for the state.

NSW Treasury should:

  • strengthen climate risk-related guidance to agencies
  • coordinate guidance on resilience in infrastructure planning
  • review how climate risks have been assured in agencies’ asset management plans.

Fast facts

4 years

between commitments in the NSW Climate Change Policy Framework, and DPIE and NSW Treasury producing key supports to agencies for climate risk management.

$120bn

Value of physical assets held by nine NSW Government entities we examined that have not completed climate risk assessments.

Low capability to do climate risk assessment has been found across state agencies. The total value of NSW Government physical assets is $365 billion, as at 30 June 2020.

x3

NSW Treasury’s estimates of the annual fiscal and economic costs associated with natural disasters will triple by 2060–61.

According to the Intergovernmental Panel on Climate Change in 2021, each of the last four decades has been successively warmer and surface temperatures will continue to increase until at least the mid-century. The Commonwealth Scientific and Industrial Research Organisation (CSIRO) and the Bureau of Meteorology (BoM) have reported that extreme weather across Australia is more frequent and intense, and there have been longer-term changes to weather patterns. They also report sea levels are rising around Australia increasing the risk of inundation and damage to coastal infrastructure and communities.

According to the Department of Planning, Industry and Environment (the department), in New South Wales the impacts of a changing climate, and the risks associated with it, will be felt differently across regions, populations and economic sectors. The department's climate projections indicate the number of hot days will increase, rainfall will vary across the state, and the number of severe fire days will increase.

The NSW Government is a provider of essential services, such as health care, education and public transport. It also owns and manages around $365 billion in physical assets (as at June 2020). More than $180 billion of its assets are in major infrastructure such as roads and railway lines.

In NSW, climate risks that could directly impact on state agencies' assets and services include flooding, bushfires, and extreme temperatures. In recent years, natural hazards exacerbated by climate change have damaged and disrupted government transport, communications and energy infrastructure. As climate risks eventuate, they can also increase hospital admissions when people are affected by poorer air quality, and make social housing dwellings or schools unsafe and unusable during heatwaves. The physical impacts of a changing climate also have significant financial costs. Taking into account projected economic growth, NSW Treasury has estimated that the fiscal and economic costs associated with natural disasters due to climate change will more than triple per year by 2061.

The department and NSW Treasury advise that leading practice in climate risk management includes a process that explicitly identifies climate risks and integrates these into existing risk management, monitoring and reporting systems. This is in line with international risk management and climate adaptation standards. For agencies to manage the physical risks of climate change to their assets and services, leading practice identified by the department means that they need to:

  • use robust climate projection information to understand the potential climate impacts
  • undertake sound climate risk assessments, within an enterprise risk management framework
  • implement adaptation plans that reduce these risks, and harness opportunities.

Adaptation responses that could be planned for include: controlling development in flood-prone locations; ensuring demand for health services can be met during heatwaves; improving thermal comfort in schools to support student engagement; proactive asset maintenance to reduce disruption of essential services, and safeguarding infrastructure from more frequent and intense natural disasters.

According to NSW Treasury policy, agencies are individually responsible for risk management systems appropriate to their context. The department and NSW Treasury have key roles in ensuring that agencies are supported with robust information and timely, relevant guidance to help manage risks to assets and services effectively, especially for emerging risks that require coordinated responses, such as those posed by climate change.

This audit assessed whether the department and NSW Treasury are effectively supporting NSW Government agencies to manage climate risks to their assets and services. It focused on the management of physical risks to assets and services associated with climate change.

Conclusion

The Department of Planning, Industry and Environment (the department) has made climate projections available to agencies since 2014, but provided limited guidance to assist agencies to identify and manage climate risks. NSW Treasury first noted climate change as a contextual factor in its 2012 guidance on risk management. NSW Treasury only clarified requirements for agencies to integrate climate considerations into their risk management processes in December 2020.
The department has not delivered on a NSW Government commitment for a state-wide climate change adaptation action plan, which was meant to be completed in 2017. Currently many state agencies that own or manage assets and provide services do not have climate risk management in place.
Since 2019, the department and NSW Treasury have worked in partnership to develop a coordinated approach to supporting agencies to manage these risks. This includes guidance to agencies on climate risk assessment and adaptation planning published in 2021.
More work is needed to embed, sustain and lead effective climate risk management across the NSW public sector, especially for the state's critical infrastructure and essential services that may be exposed to climate change impacts.

The NSW Government set directions in the 2016 NSW Climate Change Policy Framework to 'manage the impact of climate change on its assets and services by embedding climate change considerations into asset and risk management’ and more broadly into 'government decision-making'.

The department released climate projections and has made information on projected climate change impacts available since 2014, but this has not been effectively communicated to agencies. The absence of a state-wide climate change adaptation action plan has limited the department's implementation of a coordinated, well-communicated program of support to agencies for their climate risk management.

NSW Treasury is responsible for managing the state's finances and providing stewardship to the public sector on financial and risk management, but it did not consistently apply dedicated resourcing to support agencies' climate risk management until late 2019. NSW Treasury estimates the financial costs of climate-related physical risks are significant and will continue to grow.

The partnership between the department and NSW Treasury has produced the 2021 Climate Risk Ready NSW Guide and Course, which aim to help agencies understand their exposure to climate risks and develop adaptation responses. The Guide maps out a process for climate risk assessment and adaptation planning and is referenced in NSW Treasury policy on internal audit and risk management. It is also referenced in NSW Treasury guidance to agencies on how to reflect the effects of climate-related matters in financial statements.

There is more work to be done by the department on maintaining robust, accessible climate information and educating agencies in its use. NSW Treasury will need to continue to update its policies, guidance and economic analyses with relevant climate considerations to support an informed, coordinated approach to managing physical climate risks to agencies' assets and services, and to the state's finances more broadly.

The effectiveness of the department and NSW Treasury's support involves the proactive and sustained take-up of climate risk management by state agencies. There is a key role for the department and NSW Treasury in monitoring this progress and its results.

Prior to 2021, support provided by the Department of Planning, Industry and Environment (the department) to agencies for managing physical climate risks to their assets and services has been limited. NSW Treasury has a stewardship role in public sector performance, including risk management, but has not had a defined role in working with the department on climate risk matters until mid-2019. The low capacity of agencies to undertake this work has been known to NSW Government through agency surveys by the department in 2015 and by the department and NSW Treasury in 2018.

The support delivered to agencies around climate risk management, including risk assessment and adaptation planning, has been slow to start and of limited impact. The department's capacity to implement a coordinated approach to supporting agencies has also been limited by the absence of a state-wide adaptation strategy and related action plan.

In 2021, products were released by the department and NSW Treasury with potential to improve support to agencies on climate risk assessment and adaption planning (that this, Climate Risk Ready NSW Guide and Course, which provides links to key NSW Treasury polices). The department and NSW Treasury are now leading work to develop a more coordinated approach to climate risk management for agencies' assets and services, and building the resilience of the state to climate risk more broadly.

Climate projections are a key means of understanding the potential impacts of climate change, which is an important step in the climate risk assessment process. The Department of Planning, Industry and Environment (the department) used a robust approach to develop its climate projections (NARCliM). The full version of NARCliM (v1.0) is based on 2007 models11 and while still relevant, this has limited its perceived usefulness and uptake. The process of updating these projections requires significant resourcing. The department has made recent updates to enhance the currency and usefulness of its climate projections. NARCliM (v2.0) should be available in 2022.

While climate projections have been available to agencies and the community more broadly since 2013–14, the department has not been effective in educating the relevant data users within agencies in how to use the information for climate risk assessments and adaptation planning.

The absence of a strategy focused on this is significant and has contributed to the current low levels of climate risk assessment uptake across agencies (see section 2). Agencies are required to use the climate projections developed by the department when developing long term plans and strategies as part of the NSW Government Common Planning Assumptions.


11 The department advises the 2007 global climate models were released to users by the Intergovernmental Panel on Climate Change in 2010.
It is too soon to determine the impact of the 2021 Climate Risk Ready NSW (CRR) Guide and Course, produced by the Department of Planning, Industry and Environment (the department) and NSW Treasury. But there are opportunities for these agencies to progress these developments in partnership: especially with the establishment of senior executive steering and oversight committees related to climate risk.

For the department, key opportunities to embed climate risk management include leveraging land use planning policies and guidance to drive adaptation, which has potential to better protect the state's assets and services. NSW Treasury has a role in continuing to update its policies, guidance and economic analyses with relevant climate change considerations to support an informed, coordinated approach to addressing physical climate risks to agencies' assets and services, and to the state's finances more broadly.

There is currently no plan on how the department and NSW Treasury intend to routinely monitor the progress of agencies with implementing the CRR Guide or developing climate risk 'maturity' more broadly. As agencies are responsible for implementing risk management systems that meet NSW Treasury standards, which now clearly includes consideration of climate risk (TPP20-08), establishing effective monitoring, reporting and accountability around this progress should be a priority for the department and NSW Treasury.

Appendix one – Response from agencies

Appendix two – Timeline of key activities 

Appendix three – About the audit 

Appendix four – Performance auditing

 

Copyright notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary reference - Report number #355 - released (7 September 2021).