Appendix one - List of 2017 recommendations

Appendix two - Status of 2016 recommendations

Appendix three - Agencies selected for this volume

1. Financial reporting and controls

2. Service Delivery

1. Financial reporting and controls

2. Service Delivery

This report provides Parliament and other users of Transport cluster agencies' financial statements with audit results, observations, conclusions and recommendations in the following areas:

• Financial reporting and controls
• Service delivery.

Confidence in public sector decision-making and transparency is enhanced when financial reporting is accurate and timely. Appropriate financial controls help ensure the efficient and effective use of resources and administration of agency policies.

This chapter outlines our audit observations, conclusions or recommendations related to financial reporting and controls of Transport cluster agencies for 2016–17.

Achievement of government outcomes can be improved through effective delivery of the right mix of services, whether from the public, private or not‑for‑profit sectors. Service delivery reform will be most successful if there is clear accountability for service delivery outcomes, decisions are aligned to strategic direction and performance is monitored and evaluated.

This chapter outlines our audit observations, conclusions or recommendations related to service delivery in the Transport cluster agencies for 2016–17.

Appendix one - List of 2017 recommendations

Appendix two - Status of 2016 recommendations

Appendix three - Agencies selected for this volume

Appendix four - Financial audit reporting

Appendix five - Bus Contracts

Demand for ambulance services is increasing. Demographic factors including population growth and ageing have contributed to this and ongoing growth in demand is likely. It is important that NSW Ambulance finds ways to respond to this demand more efficiently, while maintaining patient safety standards and meeting community expectations.

Most triple zero calls to NSW Ambulance do not involve medical issues that require an emergency response. NSW Ambulance has introduced a range of initiatives to change the way it manages these less urgent requests for assistance. Its major demand management initiatives include using a telephone advice line, referring some patients to services other than hospital emergency departments and using specialist paramedics to respond to less urgent cases.

The role of NSW Ambulance has changed in recent years. It is aiming to become a ‘mobile health service’ that identifies the needs of patients and provides or refers them to the most appropriate type of care. This change involves a significant expansion of the clinical decision-making role of paramedics. Considerable strategic and organisational efforts are required to make this work. The successful implementation of demand management initiatives is important to NSW Ambulance's ability to continue to meet demand for its services.

This audit assessed NSW Ambulance's major demand management initiatives that aim to reduce unnecessary demand for ambulance responses and unnecessary transport to hospital emergency departments. It aimed to assess the extent to which these initiatives have improved the efficiency of its services.

Appendix one - Response from agency

Appendix two - About the audit

Appendix three - Performance auditing

Palliative care is an essential component of modern health care services and an increasingly important part of the wider health and social care systems. Palliative care is healthcare and support for people with a life-limiting illness, their families and carers. It is provided by, or informed by, professionals who specialise in palliative care. ‘End of life’ care is provided to people approaching the end of life by health professionals, who may work in the health, community or aged care systems. Not everyone receiving end of life care needs palliative care.

NSW Health has a policy and planning role in palliative and end-of-life care, and it coordinates a wide range of service providers. Local Health Districts (LHDs) provide care services in settings such as homes, hospitals and clinics to patients with varying needs. There are several care providers that can be involved.

Due to this shared nature of palliative care — where many people, services and settings are involved in delivering care to the patient — availability and communication of information is critical. For service planning, data and evidence must be drawn from various sources in a timely and efficient way.

This audit assessed whether NSW Health is effectively planning and evaluating palliative care services, in the context of rising demand, increasingly complex needs, and the diversity of service providers.

1. By July 2018, NSW Health should develop an integrated palliative and end-of-life care policy framework that:

• clearly articulates the interface between palliative and end of life care and outlines the priorities for the respective areas
• defines policy goals and objectives, and a performance and evaluation framework for palliative care service planning and delivery
• informs a related workforce plan which supports the policy framework and is linked to the Health Professional Workforce Plan 2012–2022
• reviews the funding allocation model to ensure future enhancement funds are distributed equitably and transparently based on the need and population of districts.

By December 2018, NSW Health should:

2. assess how the functionality provided in data collection programs such as the Palliative Care Outcomes Collaboration program can be provided across all palliative care services in NSW

3. complete its statewide review of systems and reporting for end of life management including specialist palliative care, and develop a business case to implement a more integrated set of solutions to:

• support providers delivering end of life and palliative care
• help monitor service quality and quantity
• provide comprehensive data for service planning

4. improve stakeholder engagement by:

• developing a statewide stakeholder engagement strategy that brings together current activity and good practice, and is transparent and publicly available
• defining accountability for overseeing and implementing the strategy at state and district levels.

1. Performance monitoring is inadequate

NSW Government policy on palliative care is outlined in the NSW Government Plan to Increase Access to Palliative Care 2012–2016 (the Plan). Under the Plan, the overarching policy is ‘to ensure that everyone has access to quality palliative care regardless of their economic or social circumstances, their geographical location or their medical condition.’ Some initiatives under the Plan are still being implemented.

NSW Health only has measures in place to assess some processes and activities for individual initiatives under the Plan. There is no tracking of outcomes relating to the policy goals set out in the Plan, such as increased choice to die at home or the location of the patient’s choice, and improved access to specialist palliative care services. NSW Health has not conducted an overall assessment of the Plan’s outcomes to guide future priorities.

Further, there is no overall performance and reporting framework for palliative and end of life care, meaning there is no monitoring of performance of palliative care services for NSW as a whole. This lack of evaluation and performance measurement impacts on NSW Health's ability to monitor progress and achievements, address gaps in service, and plan for future service enhancement. 

2. Statewide planning and evaluation lacks coordination

Currently, palliative care services are complex to plan and evaluate. Many policies, strategies, guidelines, directives and data collections currently inform services. Even definitions of services vary. The split of policy functions for palliative care and end-of-life care between different branches within NSW Health adds further complexity. These arrangements create the risk of confusion, gaps in advice and support for LHDs.

Consistency is needed in the use of terminology and planning to achieve an integrated approach at all levels, including:

• standard definitions of palliative care and end-of-life care
• planning within a single structured policy framework to help clarify what services are to be delivered, who is accountable for delivering them and how to measure their outcomes.

Workforce planning is also affected. While NSW Health has identified significant gaps in the specialist palliative care workforce (especially in regional and remote areas) and it previously made workforce capacity one of its priorities, limited work has been undertaken in producing a statewide strategy to reduce these gaps.

3. District planning is not systematic and some external providers are poorly managed

An integrated approach would inform district-level service planning for palliative care. Planning in the districts we visited was sometimes ad hoc and accountability for performance unclear. Districts would benefit from:

• better integrating data collection systems with planning
• clearer guidelines, easy-to-use tools, monitoring and accountability systems.

The recently developed guide – A Blueprint for Improvement, from the Agency for Clinical Innovation – should help districts plan more effectively and consistently as it rolls out more widely in 2017. This takes an integrated approach to palliative and end-of-life care. Only one district we visited has finalised a comprehensive plan using the Blueprint.

Issues with district planning extend to external agreements with service providers, as these are sometimes poorly managed and do not support improved patient outcomes. Examples we reviewed showed a significant reporting burden with process-focused reporting. We also found little evidence of monitoring or action as a result of these reports.

4. Diverse information systems mean data collection and use are inconsistent

NSW Health gathers a broad range of data from many collection points and systems to inform palliative care services at hospital, ward or unit level, and community teams. However, the current data is limited because: 

• activity is under-reported, particularly in community-based services
• collection is not universal across districts and services.

Districts also struggle with evidence-based planning and service delivery because multiple information systems mean data may be incomplete or inaccurate. Too often, clinicians and service managers rely on manual collection and paper-based systems. 

eHealth, which coordinates information communication technology (ICT) for the state’s healthcare, is planning a statewide approach to capture information and report on all palliative care activity. The current plans of eHealth to review and improve systems should make data more complete, robust and accessible for quality improvement and planning.

5. An overarching stakeholder strategy would strengthen engagement

Just as data is central to effective planning and evaluation, so too is stakeholder engagement. However, there is currently no explicit stakeholder strategy, which means consultation is inconsistent across the state and not systematic at a district level.

While NSW Health uses a range of platforms to consult, the purpose and value is often not clear to stakeholders. Individual districts have some good practices, but there are limited mechanisms to identify and share these with other areas. A state-wide strategy would improve the quality and consistency of engagement, which will in turn inform service planning and delivery.

A stakeholder engagement strategy would integrate current initiatives, such as the two major networks that consult with health planning staff and clinicians. But it will also need to extend the feedback gathered from families, carers and volunteers, and from the peak bodies that represent them. 

Appendix one - Response from the Agency

Appendix two -  National and NSW data on palliative care activity and outcomes

Appendix three -  About the audit

RMS’ SMC contract management includes most elements of good practice, including governance and dispute resolution mechanisms. However, key elements are missing which reduces its effectiveness.

Roads and Maritime Services (RMS) is responsible for the Sydney region State roads network This includes over 2,800 kilometres of roads and associated road corridor infrastructure such as bridges, tunnels and drainage structures. RMS divides the network into three geographical areas: south, west and north zones.

In 1995, RMS first outsourced road corridor infrastructure maintenance for the north zone through a Performance Specified Maintenance Contract (PSMC). The current 10-year PSMC for the north zone will expire in October 2018. Prior to November 2013, RMS maintained roads in the south and west zones through its Road and Fleet Services unit. 

In November 2013, RMS outsourced road maintenance services for the south and west zones using Stewardship Maintenance Contracts (SMC). The contracts run for seven years with an option for a further three years at RMS’ discretion. RMS estimated that the annual cost of these contracts was around $240 million in total. In March 2018, the contract prices are due to be reset by negotiation to reflect the contractors’ experience with, and better information about, the road networks and routine maintenance requirements. 

The SMC model adopted stewardship principles to improve value for money. RMS defined stewardship principles as a broad set of values, attitudes and behaviours, required of the contractor to effectively manage the assets on behalf of RMS. The SMC also includes commercial principles, such as linking risk to reward, and a performance framework where outcomes drive performance.

This audit assessed whether RMS had effectively managed the outsourcing of road maintenance in the Sydney region south and west zones. In making this assessment, we answered the following questions:

1. Did RMS justify the decision to adopt the SMC model?
2. Do SMCs include key performance indicators (KPIs) and incentives which promote efficiency and effectiveness? 
3. Does RMS collect high quality information on contractor performance and take action to correct performance deficiencies?
4. Are the expected benefits being achieved?

The Stewardship Maintenance Contract

RMS justified adopting the SMC model and included KPIs to drive efficiency and effectiveness

The SMC model includes features that RMS had not previously used for road maintenance contracts. These included adopting stewardship principles and transferring price risk to the contractor over time as the contractor becomes familiar with the assets being maintained.

The SMC model meets RMS’ requirements for flexibility in pricing models, the need for collaboration in asset maintenance planning, promoting innovation and effective performance management.

RMS used many good practices to develop the SMC model, including:

• preparing a robust business case comparing the SMC model to RMS maintaining the road network itself, as well as assessing whether two other contracting models
  (traditional and alliance) would meet its requirements
• assessing experiences with similar arrangements in other jurisdictions and identifying elements that worked to get the best outcomes
• developing a robust performance framework, which included a mix of efficiency and effectiveness KPIs that reflected NSW Government policy and RMS priorities
• incorporating risk and reward incentives delivered through cost sharing arrangements which change as the contract matures
• using a contract duration that supports RMS priorities and provides an incentive for better quality outcomes.

RMS uses data provided by the contractor to measure performance and calculate payments to the contractor. The SMC includes a specific sanction if RMS finds that the contractor provided incorrect performance data, but no specific sanction if the contractor provides incorrect financial data. If RMS finds that the contactor provided incorrect performance or financial data, RMS can only recover over-payments which may have been made using the incorrect data.  

To provide a stronger incentive for the contractor to ensure data it provides is accurate, RMS should consider whether to incorporate stronger sanctions when negotiating the commercial reset due in mid-2018 for south and west zones. RMS should also consider this for the new contract for the north zone when the current PSMC contract expires in October 2018.

RMS' contract management approach and benefits realization

RMS can improve the effectiveness of its oversight and management of the SMC

RMS does not have SMC specific contract procedures to guide its contract managers. Consequently, RMS has not exercised several significant SMC requirements, such as having the contractors account for an efficiency dividend in their pricing at the start of each three-year works period. Effective contract management should be supported by contract specific procedures, with explanations of, and allocation of responsibility for, the various interventions that RMS may be required to exercise in the SMC.

Performance and financial reporting under the SMC is based on a mix of RMS and contractor provided data. While there are a range of audits of contractor provided performance and financial data that RMS can conduct each year under the SMC, it does not have a schedule of audits it will conduct and when.  
During the first year of the SMC, RMS commissioned some limited audits of financial data. In the first three years of the SMC, RMS did not conduct any audits of performance data. Had there been SMC specific procedures in place, this would have reduced the risk of RMS not implementing a systematic audit program to give it reasonable assurance on the quality of the data that the contractor has provided. This is important because the data is used to measure performance and calculate contractor payments.

RMS has been aware of data quality issues since 2015. While RMS advised that it commenced addressing some data quality issues in response to a series of reviews conducted in 2015, a recent internal audit report indicates that RMS has not resolved the data quality issues.  

RMS achieved benefits in the first year, but has not tracked benefits since

As part of the business case, RMS agreed to implement a benefits realisation strategy, including a benefits tracking tool. RMS commenced tracking benefits, but did not establish a comparative baseline pre-SMC on non-financial benefits, and has not tracked benefits past year one.

In 2015, a benchmarking study commissioned by RMS found that it had achieved 80 per cent of the expected recurrent cost savings and other benefits, such as improved workplace safety, in the first full year of the SMC. However, there was no clear baseline to measure
non-financial performance. The study was qualified due to gaps in available data. The study also did not reconcile the actual one-off transition costs to the business case estimate.

During the course of the audit, RMS advised that it intends to repeat this type of study to determine whether it has achieved all expected benefits (and their value), and that it would use the results to inform its negotiation with the SMC contractors as part of the commercial reset due in mid-2018.

Roads and Maritime Services is responsible for the State Roads network in the Sydney region

Roads and Maritime Services (RMS) is responsible for the Sydney region State roads network. This includes over 2,800 kilometres of roads and associated road corridor infrastructure such as bridges, tunnels and drainage structures. The network is divided into three geographical areas: south, west and north zones. Prior to November 2013, RMS maintained roads in the Sydney region south and west zones through its Road and Fleet Services unit.  

In 1995, RMS first outsourced road corridor infrastructure maintenance for the north zone through a Performance Specified Maintenance Contract (PSMC). The current 10-year PSMC for the north zone will expire in October 2018. This contract is worth around $35 million per annum.  

NSW Government priorities and road maintenance

Efficient and effective road maintenance contributes to the following NSW Government priorities:

• improving road travel reliability
• ensuring on-time running of public transport
• reducing road fatalities
• improving government services
• keeping our environment clean.

The NSW Commission of Audit recommended outsourcing the maintenance of State roads

The NSW Commission of Audit in its Final Report on Government Expenditure (May 2012) recommended contestability as an appropriate strategy to consider for improving road maintenance service delivery for State roads.  

The Commission benchmarked RMS’ road surface quality and cost per lane kilometre against those of Western Australia, Victoria, and Queensland. This showed that New South Wales lagged the other states on both these measures.  

The Commission noted that RMS had conducted two independent reviews to examine the potential for extending road maintenance contestability. The Commission found that there was inadequate and inconclusive benchmarking to establish the efficiency of RMS’ Road and Fleet Services unit when compared to outsourcing. It recommended that RMS bring forward a proposal to conduct a competitive tender for the road maintenance of the Sydney region south zone road network to inform the feasibility of a progressive rollout of road maintenance contestability across other areas of the State. In August 2012, the NSW Government adopted the Commission’s recommendation.

The NSW Government introduced road maintenance contestability through Stewardship Maintenance Contracts

In April 2013, the NSW Government announced that it would introduce road maintenance contestability across the Sydney region, using a Stewardship Maintenance Contract (SMC) model to improve value for money. In doing so, it excluded RMS’ Road and Fleet Services unit from tendering.  

The SMC model is based on the following key commercial and performance principles set by RMS:

• performance driven by outcomes
• flexible and adaptable
• transparent and measurable
• linking risk to reward
• continuous improvement
• criteria for selection of, and transition to, different payment models.

The following key stewardship principles underpin the SMC’s broad set of values, attitudes and behaviours, which are required of the contractor to effectively manage the assets on behalf of RMS:

• putting RMS’ customers (road users and the general public) first and being responsive to them
• being responsible and accountable for the outcomes resulting from the management of the assets
• managing the assets diligently, efficiently and effectively with limited direction from RMS
• working collaboratively with RMS to deliver services that are tailored to meet RMS’ evolving needs
• acting with integrity and transparency in performing the services
• performing the services in the best interests of RMS and asset users.

Other key features of the SMC include:

• service requirements which describe the scope of the services, and the standards the contractor must meet
• a commercial framework which defines how payments are structured, how performance assessment will impact on payments and outlines the key commercial principles. SMCs primarily divide payments into two main mechanisms, these being the priced component (or fixed price) and the target cost calculated as follows:
  • fixed price – the contractor is paid a pre-agreed amount for specific services being provided, regardless of the actual costs incurred
  • target cost – RMS and the contractor agree on a target cost for a project, and any cost overruns or underruns are shared between them
• a performance framework which provides mechanisms for assessing contractor performance. This includes a comprehensive listing of the key result areas (KRAs) and key performance indicators (KPIs) against which RMS measures the contractor’s performance. The framework also outlines the scoring methodology that RMS uses to determine whether the contractor’s bid margin (profit and overheads) is reduced due to less than satisfactory performance or whether a bonus is paid if a threshold performance score is exceeded.

Road maintenance under SMCs for Sydney region south and west zones commenced in November 2013

In November 2013, RMS awarded SMCs to the Leighton Boral Amey consortium, now named Ventia Boral Amey (VBA), for the south zone and the DownerMouchel (DM) consortium for the west zone. The contracts run for seven years with an option for a further three years at RMS’ discretion. In April 2014, full services commenced following a four-month transition period. RMS estimated that the annual cost of these contracts was around $240 million in total. In March 2018, the contract prices are due to be reset by negotiation to reflect the contractors’ experience with, and better information about, the road networks and routine maintenance requirements. 

1. Roads and Maritime Services should consider whether to incorporate stronger sanctions in the Stewardship Maintenance Contract if the contractor provides incorrect performance or financial data to RMS, when:
    
   1. negotiating the commercial reset for the next works period with the Sydney region south and west zone contractors due in July 2018.
   2. finalising a new SMC contract for the Sydney region north zone, due to commence in October 2018.

Roads and Maritime Services should, by September 2017:

2.  Review its contract management framework for SMCs to ensure that all authorities and accountabilities of
     contract managers are clearly defined, including:

a) accountability and procedures for exercising all operational clauses in the SMC where RMS may opt to, or be required to intervene, or make a decision

b) authority to approve or initiate the interventions RMS is required to, or may, exercise under the SMC

c) the audits that RMS will conduct to systematically validate the performance and financial data that the SMC contractors provide

d) the accountabilities of RMS contract managers to systematically review audits and quality reviews that the SMC contractors must conduct to demonstrate compliance with their service plans

e) the accountabilities of RMS contract managers to check that the monthly and annual reports provided by SMC contractors do not contain errors, omissions or inaccuracies.

3.  Improve its management of benefits realisation by:

a) initiating a further benefits realisation review and record the benefits delivered against those
    estimated following the tender process, including the one-off transition costs

b) identify any benefits, including savings, not yet attained and develop strategies to address any short-falls

c) establish a tool to track the ongoing realisation of benefits.

Appendix One - Response from Roads and Maritime Services

Appendix Two - Better practice contract management framework

Appendix Three - About the audit

The total value of security deposits held has increased from $500 million in 2005 to around $2.2 billion in 2016, covering around 450 mine sites in New South Wales.

While there have been substantial increases in total deposits held, mine rehabilitation security deposits are still not likely to be sufficient to cover the full costs of each mine's rehabilitation in the event of a default.

This audit was undertaken when the Department of Industry, Skills and Regional Development was responsible for ensuring land disturbed by mining activities is rehabilitated in accordance with the relevant development approval, including the administration of mining rehabilitation security deposits. On 1 April 2017, this responsibility was transferred to the Department of Planning and Environment (the Department).  

This audit assessed whether the Department maintains adequate security deposits to cover the liabilities associated with mine closures, including rehabilitation. Companies authorised by the Department to undertake mining activities must provide a security deposit to cover the full costs of rehabilitation in the event of default by the company. Rehabilitation is the treatment of disturbed land or water to establish a safe, stable, non-polluting and sustainable environment.

Mining companies must provide an estimate of rehabilitation costs for each site. The Department provides a Rehabilitation Cost Calculation tool to assist companies calculate the deposit amount. Companies are also required to ensure that the cost estimate is in accordance with the approved Mining Operations Plan (MOP). The MOP is intended to be a mine rehabilitation and closure plan, and forms the basis for the estimation of the security deposit. The Department reviews the estimates and determines the deposit for each site.  

Security deposits are an option of last resort. The Department has other legislative and regulatory tools which it normally uses to promote compliance with rehabilitation requirements before accessing a security deposit. It can direct action by the mining company, issue fines and even have the Minister revoke a mining lease. To date, the Department has never had to access a security deposit for a state significant development mine site.

Security deposits are close to calculated value and should be accessible if needed

The value of securities held by the Department aligns with the latest approved rehabilitation cost estimates. This contrasts with the situation found by investigations in Victoria and Queensland, where deposit amounts held fell below the calculated costs.

The security deposits are usually in the form of a bank guarantee or cash. The Department has obtained legal advice indicating that it should be able to claim on these bank guarantees if the need arises. As the guarantee is between the financial institution and the Department, if a mining company goes into liquidation the Department should still be able to access the funds.  

When the latest estimate of rehabilitation costs is higher than the existing deposit, the Department will request additional security. It has experienced extensive delays in obtaining additional security for some sites, increasing the risk that available funds will be insufficient if needed.

Rehabilitation cost estimates are not yet adequate, but improvements are planned

The Department’s policy is for security deposits to cover the full cost of rehabilitation. No discounts are provided to mining companies for past good behaviour or low likelihood of default, unlike in some other states. Discounting could undermine the policy position.  

Current security deposits are unlikely to cover the full cost of rehabilitation on each mine site. The Department provides a rehabilitation cost calculation tool to help mining companies calculate the cost of rehabilitation and the required deposit amount, but:

• several activities required to effect closure are not included and others underestimated
• it does not make provision for industry cost changes over time
• the rates used in the tool have not been updated since 2013
• it was not able to provide the basis for the rates and allowances in the tool.

The Department reviews cost estimates provided by mining companies, but its verification of the extent of rehabilitation work on which these estimates are based is limited. It relies instead on section 387C of the Mining Act 1992 which makes it an offence for mining companies to provide false or misleading information. It is not evident how the Department would establish that information provided was false or misleading without more verification work, and six of the 14 cost estimates we reviewed were not signed by the mine manager, making enforcement more difficult.  

The Department has developed a new calculation tool, and recently released it for industry consultation. The new tool should improve rehabilitation estimates. It updates rates and allowances, and includes additional items to better cover required rehabilitation tasks. While a substantial improvement, the new tool could be further improved by providing additional coverage for stakeholder engagement, additional planning approvals, insurance costs, and any additional design, research and verification work required for successful closure.

There is no financial assurance over long-term environmental risks

The Department does not hold any financial assurance to cover the costs associated with mitigating any future environmental degradation once a mine closes and the security deposit is relinquished to the mining company. Security deposits are probably not the appropriate mechanism to cover these long-term risks but the risk of potential post-closure environmental degradation still needs to be costed and covered. A fund to cover the state-wide risk, to which all mines would contribute, is a possible mechanism.

Rehabilitation and closure outcomes are vague, particularly for unplanned closure

Rehabilitation outcomes in the MOPs we reviewed were generally not specific. Any lack of specificity in MOPs translates into uncertainty about rehabilitation work required if a mining company defaults. Part of the problem is that rehabilitation outcomes established in planning approvals are usually not specific and may not address all closure requirements. The Department has recognised there is scope to improve the clarity and specificity of rehabilitation requirements in planning approvals, and has started a review focusing on open-cut mines.

Rehabilitation outcomes are even less specific in the event of an unexpected early closure because they will probably be different from that achievable from a planned closure.  

MOP guidelines do not cover management of some key closure matters, such as the requirements of environment protection licences issued by the Environment Protection Authority and the management of heritage sites during closure.

There were significant variations in quality of MOPs we reviewed and the way closure risks and uncertainties were identified and addressed. The Department plans to improve the quality of rehabilitation programs through enhanced guidance and oversight.

Monitoring is not adequate to effectively gauge rehabilitation progress

The Department was not able to show it has been monitoring operational mine sites effectively to gauge the progress of ongoing site rehabilitation and the management of closure risks. There was no protocol for site inspections and limited evidence of inspections for the sites we reviewed.

The Department receives annual environmental management reports from mining companies, with most describing the areas of disturbance and rehabilitation occurring at each mine site. The Department recently established procedures for reviewing these annual reports, and has developed a risk-based process for prioritising reviews.

Most annual reports we reviewed did not explain environmental changes over time, nor the risks to mine closure and the measures required to mitigate them. For example, analysis of changes to surface water and groundwater quality was limited despite its relevance for assessing future contamination risks.

The Department does not currently have adequate processes in place to effectively verify the reported areas of disturbance and rehabilitation. It is developing geographic information system-based tools to better measure areas of disturbance and rehabilitation, new rehabilitation guidelines, and a procedure for determining whether rehabilitation has been successful. These initiatives should improve the monitoring and reporting of rehabilitation progress at mine sites.

There is no mechanism to prevent a mine being in ‘care and maintenance’ indefinitely

The Department does not have a clear policy on the length of time and circumstances under which a mine can remain in ‘care and maintenance’. Indefinite postponement of rehabilitation and closure is therefore possible. 'Care and maintenance' is the period following temporary cessation of operations when infrastructure remains largely intact and the site continues to be managed. There are a range of valid reasons for a mining company to put a mine in ‘care and maintenance’, but it is also reasonable for the community to expect a limit to how long it has to wait for proper rehabilitation.

Mining operations make a significant contribution to the NSW economy, including over $1.3 billion in royalties each year. Around 400 mine sites throughout NSW provide over 40,000 jobs and are a major source of economic activity for many communities. Despite these benefits, it is important to ensure that mining companies fulfil their obligations to rehabilitate land disturbed as a result of mining activity.

We recommend that the Department should, by January 2018:

1. Improve the quality of rehabilitation and closure plans by:

• ensuring plans submitted by mining companies include robust mine rehabilitation and closure risk assessments
• clarifying the level of detail required in plans at each stage of a mine’s operation
• specifying how requirements set under other legislative instruments (e.g. environment protection licences, heritage assets) should be addressed.

2. Improve assurance that security deposits are sufficient by:

• ensuring its new cost calculation tool adequately covers all works needed for rehabilitation and closure
• increasing the contingency for uncertainties associated with mine rehabilitation and closure, at least until the mining company provides a detailed closure plan
• verifying the cost estimates for a sample of high risk sites annually
• ensuring that when mining companies are required to provide increased security deposits, they do so with minimal delay.

3. Enhance oversight of mine rehabilitation by:

• developing a protocol to ensure sufficient and adequate site inspections
• ensuring mining companies report performance against rehabilitation targets and environmental changes clearly, including an analysis of long-term surface water and groundwater trends in terms of levels, flow and quality
• improving how it determines the progress and success of mine rehabilitation
• developing clear policy and procedures for ensuring a mine cannot be put into ‘care and maintenance’ indefinitely.

4. Collaborate with relevant agencies to establish a financial assurance mechanism, such as a sinking fund, to cover the risk of long-term environmental degradation after mines are closed and security deposits returned.

Appendix One - Response from the Department

Appendix Two - About the audit

This report found that in 2015−16, 75 per cent of prisoners who needed a prison-based therapeutic program did not receive one before the earliest date they could be released. Timely access to prison-based therapeutic programs can be a factor in parole refusal and can potentially exacerbate overcrowding in the prison system. The audit looked at a selection of moderate and high intensity programs that aim to reduce reoffending by addressing addiction, violence, domestic abuse, sex offending and general offending.

When a prisoner enters custody in New South Wales, there is an expectation that they will be offered therapeutic programs that reduce their risk of reoffending. Relative to the costs of providing them, these programs have wide-ranging benefits for prisoners and the broader community, and provide significant savings to the justice system. Corrective Services NSW has lead responsibility for ensuring relevant and effective programs are provided, and for the Premier’s Priority of reducing reoffending by five per cent by 2019.

In New South Wales, a significant majority of people convicted of an offence will eventually be reconvicted. Of those convicted of an offence in 2004, 79 per cent had been reconvicted of another offence by 2014 – half within the first year of their initial offence. The total cost to the community of reoffending is difficult to fully quantify. However, the potential to reduce costs to the prisons system alone by reducing reoffending is significant given the average costs of a prison stay is $167 per prisoner per day over an average 218 day sentence. Total prison system costs in New South Wales were $720 million in 2016.  

To help achieve its mandate to reduce reoffending, Corrective Services NSW delivers therapeutic programs in prison and the community, along with a range of vocational, education, supervision, case management and health and wellbeing general services. These programs and services contribute to the central goal of reducing the likelihood that prisoners will return to prison. This audit assessed whether selected therapeutic programs are available, accessible and effective in reducing the risk of reoffending. More detailed information on the programs selected is in Appendix 3.

75 per cent of prisoners who needed programs did not complete them before the earliest date they could have been released for parole 

In 2015–16, 75 per cent of prisoners with an identified program need did not complete a program prior to the earliest date they could have been paroled. If prisoners do not complete programs before their earliest parole date, they can be released having had no, or incomplete, interventions while in prison to address their offending. They can also be refused parole by the State Parole Authority, adding unnecessary length to the time spent in jail and exacerbating overcrowding. Parole refusal data from the State Parole Authority indicates that non-completion of programs was a factor in 84 per cent of 302 parole refusals in 2015. 

Program resourcing at the prison level is inadequate to meet increased demand

Lack of availability of programs to meet demand is a key factor preventing prisoners from completing programs in time for release. The 20 per cent increase in the prison population between 2011–12 and 2015–16 has placed a significant strain on resources. While more programs are being delivered, the overall proportion of prisoners receiving them before release has not. Prisoner case management is not performed in a timely and consistent way, resulting in prisoners missing opportunities to be referred to programs, particularly if they have shorter sentences. For example, 27 per cent of prisoners with more than six months to serve had not completed an assessment required to determine eligibility for an EQUIPS program in the past four years.

The mix of available programs may be out of step with the needs of some prisoners

Since 2012, Corrective Services NSW has increased the number of moderate-intensity EQUIPS domestic violence and aggression programs provided and more prisoners overall are now able to participate in programs. Over the same period, the number of intensive programs delivered for sex offenders has decreased and the number of intensive programs for serious violent offenders has remained the same. This is despite increasing proportions of prisoners sentenced for sexual assault and related offences, and serious violent offences.

Corrective Services NSW uses a risk-assessment model to determine which prisoners are eligible for existing programs, but does not regularly review whether there are gaps or insufficient program coverage of some therapeutic needs.

Corrective Services NSW does not collect robust and comparable information on program quality and outcomes 

Program performance reporting at the prison level focuses on program throughput, such as the number of programs delivered and the number of prisoners participating. Corrective Services NSW does not routinely collect information on program implementation that would provide insights at the prison level into whether programs are being run effectively, and are achieving their intended goals.

Corrective Services NSW has not systematically evaluated its therapeutic programs to confirm they are effective in reducing reoffending

Programs being delivered in New South Wales prisons are based on international evidence about the success of the specific methods and approaches used. This is a good foundation, but Corrective Services NSW is unable to show that its programs are effective in the New South Wales context, and that they are having an impact in achieving the Premier’s target of reducing reoffending by five per cent. Evaluations of some programs have been conducted, but these were mostly inconclusive because of challenges with data collection, such as developing significant enough sample sizes. A lack of consistent forward planning has also affected the rigour of some evaluations.  

With the roll out of an additional $237 million investment in reducing reoffending, Corrective Services NSW proposes to focus efforts on evaluating the effectiveness of its programs by engaging external experts and increasing resourcing in its own evaluation unit. A systematic forward program for independent evaluation, which identifies solutions to existing data gaps and builds on past studies, is needed to support this.  

Challenges for Corrective Services NSW

Corrective Services NSW, a division of the Department of Justice, operates 34 custodial correctional centres across New South Wales, including two that are managed by private companies. It is responsible for delivering correctional services and programs that reduce reoffending and enhance community safety. Corrective Services NSW has lead responsibility for the Premier’s Priority of reducing adult reoffending by five per cent by 2019. To assist in achieving this target, Corrective Services NSW delivers therapeutic programs in prisons that aim to reduce the likelihood that prisoners will reoffend once released.  

Prison overcrowding

Prior to 2011, the prison population had been decreasing, which resulted in the closure of Berrima, Parramatta and Kirkconnell Correctional Centres, the downsizing of Grafton Correctional Centre, and a reduction in total capacity of 900 beds. However, since 2011–12 the prison population has increased by approximately 30 per cent, reaching a record of around 12,900 prisoners in March 2017 (latest available data).  

Corrective Services NSW should by December 2017:

1.  Implement a systematic approach to the use of convictions, sentencing and case management data to ensure that gaps in program offerings can be identified and addressed.

By June 2018:

2.  Clearly establish program delivery staff resourcing benchmarks, based on individual prison profiles, that would meet demand and ensure prisoners receive timely assessments, comprehensive case management and relevant programs before the earliest date they can be released.

3.  Establish consistent program quality and outcomes performance indicators at the prison-level, and monitor and respond to these quarterly.

4.  Develop and implement a detailed forward program of independent evaluations for all prison-based therapeutic programs, that includes identified data requirements for prisons to collect and provide.

Appendix One - Response from Department of Justice

Appendix Two - Response from the Audit Office

Appendix Three - About the audit