Refine search Expand filter

Reports

Published

Actions for Supporting the District Criminal Court

Supporting the District Criminal Court

Justice
Community Services
Information technology
Internal controls and governance
Project management

The Auditor-General for New South Wales, Margaret Crawford, released a report today on whether the Department of Communities and Justice (the department) effectively supports the efficient operation of the District Criminal Court system.

The audit found that in the provision of data and technology services, the department is not effectively supporting the efficient operation of the District Criminal Court system. The department has insufficient controls in place to ensure that data in the system is always accurate.

The department is also using outdated technology and could improve its delivery of technical support to courts.

The audit also assessed the implementation of the Early Appropriate Guilty Pleas reform. This reform aims to improve court efficiency by having more cases resolved earlier with a guilty plea in the Local Court. The audit found that the department effectively governed the implementation of the reform but is not measuring achievement of expected benefits, placing the objectives of the reform at risk.

The Auditor-General made seven recommendations to the department, aimed at improving the controls around courts data, reporting on key performance indicators, improving regional technical support and measuring the success of the Early Appropriate Guilty Pleas reform. 

The District Court is the intermediate court in the New South Wales court system. It hears most serious criminal matters, except murder, treason and piracy. The Department of Communities and Justice (the Department) provides support to the District Court in a variety of ways. For example, it provides security services, library services and front-desk services. This audit examined three forms of support that the Department provides to the District Court:

  • data collection, reporting and analysis - the Department collects data from cases in its case management system, JusticeLink, based on the orders Judges make in court and court papers
  • technology - the Department provides technology to courts across New South Wales, as well as technical support for this technology
  • policy - the Department is responsible for proposing and implementing policy reforms.

Recent years have seen a worsening of District Court efficiency, as measured in the Productivity Commission's Report on Government Services (RoGS). Efficiency in the court system is typically measured through timeliness of case completion. There is evidence that timeliness has worsened. For example, the median time from arrest to finalisation of a case in the District Court increased from 420 days in 2012–13 to 541 days in 2017–18.

As a result, the government has announced a range of measures to improve court performance, particularly in the District Court. These measures included the Early Appropriate Guilty Pleas (EAGP) reform. One of the objectives of EAGP is to improve court efficiency, which would be achieved by having more cases resolve with a guilty plea in the Local Court.

This audit assessed whether the Department of Communities and Justice effectively supports the efficient operation of the District Criminal Court system. We assessed this with the following lines of inquiry:

  • Does the Department effectively collect, analyse and report performance information relevant to court efficiency?
  • Does the Department effectively provide technology to support the efficient working of the courts?
  • Does the Department have effective plans, governance and monitoring for the Early Appropriate Guilty Pleas reform?

The audit did not consider other support functions provided by the Department. Further information on the audit, including detailed audit criteria, may be found in Appendix two.

Conclusion
In the provision of data and technology services, the Department is not effectively supporting the efficient operation of the District Criminal Court system. The Department has insufficient controls in place to ensure accurate data in the District Criminal Court system. The Department is also using outdated technology in significant numbers and could improve its delivery of technical support to meet agreed targets.
The Department effectively governed the implementation of the Early Appropriate Guilty Pleas reform. However, it is not ensuring that the benefits stated in the business case are being achieved, placing its objectives at risk.
The impact of inaccurate court data can be severe, and the Department does not have sufficient controls in place to ensure that its court data is accurate. Recent Bureau of Crime Statistics and Research reviews have identified data inaccuracies, and this demonstrates the Department needs strong controls in place to ensure that its court data is accurate.
The Department does not have a policy for data quality and has not formally assigned responsibility for data quality to any individual or branch. The Department also does not have a data dictionary outlining all the fields in its case management system. While the Department validates the highest risk items, such as warrants, to ensure that they are accurate, most data is not validated. The Department has recently commenced setting up a data unit for the Courts, Tribunals and Service Delivery branch. It is proposed that this unit will address most of the identified shortcomings.
The Department did not provide timely technical support to the court system in 2017 and is using outdated technology in significant numbers. The Digital and Technology Services branch of the Department had agreed a Service Level Agreement with the rest of the Department, outlining the expected speed of technical support responses. The branch did not meet response times in 2017. Performance improved in 2018, though DTS fell short of its targets for critical and moderate priority incidents. Critical incidents are particularly important to deal with in a timely manner as they include incidents which may delay a court sitting.
Requests for technical support rose significantly in 2018 compared to 2017, which may be related to the number of outdated pieces of technology. As at April 2019, the whole court system had 2,389 laptops or desktop computers outside their warranty period. The Department was also using other outdated technology. Outdated technology is more prone to failure and continuing to use it poses a risk of court delays.
The Department is not measuring all the expected benefits from the Early Appropriate Guilty Pleas reform, placing the objectives of the program at risk. The Early Appropriate Guilty Pleas business case outlined nine expected benefits from the reform. The Department is not measuring one of these benefits and is not measuring the economic benefits of a further five business case benefits. Not measuring the impact of the reform means that the Department does not know if it is achieving its objectives and if the reform had the desired impact.

The Department is responsible for providing technology to the courts, which can improve the efficiency of court operations by making them faster and cheaper. The Department is also responsible for providing technical support to courtrooms and registries. It is important that technical support is provided in a timely manner because some technical incidents can delay court sittings and thus impact on court efficiency. A 2013 Organisation for Economic Co‑operation and Development report emphasised the importance of technology and digitisation for reducing trial length.

While the Department may provide technology to the courts, they are not responsible for deciding when, how or if the technology is used in the courtroom.

The Department is using a significant amount of outdated technology, risking court delays

As of April 2019, the whole court system had 2,389 laptops or desktop computers out of warranty, 56.0 per cent of the court system's fleet. The court system also had 786 printing devices out of their normal warranty period, 75.1 per cent of all printers in use. The Department also advised that many of its court audio transcription machines are out of date. These machines must be running for the court to sit and thus it is critical that they are maintained to a high degree. The then Department of Justice estimated the cost of aligning its hardware across the whole Department with desired levels at $14.0 million per year for three years. Figures for the court system were not calculated but they are likely to be a significant portion of this figure.

Using outdated technology poses a risk to the court system as older equipment may be more likely to break down, potentially delaying courts or slowing down court services. In the court system throughout 2018, hardware made up 30.8 per cent of all critical incidents reported to technical support and 41.9 per cent of all high priority incidents. In addition, 16.2 per cent of all reported issues related to printing devices or printing.

From 2017 to 2018, technical support incidents from courts or court services increased. There were 4,379 technical support incidents in 2017, which increased significantly to 9,186 in 2018. The Department advised that some outside factors may have contributed to this increase. The Department was rolling out its new incident recording system throughout 2017, meaning that there would be an under‑reporting of incidents in that year. The Department also advised that throughout 2018 there was a greater focus on ensuring that every issue was logged, which had not previously been the case. Despite these factors, the use of outdated technology has likely increased the risk of technology breakages and may have contributed to the increase in requests for technical support.

Refreshing technology on a regular basis would reduce the risk of hardware failures and ensure that equipment is covered by warranty.

The Department did not meet all court technical support targets in 2017 and 2018

The Digital and Technology Services branch (DTS) was responsible for providing technical support to the courts and the Courts and Tribunal Services branch prior to July 2019. DTS provided technical support in line with a Service Level Agreement (SLA) with the Department. In 2017, DTS did not provide this support in a timely manner. Performance improved in 2018, though DTS fell short of its targets for critical and moderate priority incidents. Exhibit 7 outlines DTS' targets under the SLA.

Exhibit 7: Digital and Technology Services' Service Level Agreement
Priority Target resolution time Target percentage in time (%)
1. Critical 4 hours 80
2. High 1 day 80
3. Moderate 3 days 85
4. Low 5 days 85
Source: Department of Communities and Justice, 2019.

Critical incidents are particularly important for the Department to deal with in a timely manner because these include incidents which may delay a court sitting until resolved or incidents which impact on large numbers of staff. Some of the critical incidents raised with DTS specifically stated that they were delaying a court sitting, often due to transcription machines not working. High priority incidents include those where there is some impact on the functions of the business, which may in turn affect the efficiency of the court system. High priority incidents also include those directly impacting on members of the Judiciary. 

This audit examined DTS' performance against its SLA in the 2017 and 2018 calendar years across the whole court system, not just the District Court. The total number of incidents, as well as critical and high priority incidents, can be seen in Exhibit 8.

Exhibit 8: Number of incidents in 2017 and 2018
Priority 2017 2018
All 4,379 9,186
1. Critical 48 91
2. High 128 315
Source: Audit Office of NSW analysis of Department of Communities and Justice data, 2019.

The Department's results against its SLA in 2017 and 2018 are shown in Exhibit 9.

The Early Appropriate Guilty Pleas (EAGP) reform consists of five main elements:

  • early disclosure of evidence from NSW Police Force to the prosecution and defence
  • early certification of what the accused is going to be charged with to minimise changes
  • mandatory criminal case conferencing between the prosecutor and accused's representation
  • changes to Local Court case management
  • more structured sentence discounts.

More detailed descriptions of each of these changes can be found in the Introduction. These reform elements are anticipated to have three key effects:

  • accelerate the timing of guilty pleas
  • increase the overall proportion of guilty pleas
  • decrease the average length of contested trials.

Improving District Court efficiency is one of the stated aims of EAGP, which would be achieved by having more cases resolve in the Local Court and having fewer defendants plead guilty on the day of their trial in the District Court. The reform commenced in April 2018 and it is too early to state the impact of this reform on District Court efficiency.

The Department is responsible for delivering EAGP in conjunction with other justice sector agencies. They participated in the Steering Committee and the Working Groups, as well as providing the Project Management Office (PMO).

The Department is not measuring the economic benefits stated in the EAGP business case

The business case for EAGP listed nine quantifiable benefits which were expected to be derived from the achievement of the three key effects listed above. The Department is not measuring one of these benefits and is not measuring the economic benefits for five more, as shown in Exhibit 12.

Benefit Economic benefit (over ten years) Being measured?
Accelerated timing of guilty pleas $54.6m yellow circle with minus in the center
Increased guilty plea rate $90.7m yellow circle with minus in the center
Decreased average trial length $27.5m yellow circle with minus in the center
A reduction in the delay of indictable matters proceeding to trial N/A check circle mauve
Increase the number of finalised matters per annum N/A check circle mauve
Reduction of the current backlog of criminal trials in the District Court N/A check circle mauve
Reduction in bed pressure on the correction system due to reduced
average time in custody
$13.7m Exclamation circle red
Productivity improvements due to reduction in wasted effort $53.3m yellow circle with minus in the center
Bankable cost savings due to jury empanelment avoided $2.5m yellow circle with minus in the center

 

Exhibit 12: The Department's measurement of quantifiable benefits
Key check circle mauve Measuring yellow circle with minus in the center Not measuring economic benefit Exclamation circle red Not measuring
Source: Audit Office of NSW analysis.

While it is too early to comment on the overall impact of EAGP, better practice in benefits realisation involves an ongoing effort to monitor benefits to ensure that the reform is on target and determine whether any corrective action is needed.

The Department is measuring the number of finalised matters per annum and while the Department is not measuring the reduction in the backlog as part of this program, this measure is reported as part of the Department's internal reporting framework. The Department is not monitoring the reduction in delay of indictable matters proceeding to trial directly as part of this reform, but this does form part of the monthly Operational Performance Report which the Department sends to the EAGP Steering Committee.

The Department is not monitoring any of the economic benefits stated in the business case. These economic benefits are a mixture of bankable savings and productivity improvements. This amounts to a total of $242.3 million over ten years which was listed in the business case as potential economic benefits from the implementation of this reform against the total cost of $206.9 million over ten years. The Department is collecting proxy indicators which would assist in these calculations for several indicators, but it is not actively monitoring these savings. For example, the Department is monitoring average trial length, but is not using this information to calculate economic benefits derived from changes in trial length.

The Department is also not collecting information related to the average length of custody as part of this program. This means that it is unable to determine if EAGP is putting less pressure on the correctives system and it is not possible for the Department to calculate the savings from this particular benefit.

While stakeholders are optimistic about the impact of EAGP, not measuring the expected benefits stated in the business case means that the Department does not know if the reform is achieving what it was designed to achieve. Further, the Department does not know if it must take corrective action to ensure that the program achieves the stated benefits. These two things put the overall program benefits at risk.

The Department has not assigned responsibility for the realisation of each benefit, potentially risking the success of the program

The Department has not assigned responsibility for the realisation of each benefit stated in the business case. The Department holds the Steering Committee responsible for the realisation of all benefits. Benefits realisation is the process which ensures that the agency reaches benefits as stated in the business case. Assigning responsibility for benefits realisation to the Steering Committee rather than individuals is not in line with good practice.

Good practice benefits realisation involves assigning responsibility for the realisation of each benefit to an individual at the business unit level. This ensures there is a single point of accountability for each part of the program with knowledge of the benefit and the ability to take corrective action if it looks like that benefit will not be realised. This responsibility should sit at the operational level where detailed action can most easily be undertaken. The role of a Steering Committee in benefits realisation is to ensure that responsible parties are monitoring their benefits and taking appropriate corrective action.

The Department advised that it believes the Steering Committee should have responsibility for the realisation of benefits due to the difficulty of attributing the achievement of each benefit to one part of the reform alone. Given the Steering Committee meets only quarterly, it is not well placed to take action in response to variances in performance.

A BOCSAR evaluation is planned, however data errors make some of the information unreliable

BOCSAR are planning to undertake an overall evaluation of EAGP which is planned for release in 2021. Undertaking this evaluation will require high quality data to gain an understanding of the drivers of the reform. However, data captured throughout the first year of EAGP has proven unreliable, which may reduce the usefulness of BOCSAR's evaluation. These data issues were discussed in Exhibit 5 in Chapter 2, above. Access to accurate data is vital for conducting any program evaluation and inaccurate data raises the risk that the BOCSAR evaluation will not be able to provide an accurate evaluation of the impact of EAGP.

In addition to the BOCSAR evaluation, the Department had plans for a series of 'snapshot' evaluations for some of the key elements of the reform to ensure that they were operating effectively. These were initially delayed due to an efficiency dividend which affected EAGP. In August 2019, the Department commissioned a review of the implementation of several key success factors for EAGP.

There was clear governance throughout the implementation of EAGP

The implementation stage of EAGP had clear governance, lines of authority and communication. The Steering Committee, each Working Group and each agency had clear roles and responsibilities, and these were organised through a Project Management Office (PMO) provided by the former Department of Justice. The governance structure throughout the implementation phase can be seen at Exhibit 13.

The Steering Committee was established in December 2016 and met regularly from March 2017. It comprised senior members of key government agencies, as well as the Chief Judge and the Chief Magistrate for most of the duration of the implementation period. The Steering Committee met at least monthly throughout the life of the program. The Steering Committee was responsible for overseeing the delivery of EAGP and making key decisions relating to implementation, including spending decisions. The Chief Judge and the Chief Magistrate abstained from financial decisions. The Steering Committee updated the governance and membership of the Steering Committee as appropriate throughout the life of the reform.

Appendix one – Response from agency
 
Appendix two – About the audit 

Appendix three – Performance auditing 

 

Copyright Notice

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary Reference: Report number #329 - released 18 December 2019

Published

Actions for Ensuring contract management capability in government - HealthShare NSW

Ensuring contract management capability in government - HealthShare NSW

Health
Management and administration
Procurement
Project management

This report examined whether HealthShare NSW, a part of NSW Health, has the required contract management capability to effectively manage goods and services contracts valued over $250,000. 

The report found that HealthShare has a procurement framework that should support effective contract management, but it is not applying it consistently. In particular, the audit found that HealthShare was not applying key contract management elements to over 80 per cent of the high-value contracts it manages. The audit also found that HealthShare’s contract management practices were limited by inadequate performance monitoring.

'Effective contract management is essential to ensure the contracts HealthShare enters into are delivering as expected and ensuring value for money,' said the Auditor-General. 'Without this, the value for money or savings HealthShare achieves when it negotiates these contracts is at risk of being eroded over the life of the contract.'

The report recommends that NSW Health develop a performance improvement plan to ensure HealthShare is fully compliant with procurement policies and that NSW Health meets its obligations under the Government's Accreditation Program for Goods and Services Procurement.

HealthShare is a NSW Health entity responsible for providing shared services, including procurement, to support the delivery of patient care within the NSW health system. In 2018, HealthShare procured high value goods and services contracts with an annual estimated total spend of around $1.8 billion, with most of the contracts of long duration.

NSW Government agencies are increasingly delivering services and projects through contracts with third parties. These contracts can be complex and governments face challenges in negotiating and implementing them effectively. A robust contract management framework helps ensure all parties meet their obligations, contractual relationships are well managed, agencies achieve value for money, and deliverables meet the required standards and agreed timeframes.

Contract management capability is a broad term, which can include aspects of individual staff capability (such as staff knowledge, skills and experience) as well as organisational capability (such as policies, frameworks and processes).

The NSW Procurement Board is responsible for overseeing the Government's procurement system, setting policy and ensuring compliance. It has accredited the Health Administration Corporation (HAC) to procure goods and services with no upper financial limit. Under the terms of this accreditation, the Secretary, NSW Health (as head of HAC) has delegated the procurement of high-value (over $250,000) goods and services contracts within NSW Health to only the Ministry of Health and HealthShare NSW (HealthShare).

HealthShare NSW (HealthShare) is a NSW Health entity responsible for providing shared services, including procurement, to support the delivery of patient care within the NSW health system. In 2018, HealthShare procured high-value goods and services contracts with an annual estimated total spend of around $1.8 billion, with most of the contracts of long duration.

HealthShare’s Contract Management Guide states that, without rigorous contract management, 75 per cent of projected sourcing savings can disappear within 18 months of the contract starting.

This audit examined whether HealthShare has the required capability to effectively manage high-value goods and services contracts. Contracts we examined included critical items such as food services in hospitals, patient transport services, intravenous equipment and kidney dialysis services, where risks include patient safety as well as value for money. We did not examine infrastructure, construction or information communication and technology contracts. We also did not examine HealthShare’s sourcing processes, including identifying business needs, tendering and contract award.

We assessed HealthShare against the following criteria:

  1. HealthShare's systems, policies and procedures support effective contract management and are consistent with relevant frameworks, policies and guidelines.
  2. HealthShare has capable personnel to effectively conduct the monitoring activities throughout the life of the contract.

We included the NSW Public Service Commission and NSW Treasury, through NSW Procurement, as auditees because they administer policies which directly affect contract management capability. These include:

  • NSW Procurement Board Directions and policies
  • NSW Government Procurement Policy Framework
  • Accreditation Program for Goods and Services Procurement
  • the NSW Public Sector Capability Framework.

NSW Procurement was transferred to NSW Treasury from the former Department of Finance, Services and Innovation on 1 July 2019 as part of changes to government administrative arrangements.

Conclusion
HealthShare is not applying the capability needed to effectively manage high-value (over $250,000) goods and services contracts. HealthShare's procurement framework includes elements that should support effective contract management, and it has a systematic approach to managing staff contract management capability. That said, HealthShare is not implementing key contract management elements of its own framework. As such, the value for money or savings it achieves when it negotiates contracts is at risk of being eroded over the life of these contracts.
Effective contract management is essential for HealthShare to ensure contracts it enters into are delivering the goods and services expected and achieving value for money, safety and quality. The Ministry of Health and HealthShare have invested in developing and implementing systems and tools to support effective contract management. In line with its obligations under the Agency Accreditation Program for Goods and Services Procurement (accreditation program), the Ministry of Health mandates the use of contract management plans for high-value contracts. The Ministry of Health also requires that all health entities use the PROcure contract management system for ongoing management of contracts with a value over $150,000. HealthShare is not complying with these directions for over 80 per cent of the contracts it manages.
In the absence of HealthShare following its framework, and the Ministry of Health’s directions, we looked for other evidence that HealthShare was effectively managing high-value contracts. We found that HealthShare’s contract management practices were limited by inadequate performance monitoring.
When Local Health Districts (LHDs) need to procure high-value goods and services, the Ministry of Health’s procurement policy requires that they use HealthShare to source and manage the procurement. This is to manage risk and provide oversight of procurement and contracts across the NSW health system. Despite this policy, HealthShare was only managing the sourcing stage of the procurement and transferring responsibility for contract management to the relevant LHD.

Appendix one – Response from agencies

Appendix two – Contract performance management summary

Appendix three – About the audit

Appendix four – Performance auditing

 

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary Reference: Report number #328 - released 31 October 2019

Published

Actions for Mental health service planning for Aboriginal people in New South Wales

Mental health service planning for Aboriginal people in New South Wales

Health
Management and administration
Project management
Service delivery
Workforce and capability

A report released by the Auditor-General for New South Wales, Margaret Crawford, has found that NSW Health is not forming effective partnerships with Aboriginal communities to plan, design and deliver appropriate mental health services. There is limited evidence that NSW Health is using the knowledge and expertise of Aboriginal communities to guide how mental health care is structured and delivered.

Mental illness (including substance use disorders) is the main contributor to lower life expectancy and increased mortality in the Aboriginal population of New South Wales. It contributes to a higher burden of disease and premature death at rates that are 40 per cent higher than the next highest chronic disease group, cardiovascular disease.1 

Aboriginal people have significantly higher rates of mental illness than non Aboriginal people in New South Wales. They are more likely to present at emergency departments in crisis or acute phases of mental illness than the rest of the population and are more likely to be admitted to hospital for mental health treatments.2 

In acknowledgement of the significant health disparities between Aboriginal and non Aboriginal people, NSW Health implemented the NSW Aboriginal Health Plan 2013 2023 (the Aboriginal Health Plan). The overarching message of the Aboriginal Health Plan is ‘to build respectful, trusting and effective partnerships with Aboriginal communities’ and to implement ‘integrated planning and service delivery’ with sector partners. Through the Plan, NSW Health commits to providing culturally appropriate and ‘holistic approaches to the health of Aboriginal people'.

The mental health sector is complex, involving Commonwealth, state and non government service providers. In broad terms, NSW Health has responsibility to support patients requiring higher levels of clinical support for mental illnesses, while the Commonwealth and non government organisations offer non acute care such as assessments, referrals and early intervention treatments.

The NSW Health network includes 15 Local Health Districts and the Justice Health and Forensic Mental Health Network that provide care to patients during acute and severe phases of mental illness in hospitals, prisons and community service environments. This includes care to Aboriginal patients in the community at rates that are more than four times higher than the non Aboriginal population. Community services are usually provided as follow up after acute admissions or interactions with hospital services. The environments where NSW Health delivers mental health care include:

  • hospital emergency departments, for short term assessment and referral
  • inpatient hospital care for patients in acute and sub acute phases of mental illness
  • mental health outpatient services in the community, such as support with medications
  • custodial mental health services in adult prisons and juvenile justice centres.

The NSW Government is reforming its mental health funding model to incrementally shift the balance from hospital care to enhanced community care. In 2018–19, the NSW Government committed $400 million over four years into early intervention and specialist community mental health teams.

This audit assessed the effectiveness of NSW Health’s planning and coordination of mental health services and service pathways for Aboriginal people in New South Wales. We addressed the audit objective by answering three questions: 

  1. Is NSW Health using evidence to plan and inform the availability of mental health services for Aboriginal people in New South Wales?
  2. Is NSW Health collaborating with partners to create accessible mental health service pathways for Aboriginal people?
  3. Is NSW Health collaborating with partners to ensure the appropriateness and quality of mental health services for Aboriginal people?
Conclusion

NSW Health is not meeting the objectives of the NSW Aboriginal Health Plan, to form effective partnerships with Aboriginal Community Controlled Health Services and Aboriginal communities to plan, design and deliver mental health services.

There is limited evidence that existing partnerships between NSW Health and Aboriginal communities meet its own commitment to use the ‘knowledge and expertise of the Aboriginal community (to) guide the health system at every level, including (for) the identification of key issues, the development of policy solutions, the structuring and delivery of services' 3 and the development of culturally appropriate models of mental health care.

NSW Health is planning and coordinating its resources to support Aboriginal people in acute phases of mental illness in hospital environments. However, it is not effectively planning for the supply and delivery of sufficient mental health services to assist Aboriginal patients to manage mental illness in community environments. Existing planning approaches, data and systems are insufficient to guide the $400 million investment into community mental health services announced in the 2018–19 Budget.

NSW Health is not consistently forming partnerships to ensure coordinated care for patients as they move between mental health services. There is no policy to guide this process and practices are not systematised or widespread.

In this report, the term ‘Aboriginal people’ is used to describe both Aboriginal and Torres Strait Islander peoples. The Audit Office of NSW acknowledges the diversity of traditional countries and Aboriginal language groups across the state of New South Wales.


1 Australian Burden of Disease Study: Impact and causes of illness and death in Aboriginal and Torres Strait Islander people 2011 (unaudited).
2 Australian Institute of Health and Welfare data 2016–17 (unaudited).
3 NSW Health, The Aboriginal Health Plan 2013-2023.

In May 2019, the Audit Office of New South Wales invited Aboriginal mental health clinicians and policy experts from government and non-government organisations to attend a one-day workshop. Workshop attendees advised on factors that improve the quality and appropriateness of mental health care for Aboriginal people in New South Wales. They described appropriate mental health care as:

  • culturally safe, allowing Aboriginal people to draw strength in their identity, culture and community
  • person centred and focussed on individual needs
  • delivered by culturally competent staff with no bias
  • holistic, trauma-informed and focussed on early intervention where possible
  • delivered in places that are appropriate including outreach to homes and communities
  • welcoming of the involvement of local Aboriginal community and connected to local knowledge and expertise including totems and kinship structures. 

The definition of 'appropriate' mental health care for Aboriginal people throughout this report is based on this advice.

Aboriginal people access emergency services at much higher rates than non-Aboriginal people

The choices that people make in relation to health service options provide some insight into the suitability and appropriateness of the service to their needs.

Aboriginal people have different mental health service use patterns than non-Aboriginal people. Aboriginal people are much more likely to be in a crisis situation before receiving mental health services, usually in an emergency department of a hospital.

Aboriginal people make up three per cent of the total New South Wales population, but they constitute 11 per cent of emergency department presentations for mental health treatments. In regional areas, Aboriginal people make up 20.5 per cent of presentations at emergency departments for mental health reasons. 

A number of factors help to explain Aboriginal mental health service usage patterns. According to government and non-government mental health organisations:

  • emergency department services are better known to Aboriginal people than other mental health services
  • community-based models of care are not appropriate for Aboriginal people
  • Aboriginal people are reluctant to access community-based mental health services to prevent crisis situations
  • community mental health services are not available for Aboriginal people after hours and during the weekend, so emergency services are the only option.

The statewide proportions of Aboriginal people presenting at emergency departments for mental health treatments has been increasing over time (Exhibit 6).

Appendix one – Response from agency

Appendix two – The NSW Aboriginal Health Plan

Appendix three – About the audit

Appendix four – Performance auditing

 

Parliamentary Reference: Report number #326 - released 29 August 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Contracting non-government organisations

Contracting non-government organisations

Community Services
Compliance
Fraud
Management and administration
Procurement
Regulation
Service delivery

This report found the Department of Family and Community Services (FACS) needs to do more to demonstrate it is effectively and efficiently contracting NGOs to deliver community services in the Permanency Support Program (a component of out-of-home-care services) and Specialist Homelessness Services. It notes that FACS is moving to an outcomes-based commissioning model and recommends this be escalated consistent with government policy.

Government agencies, such as the Department of Family and Community Services (FACS), are increasingly contracting non-government organisations (NGOs) to deliver human services in New South Wales. In doing so, agencies are responsible for ensuring these services are achieving expected outcomes. Since the introduction of the Commissioning and Contestability Policy in 2016, all NSW Government agencies are expected to include plans for customer and community outcomes and look for ways to use contestability to raise standards.

Two of the areas receiving the greatest funding from FACS are the Permanency Support Program and Specialist Homelessness Services. In the financial year 2017–18, nearly 500 organisations received $784 million for out-of-home care programs, including the Permanency Support Program. Across New South Wales, specialist homelessness providers assist more than 54,000 people each year and in the financial year 2017–18, 145 organisations received $243 million for providing short term accommodation and homelessness support, including Specialist Homelessness Services.

In the financial year 2017–18, FACS entered into 230 contracts for out-of-home care, of which 49 were for the Permanency Support Program, representing $322 million. FACS also entered into 157 contracts for the provision of Specialist Homelessness Services which totalled $170 million. We reviewed the Permanency Support Program and Specialist Homelessness Services for this audit.

This audit assessed how effectively and efficiently FACS contracts NGOs to deliver community services. The audit could not assess how NGOs used the funds they received from FACS as the Audit Office does not have a mandate that could provide direct assurance that NGOs are using government funds effectively.

Conclusion
FACS cannot demonstrate it is effectively and efficiently contracting NGOs to deliver community services because it does not always use open tenders to test the market when contracting NGOs, and does not collect adequate performance data to ensure safe and quality services are being provided. While there are some valid reasons for using restricted tenders, it means that new service providers are excluded from consideration - limiting contestability. In the service delivery areas we assessed, FACS does not measure client outcomes as it has not yet moved to outcomes-based contracts. 
FACS' procurement approach sometimes restricts the selection of NGOs for the Permanency Support Program and Specialist Homelessness Services
FACS has a procurement policy and plan which it follows when contracting NGOs for the provision of human services. This includes the option to use restricted tenders, which FACS sometimes uses rather than opening the process to the market. The use of restricted tenders is consistent with its procurement plan where there is a limited number of possible providers and the services are highly specialised. However, this approach perpetuates existing arrangements and makes it very difficult for new service providers to enter the market. The recontracting of existing providers means FACS may miss the opportunity to benchmark existing providers against the whole market. 
FACS does not effectively use client data to monitor the performance of NGOs funded under the Permanency Support Program and Specialist Homelessness Services
FACS' contract management staff monitor individual NGO performance including safety, quality of services and compliance with contract requirements. Although FACS does provide training materials on its intranet, FACS does not provide these staff with sufficient training, support or guidance to monitor NGO performance efficiently or effectively. FACS also requires NGOs to self-report their financial performance and contract compliance annually. FACS verifies the accuracy of the financial data but conducts limited validation of client data reported by NGOs to verify its accuracy. Instead, FACS relies on contract management staff to identify errors or inaccurate reporting by NGOs.
FACS' ongoing monitoring of the performance of providers under the Permanency Support Program is particularly limited due to problems with timely data collection at the program level. This reduces FACS' ability to monitor and analyse NGO performance at the program level as it does not have access to ongoing performance data for monitoring service quality.
In the Specialist Homelessness Services program, FACS and NGOs both provide the data required for the National Minimum Data Set on homelessness and provide it to the Australian Institute of Health and Welfare, as they are required to do. However, this data is not used for NGO performance monitoring or management.
FACS does not yet track outcomes for clients of NGOs
FACS began to develop an approach to outcomes-based contracting in 2015. Despite this, none of the contracts we reviewed are using outcomes as a measure of success. Currently, NGOs are required to demonstrate their performance is consistent with the measures stipulated in their contracts as part of an annual check of their contract compliance and financial accounts. NGOs report against activity-based measures (Key Performance Indicators) and not outcomes.
FACS advises that the transition to outcomes-based contracting will be made with the new rounds of funding which will take place in 2020–2021 for Specialist Homelessness Services and 2023 for the Permanency Support Program. Once these contracts are in place, FACS can transition NGOs to outcomes based reporting.
Incomplete data limits FACS' effectiveness in continuous improvement for the Permanency Support Program and Specialist Homelessness Services
FACS has policies and procedures in place to learn from past experiences and use this to inform future contracting decisions. However, FACS has limited client data related to the Permanency Support Program which restricts the amount of continuous improvement it can undertake. In the Specialist Homelessness Support Program data is collected to inform routine contract management discussions with service providers but FACS is not using this data for continuous improvement. 

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

 

Parliamentary Reference: Report number #323 - released 26 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Development assessment: pre-lodgement and lodgement in Camden Council and Randwick City Council

Development assessment: pre-lodgement and lodgement in Camden Council and Randwick City Council

Local Government
Management and administration
Service delivery

The report found that both councils could do more to monitor and assess the effectiveness of their pre-lodgement and lodgement stages. The audit highlighted that Randwick City Council closely follows guidance designed to encourage good practice in these initial stages of its development assessments. It also demonstrated it was timely when processing lodgements. Camden Council is partially following the guidance and could not demonstrate that its lodgement stage was timely.

A development application is a formal application for development that requires consent under the NSW Environmental Planning and Assessment Act 1979. It is usually lodged with the local council for processing and determination, and consists of standard application forms, supporting technical reports and plans. 

In March 2017, the NSW Department of Planning and Environment (DPE)1 released the ‘Development Assessment Best Practice Guide' designed to help councils assess development applications in a timely manner and provide a better experience for applicants. 

DPE's guide describes the development assessment process in five stages. 

According to the Guidance, councils should systematically measure, monitor and review development assessment outcomes and timeframes against performance targets to ensure the process is transparent, accountable and outcome-focused.

Appendix one – Response from agencies

Appendix two – Council's alignment with the guidance

Appendix three – About the audit

Appendix four – Performance auditing

 

Parliamentary Reference: Report number #322 - released 20 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Domestic waste management in Campbelltown City Council and Fairfield City Council

Domestic waste management in Campbelltown City Council and Fairfield City Council

Local Government
Management and administration
Service delivery

The Auditor-General for New South Wales, Margaret Crawford, today released a report on Domestic waste management in Campbelltown City Council and Fairfield City Council.The report found that both Councils collect and transport domestic kerbside waste effectively and process it at a low cost. The Councils also effectively process waste placed in green-lid and yellow-lid bins, but neither Council has been able to enforce their contracts for processing red-lid bin waste. As a result, almost all such waste goes straight to landfill. 

Local councils provide waste management services to their residents. They collect domestic waste primarily through kerbside services, but also at council drop off facilities. Waste management is one of the major services local councils deliver. Each year, councils collectively manage an estimated 3.5 million tonnes of waste generated by New South Wales residents.

Waste disposed of in landfills attracts a NSW Government waste levy. Councils’ kerbside services help residents to separate recyclable and non recyclable waste. This reduces the cost of waste disposed to landfill. These services typically provide yellow-lid bins for dry recyclables, green-lid bins for garden organics and red-lid bins for residual waste. To increase the level of recycling, some councils deliver residual waste to alternative waste treatment facilities for processing. This can involve composting and the recovery of resources, including plastics and metals, which can be recycled.

Appendix one - Responses from local councils

Appendix two - About the audit

Appendix three - Performance auditing

 

Parliamentary Reference: Report number #320 - released 5 June 2019

Published

Actions for Workforce reform in three amalgamated councils

Workforce reform in three amalgamated councils

Local Government
Management and administration
Project management
Workforce and capability

The Inner West Council and the Snowy Monaro and Queanbeyan-Palerang Regional Councils have all made progress towards efficient organisational structures following the amalgamation of their former council areas in 2016, according to a report released today by the Auditor-General of New South Wales.

All three councils are now operating with a single workforce and have largely achieved the milestones they planned for the first stage of their amalgamations. None have finished reviewing and aligning services across their former council areas nor integrated their ICT systems. They need to do this to be in a position to implement an optimal structure. 

 

On 12 May 2016, the NSW Government announced the amalgamation of 42 councils into 19 new councils. This followed a period of 18 months during which the NSW Independent Pricing and Regulatory Tribunal (IPART) had assessed councils' ‘fitness for the future’, and communities were consulted about proposed mergers. A further amalgamated council was created on 9 September 2016.

Upon amalgamation, existing elected councils were abolished, interim General Managers appointed, and Administrators engaged to undertake the role of the previously elected councils until Local Government elections were held 18 months later. During the period of administration, councils were asked to report on the progress of their amalgamations to the Department of Premier and Cabinet (DPC).

Council amalgamations not only require a re-drawing of boundaries, but re-establishment of local representation, decisions about alignment of services across the former council areas, and establishment of an amalgamated workforce.

The objective of this audit was to assess whether three councils, Inner West Council, Queanbeyan-Palerang Regional Council and Snowy Monaro Regional Council, are effectively reforming their organisation structures to realise efficiency benefits from amalgamation and managing the impact on staff.

Conclusion
The three councils we examined have made progress towards an efficient organisation structure.

Following amalgamation, all three councils developed detailed plans to bring their former workforces together, review positions and salaries, amalgamate salary structures and align human resources policies. All three councils have largely achieved the milestones included in these plans.
Benefits realisation plans show that councils did not expect to achieve material savings or efficiencies from workforce reform within the first three years of amalgamation.
Two councils do not clearly report on whether their reform initiatives are achieving benefits.

Administrators at all three councils endorsed lower savings targets than the NSW Government’s early analysis suggested may be possible. All three councils have plans or strategies to progress and achieve benefits from the amalgamation. However, Inner West Council and Snowy Monaro Regional Council could more clearly link their reform initiatives with expected benefits and include this in public reporting.

Amalgamations represent a substantial period of change for affected communities and amalgamated councils should be routinely reporting to their communities about the costs and benefits of amalgamation.

Councils have not yet determined their future service offerings and service levels nor completed integration of ICT systems. These decisions need to be made before an optimal organisation structure can be implemented.

Before amalgamated councils can implement an optimal organisation structure, they need to review and confirm their customer service offerings and service levels in consultation with their communities. This work is underway but is not yet complete in any of the councils.

Progress towards an efficient structure has been slowed by staff protections in the Local Government Act 1993 (the Act) and a range of logistical and administrative issues associated with amalgamation. These include multiple IT systems and databases that need to be integrated and different working conditions, policies and practices in the former councils that are not yet fully
harmonised.

The councils implemented legislated staff protections and focused on the people side of change but cannot reliably measure the impact of their change management efforts.

The Act provides protections that reduce the impact of amalgamations on staff. Beyond implementing these protections, the councils have communicated with staff, sought to prepare them for change, and involved staff in key decisions. All councils have conducted staff surveys over time. However, at this stage these staff surveys have not provided an effective or reliable measure of the impact of change management efforts. 

Published

Actions for Governance of Local Health Districts

Governance of Local Health Districts

Health
Internal controls and governance
Management and administration

The main roles, responsibilities and relationships between Local Health Districts (LHDs), their Boards and the Ministry of Health are clear and understood, according to a report released today by the Auditor-General for New South Wales, Margaret Crawford. However, there are opportunities to achieve further maturity in the system of governance and the audit report recommended a series of actions to further strengthen governance arrangements.

Fifteen Local Health Districts (LHDs) are responsible for providing public hospital and related health services in NSW. LHDs are:

  • established as statutory corporations under the Health Services Act 1997 to manage public hospitals and provide health services within defined geographical areas
  • governed by boards of between six and 13 people appointed by the Minister for Health
  • managed by a chief executive who is appointed by the board with the concurrence of the Secretary of NSW Health
  • accountable for meeting commitments made in annual service agreements with the NSW Ministry of Health.

The NSW Ministry of Health (the Ministry) is the policy agency for the NSW public health system, providing regulatory functions, public health policy, as well as managing the health system, including monitoring the performance of hospitals and health services.

The current roles and responsibilities of LHDs and the Ministry, along with other agencies in NSW Health, were established in 2011 following a series of reforms to the structure and governance of the system. These reforms began with the report of the 'Special Commission of Inquiry into Acute Care Services in NSW Public Hospitals' ('the Garling Inquiry'), which was released in 2008, and were followed by reforms announced by the incoming coalition government in 2011.

These reforms were intended to deliver greater local decision making, including better engagement with clinicians, consumers, local communities, and other stakeholders in the primary care (such as general practitioners) and non-government sectors.

The reforms empowered LHDs by devolving some management and accountability from the Ministry for the delivery of health services in their area. LHDs were made accountable for meeting annual obligations under service agreements.

This audit assessed the efficiency and effectiveness of the governance arrangements for LHDs. We answered two questions:

  • Are there clear roles, responsibilities and relationships between the Ministry of Health and LHDs and within LHDs?
  • Does the NSW Health Performance Framework establish and maintain accountability, oversight and strategic guidance for LHDs?
Conclusion
Main roles, responsibilities and relationships between LHDs, their boards, and the Ministry of Health are clear and understood, though there is opportunity to achieve further maturity in the system of governance for LHDs.
Main roles and responsibilities are clear and understood by local health district (LHD) board members and staff, Ministry of Health executive staff, and key stakeholders. However, there is some ambiguity for more complex and nuanced functions. A statement of principles to support decision making in a devolved system would help to ensuring that neither LHDs or the Ministry 'over-reach' into areas that are more appropriately the other's responsibility.
Better clinician engagement in LHD decision making was a key driver for devolution. This engagement has not met the expectations of devolution and requires attention as a priority.
Relationships between system participants are collaborative, though the opportunity should be taken to further embed this in the system structures and processes and complement existing interpersonal relationships and leadership styles.
Accountability and oversight mechanisms, including the Health Performance Framework and Service Agreements, have been effective in establishing accountability, oversight and strategic guidance for LHDs.
The Health Performance Framework and Service Agreements have underpinned a cultural shift toward greater accountability and oversight. However, as NSW Health is a large, complex and dynamic system, it is important that these accountability and oversight mechanisms continue to evolve to ensure that they are sufficiently robust to support good governance.
There are areas where accountability and oversight can be improved including:
  • continued progress in moving toward patient experience, outcome, and quality and safety measures
  • improving the Health Performance Framework document to ensure it is comprehensive, clear and specifies decision makers
  • greater clarity in the nexus between underperformance and escalation decisions
  • including governance-related performance measures
  • more rigour in accountability for non-service activity functions, including consumer and community engagement
  • ensuring that performance monitoring and intervention is consistent with the intent of devolution. 
There is clear understanding of the main roles and responsibilities of LHDs and the Ministry of Health under the structural and governance reforms introduced in 2011. Strongly collaborative relationships provide a good foundation on which governance arrangements can continue to mature, though there is a need to better ensure that clinicians are involved in LHD decision making.

NSW Health is large and complex system, operating in a dynamic environment. The governance reforms introduced in 2011 were significant and it is reasonable that they take time to mature.

The main roles of LHDs and the Ministry are clear and well-understood, and there is good collaboration between different parts of the system. This provides a sound foundation on which to further mature the governance arrangements of LHDs.

While the broad roles of LHDs, their boards, and the Ministry are well understood by stakeholders in the system, there are matters of detail and complexity that create ambiguity and uncertainty, including:

  • the roles and relationships between the LHDs and the Pillars
  • to what extent LHDs have discretion to pursue innovation
  • individual responsibility and obligations between chairs, boards, executive staff, and the Ministry.

These should be addressed collaboratively between boards, their executives, and the Ministry, and should be informed by a statement of principles that guides how devolved decision making should be implemented.

Better clinician engagement in health service decision making was a key policy driver for devolution. Priority should be given by LHDs and the Ministry to ensuring that clinicians are adequately engaged in LHD decision making. It appears that in many cases they are not, and this needs to be addressed.

The quality of board decision making depends on the information they are provided and their capacity to absorb and analyse that information. More can be done to promote good decision making by improving the papers that go to boards, and by ensuring that board members are well positioned to absorb the information provided. This includes ensuring that the right type and volume of information are provided to boards, and that members and executive managers have adequate data literacy skills to understand the information.

Recommendations

  1. By December 2019, the Ministry of Health should:
     
    1. work with LHDs to identify and overcome barriers that are limiting the appropriate engagement of clinicians in decision making in LHDs
    2. develop a statement of principles to guide decision making in a devolved system
    3. provide clarity on the relationship of the Agency for Clinical Innovation and the Clinical Excellence Commission to the roles and responsibilities of LHDs.
       
  2. By June 2020, LHDs boards, supported where appropriate by the Ministry of Health, should address the findings of this performance audit to ensure that local practices and processes support good governance, including:
     
    1. providing timely and consistent induction; training; and reviews of boards, members and charters
    2. ensuring that each board's governance and oversight of service agreements is consistent with their legislative functions
    3. improving the use of performance information to support decision making by boards and executive managers.
Accountability and oversight mechanisms, including the Health Performance Framework and service agreements, have been effective in establishing accountability, oversight and strategic guidance for LHDs. They have done this by driving a cultural shift that supports LHDs being accountable for meeting their obligations. These accountablity and oversight mechanisms must continue to evolve and be improved.

This cultural shift has achieved greater recognition of the importance of transparency in how well LHDs perform. However, as NSW Health is a large, complex and dynamic system, it is important that these accountability and oversight mechanisms continue to evolve to ensure that they are sufficiently robust to support good governance.

There are areas where accountability and oversight can be improved including:

  • continued progress in moving toward patient experience, outcome and value-based measures
  • improving the Health Performance Framework document to ensure it is comprehensive, clear and specifies decision makers
  • greater clarity in the nexus between underperformance and escalation decisions
  • by adding governance-related performance measures to service agreements
  • more rigour in accountability for non-service activity functions, such as consumer and community engagement
  • ensuring that performance monitoring and intervention is consistent with the intent of devolution.

Recommendations

3.    By June 2020, the Ministry of Health should improve accountability and oversight mechanisms by:

a)    revising the Health Performance Framework so that it is a cohesive and comprehensive document
b)    clarifying processes and decision making for managing performance concerns
c)    developing a mechanism to adequately hold LHDs accountable for non-service activity functions
d)    reconciling performance monitoring and intervention with the policy intent of devolution.

Published

Actions for Transport Access Program

Transport Access Program

Transport
Infrastructure
Project management
Service delivery

The following report is available in an Easy English version that is intended to meet the needs of some people with lower literacy skills, some people with an intellectual disability and some people from different cultural backgrounds.

View the Easy English version of the Transport Access Program report

Transport for NSW’s process for selecting and prioritising projects for the third stage of its Transport Access Program balanced compliance with national disability standards with broader customer outcomes. Demographics, deliverability and value for money were also considered. However, Transport for NSW does not know the complete scope of work required for full compliance, limiting its ability to demonstrate that its approach is effective, according to a report released today by the Auditor-General for New South Wales, Margaret Crawford.

Access to transport is critical to ensuring that people can engage in all aspects of community life, including education, employment and recreation. People with disability can encounter barriers when accessing public transport services. In 2015, there were 1.37 million people living with disability in New South Wales.

Accessible public transport is about more than physical accessibility. It also means barrier-free access for people who have vision, hearing or cognitive impairments. All users, not just people with disability, benefit from improvements to the accessibility and inclusiveness of transport services. 

Transport for NSW has an obligation under Australian Government legislation to provide accessible services to people with disabilities in a manner which is not discriminatory. Under the Disability Standards for Accessible Public Transport 2002 (the DSAPT - an instrument of the Disability Discrimination Act 1992 (the Act) (Commonwealth)), there is a requirement to modify and develop new infrastructure, means of transport and services to provide access for people with disabilities. All public transport operators are required to ensure that at least 90 per cent of their networks met DSAPT by December 2017 and the networks will need to be 100 per cent compliant with all parts of the standards by 31 December 2022. Trains are not required to be fully compliant with DSAPT until December 2032. 

The Transport Access Program (TAP) is Transport for NSW's largest program with a specific focus on improving access to public transport for people with disability. The TAP is a series of projects to upgrade existing public transport infrastructure across four networks: Sydney Trains, Intercity Trains, Regional Trains and Sydney Ferries. Transport for NSW established the TAP as a rolling program and, to date, it has delivered the first tranche of TAP (TAP 1) and is completing the final projects for the second tranche (TAP 2). NSW budget papers estimate that by 30 June 2018, Transport for NSW had spent $1.2 billion in the TAP since its commencement in 2011-12.

After the completion of TAP 1 and TAP 2 (as well as through other transport infrastructure programs), Transport for NSW estimates that 58.5 per cent of the Sydney Trains, Regional Trains and Intercity Trains networks, and 66 per cent of the Sydney Ferries network, will be accessible. To close the significant gap in compliance with the DSAPT target, the objective for TAP 3 is ‘to contribute to Disability Discrimination Act 1992 related targets through DSAPT compliance upgrades’. 

The audit assessed whether Transport for NSW has an effective process to select and prioritise projects as part of the TAP, with a specific focus on the third tranche of TAP funding.

In August 2018, at the commencement of this audit, Transport for NSW intended to complete the selection of projects for the TAP 3 final business case in December 2018. Transport for NSW advise that it now intends to complete the development stage and final business case in the first quarter of 2019, prior to the final investment decision of the TAP program. This report is based on the TAP 3 strategic business case and information provided by Transport for NSW up to December 2018.

Conclusion
Transport for NSW’s process for selecting and prioritising projects for TAP 3 balanced DSAPT compliance goals with broader customer outcomes. It also considered demographics, deliverability and value for money. However, Transport for NSW does not know the complete scope of work required for full DSAPT compliance, and this limits its ability to demonstrate that its approach is effective. 
Transport for NSW has applied most of the external review recommendations from previous funding rounds to the implementation of the third round of TAP funding (TAP3), with positive results. Changes made include a clear objective for TAP 3 to focus on improving compliance, improved governance arrangements, and better consideration of deliverability and design during project planning. 
Through TAP 3, Transport for NSW is also trying to better address disability access in a way that balances DSAPT compliance with other considerations - such as population demographics, access to services and value for money. Transport for NSW developed an objective prioritisation and selection methodology to assess projects for TAP 3 funding. 
Transport for NSW cannot quantify the work needed to meet DSAPT compliance targets across the rail and ferry networks as it has not completed a comprehensive audit of compliance. This information is needed to ensure the effective targeting of funding, and to measure the contribution of TAP 3 work to meeting the DSAPT compliance targets. Instead, Transport for NSW has undertaken a phased approach to completing a comprehensive audit of compliance across the networks, with a focus on first assessing compliance at locations that are not wheelchair accessible. This creates two problems. First, Transport for NSW does not know the complete scope of work required to achieve DSAPT compliance. Second, not all wheelchair accessible locations fully meet DSAPT standards.
Transport for NSW's proposed communication plan for the schedule of TAP 3 funded works does not align with its Disability Inclusion Action Plan 2018-2022. The Disability Inclusion Action Plan commits Transport for NSW to providing a full list of stations and wharves to be upgraded with their estimated time of construction when the next round of funding, TAP 3, is announced. Given the long timeframes associated with improving transport infrastructure, this information is important as it allows people to make informed decisions about where they live, work or study. Instead, Transport for NSW plans to communicate information to customers on a project by project basis.

In 2015, there were 1.37 million people living with disability in New South Wales. Access to transport is critical to ensuring that people can engage in all aspects of community life, including education, employment and recreation. People with disability can encounter barriers when accessing public transport services. 

The social model of disability, outlined in the United Nations Convention on the Rights of Persons with Disabilities, views people with disability as not disabled by their impairment but by the barriers in the community and environment that restrict their full and effective participation in society on an equal basis with others. 

Accessible public transport is more than the provision of physical access to premises and conveyances, it provides barrier-free access for people who have vision, hearing or cognitive impairments. All users, not just people with disability, benefit from improvements to the accessibility and inclusiveness of transport services.

According to the Australian Bureau of Statistics, the main types of difficulties experienced by people with disability when using public transport relate to steps (39.9 per cent), difficulty getting to stops and stations (25 per cent), fear and anxiety (23.3 per cent) and lack of seating or difficulty standing (20.7 per cent).

Transport for NSW has a Disability Inclusion Action Plan (the Action Plan) 2018-2022 that sets an overall framework for planning, delivering and reporting on initiatives to increase accessibility of the transport network. It covers all elements of the journey experienced when using public transport, including journey planning, staff training, customer services and interaction between the physical environment and modes of transport. Appendix five outlines the guiding principles of the Action Plan.

Transport for NSW's Transport Social Policy branch developed the Action Plan in consultation with internal and external stakeholders. The director of the Transport Social Policy branch is a member of the TAP executive steering committee, which supports alignment between the Action Plan and TAP.

Transport for NSW's Disability Inclusion Action Plan describes a customer focussed approach to accessibility

One of the guiding principles of the Action Plan is ‘intelligent compliance’. Transport for NSW describes this as compliance that prioritises customer-focused outcomes over a narrow focus on legal compliance with accessibility standards. As well as being compliant, infrastructure should be practical, usable, fit for purpose and convenient. 

The TAP prioritisation and selection methodology reflects Transport for NSW’s focus on intelligent compliance. We consider this a reasonable approach as had Transport for NSW focussed exclusively on achieving compliance with the DSAPT targets by upgrading the most affordable infrastructure, some locations, that are used by more customers, would remain inaccessible to people with disability. However, this approach should not be seen as an alternative to Transport for NSW meeting its DSAPT compliance obligations.

TAP program staff consult with the Accessible Transport Advisory Committee

The Accessible Transport Advisory Committee (ATAC) has representatives from disability and ageing organisations, who provide expert guidance to Transport for NSW on access and inclusion. The ATAC provide guidance and feedback on projects and project solutions, including user testing where appropriate. TAP program staff provide regular updates at ATAC meetings, which include briefings on progress. The ATAC also provides feedback and suggestions to TAP program staff, which is considered and sometimes included in current and future projects.For example, in March 2017 the TAP program team briefed the ATAC on the challenges with respect to a number of ferry wharves and sought support for DSAPT exemptions proposed in the TAP 3 strategic business case.

Case study: Feedback on Braille lettering for lift buttons
In June 2018, the Program team sought feedback on a variety of lift button options to improve accessibility on future TAP projects. In September 2018, during the ATAC meeting attended by the Audit Office, the program team sought feedback on the standard designs for TAP 3. Some ATAC members noted that the standard design included Braille lettering on the lift buttons, and that this was not good practice because people can accidently press the button while reading it. As a result, Transport for NSW are incorporating this feedback into design requirements for the lifts for TAP 3, which will consider larger buttons, clearer Braille and Braille signage adjacent to the button.

Transport for NSW has not briefed the Advisory Committee on the outcome of the prioritisation and selection process

TAP program staff briefed the Advisory Committee about the prioritisation and selection methodology, after the Minister approved it in 2016. However, Transport for NSW have not briefed or consulted the Advisory Committee on the outcome of the prioritisation process. Infrastructure NSW noted this issue during its review of the strategic business case. 

Transport for NSW advised us that it established the ATAC as an advisory group, and that Transport for NSW does not disclose sensitive information to it. Transport for NSW intends to share the outcome of the prioritisation process following the completion of the TAP 3 development stage and final investment decision.

The TAP communication plan does not fully meet the requirements of the Disability Inclusion Action Plan

The Disability Inclusion Action Plan includes an action item to ‘provide a listing of stations and wharves to be upgraded with estimated time of construction as each new tranche of the Transport Access Program is announced’ The TAP Communication Plan that we reviewed does not include this provision instead focussing on communication on a per project basis. Given the long timeframes associated with improving transport infrastructure, this information is important as it allows people to make informed decisions about where they live, work or study.

Published

Actions for Newcastle Urban Transformation and Transport Program

Newcastle Urban Transformation and Transport Program

Transport
Planning
Compliance
Infrastructure
Management and administration
Procurement
Project management

The urban renewal projects on former railway land in the Newcastle city centre are well targeted to support the objectives of the Newcastle Urban Transformation and Transport Program (the Program), according to a report released today by the Auditor-General for New South Wales, Margaret Crawford. The planned uses of the former railway land achieve a balance between the economic and social objectives of the Program at a reasonable cost to the government. However, the evidence that the cost of the light rail will be justified by its contribution to the Program is not convincing.

The Newcastle Urban Transformation and Transport Program (the Program) is an urban renewal and transport program in the Newcastle city centre. The Hunter and Central Coast Development Corporation (HCCDC) has led the Program since 2017. UrbanGrowth NSW led the Program from 2014 until 2017. Transport for NSW has been responsible for delivering the transport parts of the Program since the Program commenced. All references to HCCDC in this report relate to both HCCDC and its predecessor, the Hunter Development Corporation. All references to UrbanGrowth NSW in this report relate only to its Newcastle office from 2014 to 2017.

This audit had two objectives:

  1. To assess the economy of the approach chosen to achieve the objectives of the Program.
  2. To assess the effectiveness of the consultation and oversight of the Program.

We addressed the audit objectives by answering the following questions:

a) Was the decision to build light rail an economical option for achieving Program objectives?
b) Has the best value been obtained for the use of the former railway land?
c) Was good practice used in consultation on key Program decisions?
d) Did governance arrangements support delivery of the program?

Conclusion
1. The urban renewal projects on the former railway land are well targeted to support the objectives of the Program. However, there is insufficient evidence that the cost of the light rail will be justified by its contribution to Program objectives.

The planned uses of the former railway land achieve a balance between the economic and social objectives of the Program at a reasonable cost to the Government. HCCDC, and previously UrbanGrowth NSW, identified and considered options for land use that would best meet Program objectives. Required probity processes were followed for developments that involved financial transactions. Our audit did not assess the achievement of these objectives because none of the projects have been completed yet.

Analysis presented in the Program business case and other planning documents showed that the light rail would have small transport benefits and was expected to make a modest contribution to broader Program objectives. Analysis in the Program business case argued that despite this, the light rail was justified because it would attract investment and promote economic development around the route. The Program business case referred to several international examples to support this argument, but did not make a convincing case that these examples were comparable to the proposed light rail in Newcastle.

The audited agencies argue that the contribution of light rail cannot be assessed separately because it is a part of a broader Program. The cost of the light rail makes up around 53 per cent of the total Program funding. Given the cost of the light rail, agencies need to be able to demonstrate that this investment provides value for money by making a measurable contribution to the Program objectives.

2. Consultation and oversight were mostly effective during the implementation stages of the Program. There were weaknesses in both areas in the planning stages.

Consultations about the urban renewal activities from around 2015 onward followed good practice standards. These consultations were based on an internationally accepted framework and met their stated objectives. Community consultations on the decision to close the train line were held in 2006 and 2009. However, the final decision in 2012 was made without a specific community consultation. There was no community consultation on the decision to build a light rail.

The governance arrangements that were in place during the planning stages of the Program did not provide effective oversight. This meant there was not a single agreed set of Program objectives until 2016 and roles and responsibilities for the Program were not clear. Leadership and oversight improved during the implementation phase of the Program. Roles and responsibilities were clarified and a multi-agency steering committee was established to resolve issues that needed multi-agency coordination.
The light rail is not justified by conventional cost-benefit analysis and there is insufficient evidence that the indirect contribution of light rail to achieving the economic development objectives of the Program will justify the cost.
Analysis presented in Program business cases and other planning documents showed that the light rail would have small transport benefits and was expected to make a modest contribution to broader Program objectives. Analysis in the Program business case argued that despite this, the light rail was justified because it would attract investment and promote economic development around the route. The Program business case referred to several international examples to support this argument, but did not make a convincing case that these examples were comparable to the proposed light rail in Newcastle.
The business case analysis of the benefits and costs of light rail was prepared after the decision to build light rail had been made and announced. Our previous reports, and recent reports by others, have emphasised the importance of completing thorough analysis before announcing infrastructure projects. Some advice provided after the initial light rail decision was announced was overly optimistic. It included benefits that cannot reasonably be attributed to light rail and underestimated the scope and cost of the project.
The audited agencies argue that the contribution of light rail cannot be assessed separately because it is part of a broader Program. The cost of the light rail makes up around 53 per cent of the total Program funding. Given the high cost of the light rail, we believe agencies need to be able to demonstrate that this investment provides value for money by making a measurable contribution to the Program objectives.

Recommendations
For future infrastructure programs, NSW Government agencies should support economical decision-making on infrastructure projects by:
  • providing balanced advice to decision makers on the benefits and risks of large infrastructure investments at all stages of the decision-making process
  • providing scope and cost estimates that are as accurate and complete as possible when initial funding decisions are being made
  • making business cases available to the public.​​​​​​
The planned uses of the former railway land achieve a balance between the economic and social objectives of the Program at a reasonable cost to the government.

The planned uses of the former railway land align with the objectives of encouraging people to visit and live in the city centre, creating attractive public spaces, and supporting growth in employment in the city. The transport benefits of the activities are less clear, because the light rail is the major transport project and this will not make significant improvements to transport in Newcastle.

The processes used for selling and leasing parts of the former railway land followed industry standards. Options for the former railway land were identified and assessed systematically. Competitive processes were used for most transactions and the required assessment and approval processes were followed. The sale of land to the University of Newcastle did not use a competitive process, but required processes for direct negotiations were followed.

Recommendation
By March 2019, the Hunter and Central Coast Development Corporation should:
  • work with relevant stakeholders to explore options for increasing the focus on the heritage objective of the Program in projects on the former railway land. This could include projects that recognise the cultural and industrial heritage of Newcastle.
Consultations about the urban renewal activities followed good practice standards, but consultation on transport decisions for the Program did not.

Consultations focusing on urban renewal options for the Program included a range of stakeholders and provided opportunities for input into decisions about the use of the former railway land. These consultations received mostly positive feedback from participants. Changes and additions were made to the objectives of the Program and specific projects in response to feedback received. 

There had been several decades of debate about the potential closure of the train line, including community consultations in 2006 and 2009. However, the final decision to close the train line was made and announced in 2012 without a specific community consultation. HCCDC states that consultation with industry and business representatives constitutes community consultation because industry representatives are also members of the community. This does not meet good practice standards because it is not a representative sample of the community.

There was no community consultation on the decision to build a light rail. There were subsequent opportunities for members of the community to comment on the implementation options, but the decision to build it had already been made. A community and industry consultation was held on which route the light rail should use, but the results of this were not made public. 

Recommendation
For future infrastructure programs, NSW Government agencies should consult with a wide range of stakeholders before major decisions are made and announced, and report publicly on the results and outcomes of consultations. 

The governance arrangements that were in place during the planning stages of the Program did not provide effective oversight. Project leadership and oversight improved during the implementation phase of the Program.

Multi-agency coordination and oversight were ineffective during the planning stages of the Program. Examples include: multiple versions of Program objectives being in circulation; unclear reporting lines for project management groups; and poor role definition for the initial advisory board. Program ownership was clarified in mid-2016 with the appointment of a new Program Director with clear accountability for the delivery of the Program. This was supported by the creation of a multi-agency steering committee that was more effective than previous oversight bodies.

The limitations that existed in multi-agency coordination and oversight had some negative consequences in important aspects of project management for the Program. This included whole-of-government benefits management and the coordination of work to mitigate impacts of the Program on small businesses.

Recommendations
For future infrastructure programs, NSW Government agencies should: 

  • develop and implement a benefits management approach from the beginning of a program to ensure responsibility for defining benefits and measuring their achievement is clear
  • establish whole-of-government oversight early in the program to guide major decisions. This should include:
    • agreeing on objectives and ensuring all agencies understand these
    • clearly defining roles and responsibilities for all agencies
    • establishing whole-of-government coordination for the assessment and mitigation of the impact of major construction projects on businesses and the community.

By March 2019, the Hunter and Central Coast Development Corporation should update and implement the Program Benefits Realisation Plan. This should include:

  • setting measurable targets for the desired benefits
  • clearly allocating ownership for achieving the desired benefits
  • monitoring progress toward achieving the desired benefits and reporting publicly on the results.

Appendix one - Response from agencies    

Appendix two - About the audit

Appendix three - Performance auditing

 

Parliamentary reference - Report number #310 - released 12 December 2018