Reports
Ensuring contract management capability in government - HealthShare NSW
This report examined whether HealthShare NSW, a part of NSW Health, has the required contract management capability to effectively manage goods and services contracts valued over $250,000.
The report found that HealthShare has a procurement framework that should support effective contract management, but it is not applying it consistently. In particular, the audit found that HealthShare was not applying key contract management elements to over 80 per cent of the high-value contracts it manages. The audit also found that HealthShare’s contract management practices were limited by inadequate performance monitoring.
'Effective contract management is essential to ensure the contracts HealthShare enters into are delivering as expected and ensuring value for money,' said the Auditor-General. 'Without this, the value for money or savings HealthShare achieves when it negotiates these contracts is at risk of being eroded over the life of the contract.'
The report recommends that NSW Health develop a performance improvement plan to ensure HealthShare is fully compliant with procurement policies and that NSW Health meets its obligations under the Government's Accreditation Program for Goods and Services Procurement.
HealthShare is a NSW Health entity responsible for providing shared services, including procurement, to support the delivery of patient care within the NSW health system. In 2018, HealthShare procured high value goods and services contracts with an annual estimated total spend of around $1.8 billion, with most of the contracts of long duration.
NSW Government agencies are increasingly delivering services and projects through contracts with third parties. These contracts can be complex and governments face challenges in negotiating and implementing them effectively. A robust contract management framework helps ensure all parties meet their obligations, contractual relationships are well managed, agencies achieve value for money, and deliverables meet the required standards and agreed timeframes.
Contract management capability is a broad term, which can include aspects of individual staff capability (such as staff knowledge, skills and experience) as well as organisational capability (such as policies, frameworks and processes).
The NSW Procurement Board is responsible for overseeing the Government's procurement system, setting policy and ensuring compliance. It has accredited the Health Administration Corporation (HAC) to procure goods and services with no upper financial limit. Under the terms of this accreditation, the Secretary, NSW Health (as head of HAC) has delegated the procurement of high-value (over $250,000) goods and services contracts within NSW Health to only the Ministry of Health and HealthShare NSW (HealthShare).
HealthShare NSW (HealthShare) is a NSW Health entity responsible for providing shared services, including procurement, to support the delivery of patient care within the NSW health system. In 2018, HealthShare procured high-value goods and services contracts with an annual estimated total spend of around $1.8 billion, with most of the contracts of long duration.
HealthShare’s Contract Management Guide states that, without rigorous contract management, 75 per cent of projected sourcing savings can disappear within 18 months of the contract starting.
This audit examined whether HealthShare has the required capability to effectively manage high-value goods and services contracts. Contracts we examined included critical items such as food services in hospitals, patient transport services, intravenous equipment and kidney dialysis services, where risks include patient safety as well as value for money. We did not examine infrastructure, construction or information communication and technology contracts. We also did not examine HealthShare’s sourcing processes, including identifying business needs, tendering and contract award.
We assessed HealthShare against the following criteria:
- HealthShare's systems, policies and procedures support effective contract management and are consistent with relevant frameworks, policies and guidelines.
- HealthShare has capable personnel to effectively conduct the monitoring activities throughout the life of the contract.
We included the NSW Public Service Commission and NSW Treasury, through NSW Procurement, as auditees because they administer policies which directly affect contract management capability. These include:
- NSW Procurement Board Directions and policies
- NSW Government Procurement Policy Framework
- Accreditation Program for Goods and Services Procurement
- the NSW Public Sector Capability Framework.
NSW Procurement was transferred to NSW Treasury from the former Department of Finance, Services and Innovation on 1 July 2019 as part of changes to government administrative arrangements.
Appendix one – Response from agencies
Appendix two – Contract performance management summary
Appendix three – About the audit
Appendix four – Performance auditing
© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.
Parliamentary Reference: Report number #328 - released 31 October 2019
Ensuring teaching quality in NSW public schools
The Auditor-General for New South Wales, Margaret Crawford, has released a report on how the New South Wales Education and Standards Authority (NESA) and the Department of Education (the Department) ensure teaching quality in NSW public schools.
Around 2,200 NSW public school principals are responsible for accrediting their teachers in line with the Australian Professional Standards for Teachers. The report found that NESA does not oversight principals’ decisions to ensure that minimum standards for teaching quality are consistently met.
The Department does not effectively monitor teaching quality across the state. With limited data, it is difficult for the Department to ensure its strategies to improve teaching quality are appropriately targeted to improve teaching quality.
The Department’s Performance and Development Framework does not adequately support principals and supervisors to effectively manage and improve teacher performance or actively improve teaching quality. The Department manages those teachers formally identified as underperforming through teacher improvement programs. Only 53 of over 66,000 teachers employed by the Department were involved in these programs in 2018.
The report makes three recommendations towards NESA to improve accreditation processes, and four recommendations to the Department to improve its systems and processes for ensuring teaching quality across the State.
Australian research has shown that quality teaching is the greatest in-school influence on student engagement and outcomes, accounting for 30 per cent of the variance in student performance. An international comparative study of 15-year-old students showed the performance of New South Wales students in reading, mathematics and science has declined between 2006 and 2015.
The Australian Professional Standards for Teachers (the Standards) describe the knowledge, skills and understanding expected of effective teachers at different career stages. Teachers must be accredited against the Standards to be employed in NSW schools. The NSW Education Standards Authority (NESA) is responsible for ensuring all teachers in NSW schools are accredited. As part of the accreditation process the NSW Department of Education (The Department) assesses whether public school teachers meet proficient accreditation standards and advises NESA of its decisions.
The School Excellence Framework provides a method for the Department to monitor teaching quality at a school level across four elements of effective teaching practice. The Performance and Development Framework provides a method for teachers and their supervisors to monitor and improve teaching quality through setting professional goals to guide their performance and development.
The Department has a strategic goal that every student, every teacher, every leader and every school improves every year. In line with this goal, the Department has a range of strategies targeted to improving teaching quality at different career stages. These include additional resources to support new teachers, a program to support teachers to gain higher-level accreditation, support for principals to manage underperforming teachers, and a professional learning program where teachers observe and discuss each other's practice.
The objective of this audit was to assess the effectiveness of the NSW Department of Education's and the NSW Education Standards Authority's arrangements to ensure teaching quality in NSW public schools. To address this objective, the audit examined whether:
- agencies effectively monitor the quality of teaching in NSW public schools
- strategies to improve the quality of teaching are planned, communicated, implemented and monitored well.
Appendix one – Response from agencies
Appendix two – About the audit
Appendix three – Performance auditing
© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.
Parliamentary Reference: Report number #327 - released 26 September 2019
Ensuring contract management capability in government - Department of Education
This report examines whether the Department of Education has the required contract management capability to effectively manage high-value goods and services contracts (over $250,000). In 2017–18, the department managed high-value goods and services contracts worth $3.08 billion, with most of the contracts running over multiple years.
NSW government agencies are increasingly delivering services and projects through contracts with third parties. These contracts can be complex and governments face challenges in negotiating and implementing them effectively.
Contract management capability is a broad term, which can include aspects of individual staff capability as well as organisational capability (such as policies, frameworks and processes).
In 2017–18, the Department of Education (the Department) managed high-value (over $250,000) goods and services contracts worth $3.08 billion, with most of the contracts running over multiple years. The Department delivers, funds and regulates education services for NSW students from early childhood to secondary school.
This audit examined whether the Department has the required capability to effectively manage high-value goods and services contracts.
We did not examine infrastructure, construction or information communication and technology contracts. We assessed the Department against the following criteria:
- The Department’s policies and procedures support effective contract management and are consistent with relevant frameworks, policies and guidelines.
- The Department has capable personnel to effectively conduct the monitoring activities throughout the life of the contract.
The NSW Public Service Commission and the Department of Finance, Services and Innovation are included as auditees as they administer policies which directly affect contract management capability, including:
- NSW Procurement Board Directions and policies
- NSW Procurement Agency Accreditation Scheme
- NSW Public Sector Capability Framework.
The Department of Finance, Services and Innovation's responsibility for NSW Procurement will transfer to NSW Treasury on 1 July 2019 as part of changes to government administrative arrangements announced on 2 April 2019 and amended on 1 May 2019.
|
Conclusion The Department of Education's procedures and policies for goods and services contract management are consistent with relevant guidance. It also has a systemic approach to defining the capability required for contract management roles. That said, there are gaps in how well the Department uses this capability to ensure its contracts are performing. We also found one program (comprising 645 contracts) that was not compliant with the Department's policies. The Department has up-to-date policies and procedures that are consistent with relevant guidance. The Department also communicates changes to procurement related policies, monitors compliance with policies and conducts regular reviews aiming to identify non-compliance. The Department uses the NSW Public Service Commission's capability framework to support its workforce management and development. The capability framework includes general contract management capability for all staff and occupation specific capabilities for contract managers. The Department also provides learning and development for staff who manage contracts to improve their capability. The Department provides some guidance on different ways that contract managers can validate performance information provided by suppliers. However, the Department does not provide guidance to assist contract managers to choose the best validation strategy according to contract risk. This could lead to inconsistent practice and contracts not delivering what they are supposed to. We found that none of the 645 contracts associated with the Assisted Schools Travel Program (estimated value of $182 million in 2018–19) have contract management plans. This is contrary to the Department's policies and increases the risk that contract managers are not effectively reviewing performance and resolving disputes. |
Appendix one - Response from agencies
Appendix two - About the audit
Appendix three - Performance auditing
Parliamentary Reference: Report number #325 - released 28 June 2019
Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.
Managing native vegetation
The report found the clearing of native vegetation on rural land is not effectively regulated and managed. The processes supporting the regulatory framework are weak and there is no evidence-based assurance that clearing of native vegetation is carried out in accordance with approvals.
In 2014 an expert panel completed a review of biodiversity legislation in NSW. The panel’s recommendations included repealing the Native Vegetation Act 2003, proposing a new Act with the goal of maintaining a healthy, productive and resilient environment for the greatest wellbeing of the community, and recommending that management of native vegetation in the context of existing agricultural management would be assisted and supervised by Local Land Services (LLS).
Following the panel report, the NSW Government undertook major biodiversity conservation and land management reforms which saw the introduction of the Biodiversity Conservation Act 2016 (NSW) and the Local Land Services Amendment Act 2016 (NSW). The reforms commenced in August 2017. The Native Vegetation Act 2003, the Threatened Species Conservation Act 1995, the Nature Conservation Trust Act 2001, and parts of the National Parks and Wildlife Act 1974 were repealed.
Under the legislative reforms, the Biodiversity Conservation Act 2016 and Local Land Services Amendment Act 2016, which amended the Local Land Services Act 2013, aim to ensure a balanced approach to land management and biodiversity conservation in NSW.
A core objective of the Biodiversity Conservation Act 2016 is to conserve biodiversity at bioregional and state scales. A core objective of the Local Land Service Act 2013 is to ensure the proper management of natural resources in the social, economic and environmental interests of the state, consistently with the principles of ecologically sustainable development.
The integrated package of reforms included:
- new arrangements that allow land owners to improve productivity while responding to environmental risks
- new ways to assess and manage the biodiversity impacts of development
- a new state Environmental Planning Policy for managing impacts on native vegetation in urban areas
- significant investment in conservation of private land
- a risk-based system for regulating human and business interactions with native plants and animals
- streamlined approvals and dedicated resources to help reduce the regulatory burden.
Transition to this land management framework began on 25 August 2017 with the commencement of the Land Management (Native Vegetation) Code.
The overall objectives of the reforms are:
- to arrest and ultimately reverse the current decline in the state’s biodiversity while facilitating ecologically sustainable development, in particular efficient and sustainable agricultural development
- enable landholders to improve the efficiency of their agricultural systems and take a more active role in providing incentive and supporting landholders to improve the condition and function of their ecological systems.
The objective of this audit is to assess whether the clearing of native vegetation in rural areas is effectively regulated and managed by the Office of Environment and Heritage (OEH) and LLS under these legislative frameworks. The audit also examined the progress of the Biodiversity Conservation Trust in implementing the Biodiversity Conservation Investment Strategy as a counterbalance to rural land clearing.
At the time of this audit OEH was responsible for preparing the Native Vegetation Regulatory map and for compliance enforcement in relation to unlawful land clearing. Post 1 July 2019, under machinery of government changes, OEH will be abolished and its activities relevant to this audit will be moved to the new Department of Planning, Industry and Environment. For the purposes of this audit we will continue to refer to it as OEH.
|
Conclusion
The clearing of native vegetation on rural land is not effectively regulated and managed because the processes in place to support the regulatory framework are weak. There is no evidence-based assurance that clearing of native vegetation is being carried out in accordance with approvals. Responses to incidents of unlawful clearing are slow, with few tangible outcomes. Enforcement action is rarely taken against landholders who unlawfully clear native vegetation. There are processes in place for approving land clearing but there is limited follow-up to ensure approvals are complied with. Procedures and systems are in place for assessing applications and issuing approvals for land clearing. Approvals contain conditions for managing clearing and setting aside land for conservation as a counterbalance to permitted clearing.
There is limited follow-up or capacity to gauge whether landholders are complying with the conditions of approvals and effectively managing areas of their land that have been set aside for conservation (i.e. 'set asides').
Certificate assessments are used to grant landholders permission to clear. All assessments we reviewed generally complied with the Land Management (Native Vegetation) Code 2018 (the Code).
The rules around land clearing may not be responding adequately to environmental risks.
The Code, which contains conditions under which the thinning or clearing of native vegetation can be approved on regulated land, is intended to allow landholders to improve productivity while responding to environmental risks. That said, it may not be achieving this balance. For example, the Code allows some native species to be treated as ‘invasive’ when they may not be invading an area, provides little protection for groundcover and limited management requirements for set asides. There is also limited ability under the Code to reject applications for higher risk clearing proposals. The release of the Native Vegetation Regulatory (NVR) map has been delayed, limiting landholders' ability to determine if their plans for clearing are lawful.
OEH has applied significant effort in developing a native vegetation regulatory map to guide landholders on which land they can and can’t clear without approval. However, in November 2016 the then Minister for Primary Industries advised Parliament that the two largest land categories of the NVR map will not come into effect until the relevant Ministers are satisfied stakeholders have sufficient confidence in the maps’ accuracy. Not releasing the map has made it harder for landholders to identify the portions of their land that are regulated and ensure they comply with land clearing rules. It has also limited OEH’s ability to consult on and improve the accuracy of the map. There are significant delays in identifying unlawful clearing and few penalties imposed.
Unexplained land clearing can take over two years to identify and analyse, making it difficult to minimise environmental harm or gather evidence to prosecute unlawful clearing. Despite around 1,000 instances of unexplained clearing identified by OEH and over 500 reports to the environmental hotline each year, with around 300 investigations in progress at any one time, there are only two to three prosecutions, three to five remediation orders and around ten penalty notices issued each year for unlawful clearing. Further, OEH is yet to commence any prosecutions under the current legislation which commenced in August 2017. Land clearing and private land conservation investment have both increased.
Clearing of native vegetation has increased in recent years. At the same time, the government is also investing in properties with high environmental value with a focus on improving the mix of endangered ecological communities conserved in perpetuity. Processes are in place for identifying and prioritising areas of land for investment but the funding provided to each region is not always consistent with these priorities. |
Local Land Services (LLS) is responsible for processing notifications and issuing certificates to landholders for managing the thinning or clearing of native vegetation on rural land through the ‘Land Management (Native Vegetation) Code 2018’ (the Code). This work includes monitoring and reporting on the implementation of the Code, including the establishment and management of set asides.
OEH is responsible for compliance and enforcement in relation to unlawful land clearing. It is also responsible for producing the NVR map, designed to show landholders where land clearing can occur without approval, where approval is required, and where land clearing is not permitted. Post 1 July 2019, under machinery of government changes, OEH will be abolished and its activities relevant to this audit will be moved to the new Department of Planning, Industry and Environment.
Appendix one - Response from agencies
Appendix three - About the audit
Appendix four - Performance auditing
Parliamentary Reference: Report number #324 - released 27 June 2019
Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.
Contracting non-government organisations
This report found the Department of Family and Community Services (FACS) needs to do more to demonstrate it is effectively and efficiently contracting NGOs to deliver community services in the Permanency Support Program (a component of out-of-home-care services) and Specialist Homelessness Services. It notes that FACS is moving to an outcomes-based commissioning model and recommends this be escalated consistent with government policy.
Government agencies, such as the Department of Family and Community Services (FACS), are increasingly contracting non-government organisations (NGOs) to deliver human services in New South Wales. In doing so, agencies are responsible for ensuring these services are achieving expected outcomes. Since the introduction of the Commissioning and Contestability Policy in 2016, all NSW Government agencies are expected to include plans for customer and community outcomes and look for ways to use contestability to raise standards.
Two of the areas receiving the greatest funding from FACS are the Permanency Support Program and Specialist Homelessness Services. In the financial year 2017–18, nearly 500 organisations received $784 million for out-of-home care programs, including the Permanency Support Program. Across New South Wales, specialist homelessness providers assist more than 54,000 people each year and in the financial year 2017–18, 145 organisations received $243 million for providing short term accommodation and homelessness support, including Specialist Homelessness Services.
In the financial year 2017–18, FACS entered into 230 contracts for out-of-home care, of which 49 were for the Permanency Support Program, representing $322 million. FACS also entered into 157 contracts for the provision of Specialist Homelessness Services which totalled $170 million. We reviewed the Permanency Support Program and Specialist Homelessness Services for this audit.
This audit assessed how effectively and efficiently FACS contracts NGOs to deliver community services. The audit could not assess how NGOs used the funds they received from FACS as the Audit Office does not have a mandate that could provide direct assurance that NGOs are using government funds effectively.
|
Conclusion
FACS cannot demonstrate it is effectively and efficiently contracting NGOs to deliver community services because it does not always use open tenders to test the market when contracting NGOs, and does not collect adequate performance data to ensure safe and quality services are being provided. While there are some valid reasons for using restricted tenders, it means that new service providers are excluded from consideration - limiting contestability. In the service delivery areas we assessed, FACS does not measure client outcomes as it has not yet moved to outcomes-based contracts. FACS' procurement approach sometimes restricts the selection of NGOs for the Permanency Support Program and Specialist Homelessness Services
FACS has a procurement policy and plan which it follows when contracting NGOs for the provision of human services. This includes the option to use restricted tenders, which FACS sometimes uses rather than opening the process to the market. The use of restricted tenders is consistent with its procurement plan where there is a limited number of possible providers and the services are highly specialised. However, this approach perpetuates existing arrangements and makes it very difficult for new service providers to enter the market. The recontracting of existing providers means FACS may miss the opportunity to benchmark existing providers against the whole market. FACS does not effectively use client data to monitor the performance of NGOs funded under the Permanency Support Program and Specialist Homelessness Services
FACS' contract management staff monitor individual NGO performance including safety, quality of services and compliance with contract requirements. Although FACS does provide training materials on its intranet, FACS does not provide these staff with sufficient training, support or guidance to monitor NGO performance efficiently or effectively. FACS also requires NGOs to self-report their financial performance and contract compliance annually. FACS verifies the accuracy of the financial data but conducts limited validation of client data reported by NGOs to verify its accuracy. Instead, FACS relies on contract management staff to identify errors or inaccurate reporting by NGOs. FACS' ongoing monitoring of the performance of providers under the Permanency Support Program is particularly limited due to problems with timely data collection at the program level. This reduces FACS' ability to monitor and analyse NGO performance at the program level as it does not have access to ongoing performance data for monitoring service quality. In the Specialist Homelessness Services program, FACS and NGOs both provide the data required for the National Minimum Data Set on homelessness and provide it to the Australian Institute of Health and Welfare, as they are required to do. However, this data is not used for NGO performance monitoring or management. FACS does not yet track outcomes for clients of NGOs
FACS began to develop an approach to outcomes-based contracting in 2015. Despite this, none of the contracts we reviewed are using outcomes as a measure of success. Currently, NGOs are required to demonstrate their performance is consistent with the measures stipulated in their contracts as part of an annual check of their contract compliance and financial accounts. NGOs report against activity-based measures (Key Performance Indicators) and not outcomes. FACS advises that the transition to outcomes-based contracting will be made with the new rounds of funding which will take place in 2020–2021 for Specialist Homelessness Services and 2023 for the Permanency Support Program. Once these contracts are in place, FACS can transition NGOs to outcomes based reporting. Incomplete data limits FACS' effectiveness in continuous improvement for the Permanency Support Program and Specialist Homelessness Services
FACS has policies and procedures in place to learn from past experiences and use this to inform future contracting decisions. However, FACS has limited client data related to the Permanency Support Program which restricts the amount of continuous improvement it can undertake. In the Specialist Homelessness Support Program data is collected to inform routine contract management discussions with service providers but FACS is not using this data for continuous improvement. |
Appendix one – Response from agency
Appendix two – About the audit
Appendix three – Performance auditing
Parliamentary Reference: Report number #323 - released 26 June 2019
Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.
Coal Mining Royalties
Department of Industry and Investment cannot assure the people of NSW that all royalties owed are being paid in full. This is because it does not have sufficiently robust systems and processes to identify what is owed and to make sure it is paid.
Parliamentary reference - Report number #208 - released 30 November 2010
Helicopter Emergency Medical Service Contract
We found that the contract process was satisfactory. Ambulance data show that the performance of CHC is meeting contract requirements with the exception of the availability of the Wollongong helicopter. Ambulance’s ability to transport patients to the right hospital at the right time has improved. However the cost of the new Greater Sydney helicopter contract is three times higher than before.
Parliamentary reference - Report number #206 - released 22 September 2010
Protecting the Environment: Pollution Incidents
The department has a systematic approach to receiving, investigating and responding to reports of pollution incidents. However, the department does not analyse and report on the extent of environmental harm caused by pollution incidents reported to it, whether its response has minimised harm to the environment, whether its regulatory approach has improved compliance, particularly by Environment Protection Licence (EPL) holders (licensees).
Parliamentary reference - Report number #205 - released 15 September 2010
Improving the Performance of Metropolitan Bus Services
The 2004 Review of Bus Services in NSW always envisaged that there would be a transition period as the new bus contracts were introduced. NSWTI has developed and implemented the new arrangements, and pursued a range of new initiatives including the network improvement program, strategic corridors and uniform bus fares and concessions. The new contracts provided for a performance management regime to hold operators accountable. But this is still being developed four years after the bus contracts came into effect and it remains unproven as a basis for ensuring value for money from the contracts - each of which guarantees monopoly rights to the operators.
Parliamentary reference - Report number #198 - released 10 March 2010
Working With Children Check
To be effective the WWCC has to be thorough. Gaps in the checking process such as employers not checking everyone they should mean that people who may pose a risk to children are not identified. We found that the WWCC does not reliably identify all those who may pose a risk to children. Audit conclusion and recommendations Working With Children Check 3 In addition, we found the Commission does not monitor the compliance of employers, the self-employed or volunteer organisations with their obligations or have a formal strategy to promote awareness of the WWCC.
Parliamentary reference - Report number #196 - released 24 February 2010
