Reports
Matching skills training with market needs
In 2012, governments across Australia entered into the National Partnership Agreement on Skills Reform. Under the National Partnership Agreement, the Australian Government provided incentive payments to States and Territories to move towards a more contestable Vocational Education and Training (VET) market. The aim of the National Partnership Agreement was to foster a more accessible, transparent, efficient and high quality training sector that is responsive to the needs of students and industry.
The New South Wales Government introduced the Smart and Skilled program in response to the National Partnership Agreement. Through Smart and Skilled, students can choose a vocational course from a list of approved qualifications and training providers. Students pay the same fee for their chosen qualification regardless of the selected training provider and the government covers the gap between the student fee and the fixed price of the qualification through a subsidy paid to their training provider.
Smart and Skilled commenced in January 2015, with the then Department of Education and Communities having primary responsibility for its implementation. Since July 2015, the NSW Department of Industry (the Department) has been responsible for VET in New South Wales and the implementation of Smart and Skilled.
The NSW Skills Board, comprising nine part-time members appointed by the Minister for Skills, provides independent strategic advice on VET reform and funding. In line with most other States and Territories, the Department maintains a 'Skills List' which contains government subsidised qualifications to address identified priority skill needs in New South Wales.
This audit assessed the effectiveness of the Department in identifying, prioritising, and aligning course subsidies to the skill needs of NSW. To do this we examined whether:
- the Department effectively identifies and prioritises present and future skill needs
- Smart and Skilled funding is aligned with the priority skill areas
- skill needs and available VET courses are effectively communicated to potential participants and training providers.
Smart and Skilled is a relatively new and complex program, and is being delivered in the context of significant reform to VET nationally and in New South Wales. A large scale government funded contestable market was not present in the VET sector in New South Wales before the introduction of Smart and Skilled. This audit's findings should be considered in that context.
The Department needs to better use the data it has, and collect additional data, to support its analysis of priority skill needs in New South Wales, and direct funding accordingly.
- funding scholarships and support for disadvantaged students
- funding training in regional and remote areas
- providing additional support to deliver some qualifications that the market is not providing.
The Department needs to evaluate these funding strategies to ensure they are achieving their goals. It should also explore why training providers are not delivering some priority qualifications through Smart and Skilled.
Training providers compete for funding allocations based on their capacity to deliver. The Department successfully manages the budget by capping funding allocated to each Smart and Skilled training provider. However, training providers have only one year of funding certainty at present. Training providers that are performing well are not rewarded with greater certainty.
The Department needs to improve its communication with prospective students to ensure they can make informed decisions in the VET market.
The Department also needs to communicate more transparently to training providers about its funding allocations and decisions about changes to the NSW Skills List.
The Department relies on stakeholder proposals to update the NSW Skills List. Stakeholders include industry, training providers and government departments. These stakeholders, particularly industry, are likely to be aware of skill needs, and have a strong incentive to propose qualifications that address these needs. The Department’s process of collecting stakeholder proposals helps to ensure that it can identify qualifications needed to address material skill needs.
It is also important that the Department ensures the NSW Skills List only includes priority qualifications that need to be subsidised by government. The Department does not have robust processes in place to remove qualifications from the NSW Skills List. As a result, there is a risk that the list may include lower priority skill areas. Since the NSW Skills List was first created, new additions to the list have outnumbered those removed by five to one.
The Department does not always validate information gathered from stakeholder proposals, even when it has data to do so. Further, its decision making about what to include on, or delete from, the NSW Skills List is not transparent because the rationale for decisions is not adequately documented.
The Department is undertaking projects to better use data to support its decisions about what should be on the NSW Skills List. Some of these projects should deliver useful data soon, but some can only provide useful information when sufficient trend data is available.
Recommendation
The Department should:
- by June 2019, increase transparency of decisions about proposed changes to the NSW Skills List and improve record-keeping of deliberations regarding these changes
- by December 2019, use data more effectively and consistently to ensure that the NSW Skills List only includes high priority qualifications
Only qualifications on the NSW Skills List are eligible for subsidies under Smart and Skilled. As the Department does not have a robust process for removing low priority qualifications from the NSW Skills list, some low priority qualifications may be subsidised.
The Department allocates the Smart and Skilled budget through contracts with Smart and Skilled training providers. Training providers that meet contractual obligations and perform well in terms of enrolments and completion rates are rewarded with renewed contracts and more funding for increased enrolments, but these decisions are not based on student outcomes. The Department reduces or removes funding from training providers that do not meet quality standards, breach contract conditions or that are unable to spend their allocated funding effectively. Contracts are for only one year, offering training providers little funding certainty.
Smart and Skilled provides additional funding for scholarships and for training providers in locations where the cost of delivery is high or to those that cater to students with disabilities. The Department has not yet evaluated whether this additional funding is achieving its intended outcomes.
Eight per cent of the qualifications that have been on the NSW Skills List since 2015 are not delivered under Smart and Skilled anywhere in New South Wales. A further 14 per cent of the qualifications that are offered by training providers have had no student commencements. The Department is yet to identify the reasons that these high priority qualifications are either not offered or not taken up by students.
Recommendation
The Department should:
- by June 2019, investigate why training providers do not offer, and prospective students do not enrol in, some Smart and Skilled subsidised qualifications
- by December 2019, evaluate the effectiveness of Smart and Skilled funding which supplements standard subsidies for qualifications on the NSW Skills List, to determine whether it is achieving its objectives
- by December 2019, provide longer term funding certainty to high performing training providers, while retaining incentives for them to continue to perform well.
In a contestable market, it is important for consumers to have sufficient information to make informed decisions. The Department does not provide some key information to prospective VET students to support their decisions, such as measures of provider quality and examples of employment and further education outcomes of students completing particular courses. Existing information is spread across numerous channels and is not presented in a user friendly manner. This is a potential barrier to participation in VET for those less engaged with the system or less ICT literate.
The Department conveys relevant information about the program to training providers through its websites and its regional offices. However, it could better communicate some specific information directly to individual Smart and Skilled training providers, such as reasons their proposals to include new qualifications on the NSW Skills List are accepted or rejected.
While the Department is implementing a communication strategy for VET in New South Wales, it does not have a specific communications strategy for Smart and Skilled which comprehensively identifies the needs of different stakeholders and how these can be addressed.
Recommendation
By December 2019, the Department should develop and implement a specific communications strategy for Smart and Skilled to:
- support prospective student engagement and informed decision making
- meet the information needs of training providers
Appendix one - Response from agency
Appendix two - About the audit
Appendix three - Performance auditing
Parliamentary reference - Report number #305 - released 26 July 2018
Implementation of the NSW Government’s program evaluation initiative
The NSW Government’s ‘program evaluation initiative’, introduced to assess whether service delivery programs achieve expected outcomes and value for money, is largely ineffective according to a report released today by NSW Auditor-General, Margaret Crawford.
Government services, in areas such as public order and safety, health and education, are delivered by agencies through a variety of programs. In 2016–17, the NSW Government estimates that it will spend over $73 billion on programs to deliver services.
Parliamentary reference - Report number #277 - released 3 November 2016
Performance frameworks in custodial centre operations
The effectiveness of Corrective Services NSW’s performance framework is limited because organisational key performance indicators (KPIs) do not cascade to public correctional centres, according to a report released today by the Acting New South Wales Auditor-General, Tony Whitfield.
'As a result, individual public correctional centres could not be assessed on how well they are contributing to overall Corrective Service objectives, and it is difficult to vary performance expectations in response to changing operating environments', said Mr Whitfield. 'Its commissioning and contestability project is designed to address these issues', he added.
Parliamentary reference - Report number #267 - released 3 March 2016
Country towns water supply and sewerage program
The Country Towns Water Supply and Sewerage Program has effectively promoted adoption of better management practices by local water utilities, but will not achieve its objective of eliminating the water supply and sewerage infrastructure backlog in urban areas of country NSW.
The $1.2 billion Program aims to help local water utilities provide appropriate, affordable, cost effective and well-managed water supply and sewerage services in the urban areas of country NSW. It has two broad elements:
- promoting adoption of better practices
- providing financial assistance towards the capital cost of infrastructure backlog works.
Parliamentary reference - Report number #251 - released 4 May 2015
Vocational education and training reform
The Department’s framework for VET reform has the potential to effectively achieve the government’s immediate objectives for the reform, which are associated with meeting its commitments under the National Partnership Agreement for Skills Reform without spending more. We found that the government is addressing VET reform objectives in the following order of priority: no extra cost (budget neutrality), TAFE viability, quality VET, access to VET for regions and equity groups, more contestability, student choice. Overall, we conclude that a more balanced approach, by putting more emphasis on increased contestability and student choice, is more likely to maximise the public value for the government’s investment in VET.
Parliamentary reference - Report number #249 - released 29 January 2015
Northside Storage Tunnel Project
The Northside Storage Tunnel was the first major public sector construction project using an alliance approach. In our opinion, the outcome of the project suggests that an alliance approach, when applied to a suitable project and managed appropriately, can support positive project outcomes. And in many respects the Alliance worked well. There are, however, a number of issues that we believe need to be addressed for future alliances.
Parliamentary reference - Report number #113 - released 24 July 2003
The Police Assistance Line
We are of the opinion that overall, the Police Assistance Line (PAL) has contributed to improving the efficiency and effectiveness of NSW Police. Through civilianisation of call taking, NSW Police reports that the cost of handling a minor crime report has been reduced by 65 per cent, to around $21 per call. It is also estimated that PAL has contributed to the release of over 200 police to operational duties. There has also been an improvement in customer service since PAL commenced, with the average time taken to answer a call reduced from over two minutes to 42 seconds. However, performance is still outside NSW Police’s goal of answering 80 per cent of calls within 27 seconds. In addition, waiting time increased over the last six months of 2002.
Parliamentary reference - Report number #110 - released 5 June 2003
Implementing the Ovine Johne's Disease Program
The implementation of the Ovine Johne's Disease (OJD) program in New South Wales has been prolonged and difficult. In our view, the OJD Program in New South Wales has experienced two major difficulties with its implementation: the lack of a strategic approach to program management, and an ill-defined governance structure. Both the NSW Government and industry need to be better organised and improve the planning, direction and co-ordination of the OJD Program and future programs.
Parliamentary reference - Report number #107 - released 26 February 2003
