Reports
Matching skills training with market needs
In 2012, governments across Australia entered into the National Partnership Agreement on Skills Reform. Under the National Partnership Agreement, the Australian Government provided incentive payments to States and Territories to move towards a more contestable Vocational Education and Training (VET) market. The aim of the National Partnership Agreement was to foster a more accessible, transparent, efficient and high quality training sector that is responsive to the needs of students and industry.
The New South Wales Government introduced the Smart and Skilled program in response to the National Partnership Agreement. Through Smart and Skilled, students can choose a vocational course from a list of approved qualifications and training providers. Students pay the same fee for their chosen qualification regardless of the selected training provider and the government covers the gap between the student fee and the fixed price of the qualification through a subsidy paid to their training provider.
Smart and Skilled commenced in January 2015, with the then Department of Education and Communities having primary responsibility for its implementation. Since July 2015, the NSW Department of Industry (the Department) has been responsible for VET in New South Wales and the implementation of Smart and Skilled.
The NSW Skills Board, comprising nine part-time members appointed by the Minister for Skills, provides independent strategic advice on VET reform and funding. In line with most other States and Territories, the Department maintains a 'Skills List' which contains government subsidised qualifications to address identified priority skill needs in New South Wales.
This audit assessed the effectiveness of the Department in identifying, prioritising, and aligning course subsidies to the skill needs of NSW. To do this we examined whether:
- the Department effectively identifies and prioritises present and future skill needs
- Smart and Skilled funding is aligned with the priority skill areas
- skill needs and available VET courses are effectively communicated to potential participants and training providers.
Smart and Skilled is a relatively new and complex program, and is being delivered in the context of significant reform to VET nationally and in New South Wales. A large scale government funded contestable market was not present in the VET sector in New South Wales before the introduction of Smart and Skilled. This audit's findings should be considered in that context.
The Department needs to better use the data it has, and collect additional data, to support its analysis of priority skill needs in New South Wales, and direct funding accordingly.
- funding scholarships and support for disadvantaged students
- funding training in regional and remote areas
- providing additional support to deliver some qualifications that the market is not providing.
The Department needs to evaluate these funding strategies to ensure they are achieving their goals. It should also explore why training providers are not delivering some priority qualifications through Smart and Skilled.
Training providers compete for funding allocations based on their capacity to deliver. The Department successfully manages the budget by capping funding allocated to each Smart and Skilled training provider. However, training providers have only one year of funding certainty at present. Training providers that are performing well are not rewarded with greater certainty.
The Department needs to improve its communication with prospective students to ensure they can make informed decisions in the VET market.
The Department also needs to communicate more transparently to training providers about its funding allocations and decisions about changes to the NSW Skills List.
The Department relies on stakeholder proposals to update the NSW Skills List. Stakeholders include industry, training providers and government departments. These stakeholders, particularly industry, are likely to be aware of skill needs, and have a strong incentive to propose qualifications that address these needs. The Department’s process of collecting stakeholder proposals helps to ensure that it can identify qualifications needed to address material skill needs.
It is also important that the Department ensures the NSW Skills List only includes priority qualifications that need to be subsidised by government. The Department does not have robust processes in place to remove qualifications from the NSW Skills List. As a result, there is a risk that the list may include lower priority skill areas. Since the NSW Skills List was first created, new additions to the list have outnumbered those removed by five to one.
The Department does not always validate information gathered from stakeholder proposals, even when it has data to do so. Further, its decision making about what to include on, or delete from, the NSW Skills List is not transparent because the rationale for decisions is not adequately documented.
The Department is undertaking projects to better use data to support its decisions about what should be on the NSW Skills List. Some of these projects should deliver useful data soon, but some can only provide useful information when sufficient trend data is available.
Recommendation
The Department should:
- by June 2019, increase transparency of decisions about proposed changes to the NSW Skills List and improve record-keeping of deliberations regarding these changes
- by December 2019, use data more effectively and consistently to ensure that the NSW Skills List only includes high priority qualifications
Only qualifications on the NSW Skills List are eligible for subsidies under Smart and Skilled. As the Department does not have a robust process for removing low priority qualifications from the NSW Skills list, some low priority qualifications may be subsidised.
The Department allocates the Smart and Skilled budget through contracts with Smart and Skilled training providers. Training providers that meet contractual obligations and perform well in terms of enrolments and completion rates are rewarded with renewed contracts and more funding for increased enrolments, but these decisions are not based on student outcomes. The Department reduces or removes funding from training providers that do not meet quality standards, breach contract conditions or that are unable to spend their allocated funding effectively. Contracts are for only one year, offering training providers little funding certainty.
Smart and Skilled provides additional funding for scholarships and for training providers in locations where the cost of delivery is high or to those that cater to students with disabilities. The Department has not yet evaluated whether this additional funding is achieving its intended outcomes.
Eight per cent of the qualifications that have been on the NSW Skills List since 2015 are not delivered under Smart and Skilled anywhere in New South Wales. A further 14 per cent of the qualifications that are offered by training providers have had no student commencements. The Department is yet to identify the reasons that these high priority qualifications are either not offered or not taken up by students.
Recommendation
The Department should:
- by June 2019, investigate why training providers do not offer, and prospective students do not enrol in, some Smart and Skilled subsidised qualifications
- by December 2019, evaluate the effectiveness of Smart and Skilled funding which supplements standard subsidies for qualifications on the NSW Skills List, to determine whether it is achieving its objectives
- by December 2019, provide longer term funding certainty to high performing training providers, while retaining incentives for them to continue to perform well.
In a contestable market, it is important for consumers to have sufficient information to make informed decisions. The Department does not provide some key information to prospective VET students to support their decisions, such as measures of provider quality and examples of employment and further education outcomes of students completing particular courses. Existing information is spread across numerous channels and is not presented in a user friendly manner. This is a potential barrier to participation in VET for those less engaged with the system or less ICT literate.
The Department conveys relevant information about the program to training providers through its websites and its regional offices. However, it could better communicate some specific information directly to individual Smart and Skilled training providers, such as reasons their proposals to include new qualifications on the NSW Skills List are accepted or rejected.
While the Department is implementing a communication strategy for VET in New South Wales, it does not have a specific communications strategy for Smart and Skilled which comprehensively identifies the needs of different stakeholders and how these can be addressed.
Recommendation
By December 2019, the Department should develop and implement a specific communications strategy for Smart and Skilled to:
- support prospective student engagement and informed decision making
- meet the information needs of training providers
Appendix one - Response from agency
Appendix two - About the audit
Appendix three - Performance auditing
Parliamentary reference - Report number #305 - released 26 July 2018
Volume Eight 2013 focusing on Transport and Ports
Unqualified audit opinions were issued on the above corporations’ 30 June 2013 financial statements. During the year, Treasury issued TC 13/01 ‘Mandatory early close procedures for 2013’. This Circular aimed to improve the quality and timeliness of agencies’ annual financial statements. In 2012-13, application of the circular was made mandatory for State owned corporations. As a result, the port corporations were required to perform the early close procedures. All the port corporations were successful in performing the procedures, which helped them submit financial statements by an earlier due date. The early close procedures also resulted in general improvements to the quality of most financial statements.
The report recommends all transport entities should do more to reduce excessive annual leave balances to ensure they will comply with new targets set by the Premier, RailCorp, Sydney Trains and NSW Trains should minimise the amount of overtime bonuses paid to train drivers and that Transport for NSW should set targets to measure the overall satisfaction of train users.
Volume Four 2013 focusing on Electricity
During the year, Treasury issued TC 13/01 ‘Mandatory early close procedures for 2013’. This circular aimed to improve the quality and timeliness of agencies’ annual financial statements. In 2012-13, application of the circular was made mandatory for State owned corporations. As a result, the NSW Generators, Distributors and Transgrid were required to perform the early close procedures. All the electricity entities were broadly successful in performing the procedures, which helped them submit financial statements by an earlier due date.
This in turn enabled the financial statement audits to be finalised within an earlier timeframe of eight weeks (nine weeks in 2011-12), with the exception of Eraring Energy’s audit, which is yet to be finalised. The early close procedures also resulted in improvements to the quality of the financial statements, as evidenced by fewer reported misstatements in 2012-13 compared to 2011-12.
Management of the ClubGRANTS Scheme
The ClubGRANTS scheme gives tax rebates to clubs for supporting their local community. Since 2002, $417 million of ClubGRANTS tax rebates have been given to clubs. The scheme recognises the valuable role played by registered clubs in their local communities. However, the public must have confidence that the scheme is delivering genuine services to the community.
Parliamentary reference - Report number #229 - released 2 May 2013
Volume One 2013 focusing on themes from 2012
This overview summarises the significant findings included in my 2012 financial audit report, volumes three to eleven, and highlights NSW agencies’ overall achievements and challenges. The overview summarises key themes and messages arising from these audits to help readers understand common findings. Agencies and their audit and risk committees can use the overview to self-assess and identify issues that may be relevant to their organisations.
It found more than 85 per cent of the recommendations in my 2011 financial audit reports to Parliament were implemented in 2012. Whilst this is less than 100 per cent, NSW government agencies clearly acted on my significant recommendations. However, NSW government agencies need to do more to follow up more detailed recommendations that are made directly to management.
Use of the internet and related technologies to improve public sector performance
Notwithstanding the considerable effort, it is not apparent that the Government's vision can be fully achieved without increased efforts. Based on the current position, to ensure that the Government's vision can be achieved the Audit Office is of the view that the following key issues need to be urgently addressed:
-
more robust mechanisms are needed to monitor, review and report publicly on progress and benefits
-
a greater emphasis should be placed on central coordination to ensure that agencies act in a more uniform and integrated manner
-
the achievement of significant reform of business processes will require a substantial strengthening of accountability mechanisms and more comprehensive, rigorous and systematic approaches to e-government project and risk management.
-
despite an array of guidance material and support provided by central agencies, line agency needs for assistance do not seem to be being met to sufficiently advance matters across the sector at the pace and scope desired
-
the Government’s e-government aspirations and funding are not always effectively harmonised. Agencies typically have limited resources available to trial or experience new technologies, and display an aversion to the associated risks.
Parliamentary reference - Report number #87 - released 19 September 2001
