Refine search Expand filter

Reports

Published

Actions for Internal Controls and Governance 2017

Internal Controls and Governance 2017

Finance
Education
Community Services
Health
Justice
Whole of Government
Asset valuation
Compliance
Cyber security
Information technology
Internal controls and governance
Project management
Risk

Agencies need to do more to address risks posed by information technology (IT).

Effective internal controls and governance systems help agencies to operate efficiently and effectively and comply with relevant laws, standards and policies. We assessed how well agencies are implementing these systems, and highlighted opportunities for improvement.
 

1. Overall trends

New and repeat findings

The number of reported financial and IT control deficiencies has fallen, but many previously reported findings remain unresolved.

High risk findings

Poor systems implementations contributed to the seven high risk internal control deficiencies that could affect agencies.

Common findings

Poor IT controls are the most commonly reported deficiency across agencies, followed by governance issues relating to cyber security, capital projects, continuous disclosure, shared services, ethics and risk management maturity.

2. Information Technology

IT security

Only two-thirds of agencies are complying with their own policies on IT security. Agencies need to tighten user access and password controls.

Cyber security

Agencies do not have a common view on what constitutes a cyber attack, which limits understanding the extent of the cyber security threat.

Other IT systems

Agencies can improve their disaster recovery plans and the change control processes they use when updating IT systems.

3. Asset Management

Capital investment

Agencies report delays delivering against the significant increase in their budgets for capital projects.

Capital projects

Agencies are underspending their capital budgets and some can improve capital project governance.

Asset disposals

Eleven per cent of agencies were required to sell their real property through Property NSW but didn’t. And eight per cent of agencies can improve their asset disposal processes.

4. Governance

Governance arrangements

Sixty-four per cent of agencies’ disclosure policies support communication of key performance information and prompt public reporting of significant issues.

Shared services

Fifty-nine per cent of agencies use shared services, yet 14 per cent do not have service level agreements in place and 20 per cent can strengthen the performance standards they set.

5. Ethics and Conduct

Ethical framework

Agencies can reinforce their ethical frameworks by updating code‑of‑conduct policies and publishing a Statement of Business Ethics.

Conflicts of interest

All agencies we reviewed have a code of conduct, but they can still improve the way they update and manage their codes to reduce the risk of fraud and unethical behaviour.

6. Risk Management 

Risk management maturity

All agencies have implemented risk management frameworks, but with varying levels of maturity.

Risk management elements

Many agencies can improve risk registers and strengthen their risk culture, particularly in the way that they report risks to their lead agency.

This report covers the findings and recommendations from our 2016–17 financial audits related to the internal controls and governance of the 39 largest agencies (refer to Appendix three) in the NSW public sector. These agencies represent about 95 per cent of total expenditure for all NSW agencies and were considered to be a large enough group to identify common issues and insights.

The findings in this report should not be used to draw conclusions on the effectiveness of individual agency control environments and governance arrangements. Specific financial reporting, controls and service delivery comments are included in the individual 2017 cluster financial audit reports tabled in Parliament from October to December 2017.

This new report offers strategic insight on the public sector as a whole

In previous years, we have commented on internal control and governance issues in the volumes we published on each ‘cluster’ or agency sector, generally between October and December. To add further value, we then commented more broadly about the issues identified for the public sector as a whole at the start of the following year.

This year, we have created this report dedicated to internal controls and governance. This will help Parliament to understand broad issues affecting the public sector, and help agencies to compare their own performance against that of their peers.

Without strong control measures and governance systems, agencies face increased risks in their financial management and service delivery. If they do not, for example, properly authorise payments or manage conflicts of interest, they are at greater risk of fraud. If they do not have strong information technology (IT) systems, sensitive and trusted information may be at risk of unauthorised access and misuse.

These problems can in turn reduce the efficiency of agency operations, increase their costs and reduce the quality of the services they deliver.

Our audits do not review every control or governance measure every year. We select a range of measures, and report on those that present the most significant risks that agencies should mitigate. This report divides these into the following six areas:

  1. Overall trends
  2. Information technology
  3. Asset management
  4. Governance
  5. Ethics and conduct
  6. Risk management.

Internal controls are processes, policies and procedures that help agencies to:

  • operate effectively and efficiently
  • produce reliable financial reports
  • comply with laws and regulations.

This chapter outlines the overall trends for agency controls and governance issues, including the number of findings, level of risk and the most common deficiencies we found across agencies. The rest of this volume then illustrates this year’s controls and governance findings in more detail.

Issues

Recommendations

1.1 New and repeat findings

The number of internal control deficiencies reduced over the past three years, but new higher-risk information technology (IT) control deficiencies were reported in 2016–17.

Deficiencies repeated from previous years still make up a sizeable proportion of all internal control deficiencies.

Recommendation

Agencies should focus on emerging IT risks, but also manage new IT risks, reduce existing IT control deficiencies, and address repeat internal control deficiencies on a more timely basis.

1.2 High risk findings

We found seven high risk internal control deficiencies, which might significantly affect agencies.

Recommendation

Agencies should rectify high risk internal control deficiencies as a priority

1.3 Common findings

The most common internal control deficiencies related to poor or absent IT controls.

We found some common governance deficiencies across multiple agencies.

Recommendation

Agencies should coordinate actions and resources to help rectify common IT control and governance deficiencies.

Information technology (IT) has become increasingly important for government agencies’ financial reporting and to deliver their services efficiently and effectively. Our audits reviewed whether agencies have effective controls in place over their IT systems. We found that IT security remains the source of many control weakness in agencies.

Issues Recommendations

2.1 IT security

User access administration

While 95 per cent of agencies have policies about user access, about two-thirds were compliant with these policies. Agencies can improve how they grant, change and end user access to their systems.

Recommendation

Agencies should strengthen user access administration to prevent inappropriate access to sensitive systems. Agencies should:

  • establish and enforce clear policies and procedures
  • review user access regularly
  • remove user access for terminated staff promptly
  • change user access for transferred staff promptly.

Privileged access

Sixty-eight per cent of agencies do not adequately manage who can access their information systems, and many do not sufficiently monitor or restrict privileged access.

Recommendation

Agencies should tighten privileged user access to protect their information systems and reduce the risks of data misuse and fraud. Agencies should ensure they:

  • only grant privileged access in line with the responsibilities of a position
  • review the level of access regularly
  • limit privileged access to necessary functions and data
  • monitor privileged user account activity on a regular basis.

Password controls

Forty-one per cent of agencies did not meet either their own standards or minimum standards for password controls.

Recommendation

Agencies should review and enforce password controls to strengthen security over sensitive systems. As a minimum, password parameters should include:

  • minimum password lengths and complexity requirements
  • limits on the number of failed log-in attempts
  • password history (such as the number of passwords remembered)
  • maximum and minimum password ages.

2.2 Cyber Security

Cyber security framework

Agencies do not have a common view on what constitutes a cyber attack, which limits understanding the extent of the cyber security threat.

Recommendation

The Department of Finance, Services and Innovation should revisit its existing framework to develop a shared cyber security terminology and strengthen the current reporting requirements for cyber incidents.

Cyber security strategies

While 82 per cent of agencies have dedicated resources to address cyber security, they can strengthen their strategies, expertise and staff awareness.

Recommendations

The Department of Finance, Services and Innovation should:

  • mandate minimum standards and require agencies to regularly assess and report on how well they mitigate cyber security risks against these standards
  • develop a framework that provides for cyber security training.

Agencies should ensure they adequately resource staff dedicated to cyber security.

2.3 Other IT systems

Change control processes

Some agencies need to improve change control processes to avoid unauthorised or inaccurate system changes.

Recommendation

Agencies should consistently perform user acceptance testing before system upgrades and changes. They should also properly approve and document changes to IT systems.

Disaster recovery planning

Agencies can do more to adequately assess critical business systems to enforce effective disaster recovery plans. This includes reviewing and testing their plans on a timely basis.

Recommendation

Agencies should complete business impact analyses to strengthen disaster recovery plans, then regularly test and update their plans.

Agency service delivery relies on developing and renewing infrastructure assets such as schools, hospitals, roads, or public housing. Agencies are currently investing significantly in new assets. Agencies need to manage the scale and volume of current capital projects in order to deliver new infrastructure on time, on budget and realise the intended benefits. We found agencies can improve how they:

  • manage their major capital projects
  • dispose of existing assets.
Issues Recommendations or conclusions

3.1 Capital investment

Capital asset investment ratios

Most agencies report high capital investment ratios, but one-third of agencies’ capital investment ratios are less than one.

Recommendation

Agencies with high capital asset investment ratios should ensure their project management and delivery functions have the capacity to deliver their current and forward work programs.

Volume of capital spending

Most agencies have significant forward spending commitments for capital projects. However, agencies’ actual capital expenditure has been below budget for the last three years.

Conclusion

The significant increase in capital budget underspends warrant investigation, particularly where this has resulted from slower than expected delivery of projects from previous years.

3.2 Capital projects

Major capital projects

Agencies’ major capital projects were underspent by 13 percent against their budgets.

Conclusion

The causes of agency budget underspends warrant investigation to ensure the NSW Government’s infrastructure commitment is delivered on time.

Capital project governance

Agencies do not consistently prepare business cases or use project steering committees to oversee major capital projects.

Conclusion

Agencies that have project management processes that include robust business cases and regular updates to their steering committees (or equivalent) are better able to provide those projects with strategic direction and oversight.

3.3. Asset disposals

Asset disposal procedures

Agencies need to strengthen their asset disposal procedures.

Recommendations

Agencies should have formal processes for disposing of surplus properties.

Agencies should use Property NSW to manage real property sales unless, as in the case for State owned corporations, they have been granted an exemption.

Governance refers to the high-level frameworks, processes and behaviours that help an organisation to achieve its objectives, comply with legal and other requirements, and meet a high standard of probity, accountability and transparency.

This chapter sets out the governance lighthouse model the Audit Office developed to help agencies reach best practice. It then focuses on two key areas: continuous disclosure and shared services arrangements. The following two chapters look at findings related to ethics and risk management.

Issues Recommendations or conclusions

4.1 Governance arrangements

Continuous disclosure

Continuous disclosure promotes improved performance and public trust and aides better decision-making. Continuous disclosure is only mandatory for NSW Government Businesses such as State owned corporations.

Conclusion

Some agencies promote transparency and accountability by publishing on their websites a continuous disclosure policy that provides for, and encourages:

  • regular public disclosure of key performance information
  • disclosure of both positive and negative information
  • prompt reporting of significant issues.

4.2 Shared services

Service level agreements

Some agencies do not have service level agreements for their shared service arrangements.

Many of the agreements that do exist do not adequately specify controls, performance or reporting requirements. This reduces the effectiveness of shared services arrangements.

Conclusion

Agencies are better able to manage the quality and timeliness of shared service arrangements where they have a service level agreement in place. Ideally, the terms of service should be agreed before services are transferred to the service provider and:

  • specify the controls a provider must maintain
  • specify key performance targets
  • include penalties for non-compliance.

Shared service performance

Some agencies do not set performance standards for their shared service providers or regularly review performance results.

Conclusion

Agencies can achieve better results from shared service arrangements when they regularly monitor the performance of shared service providers using key measures for the benefits realised, costs saved and quality of services received.

Before agencies extend or renegotiate a contract, they should comprehensively assess the services received and test the market to maximise value for money.

All government sector employees must demonstrate the highest levels of ethical conduct, in line with standards set by The Code of Ethics and Conduct for NSW government sector employees.

This chapter looks at how well agencies are managing these requirements, and where they can improve their policies and processes.

We found that agencies mostly have the appropriate codes, frameworks and policies in place. But we have highlighted opportunities to improve the way they manage those systems to reduce the risks of unethical conduct.

Issues Recommendations or conclusions

5.1 Ethical framework

Code of conduct

All agencies we reviewed have a code of conduct, but they can still improve the way they update and manage their codes to reduce the risk of fraud and unethical behaviour.

Recommendation

Agencies should regularly review their code-of-conduct policies and ensure they keep their codes of conduct up-to-date.

Statement of business ethics

Most agencies maintain an ethical framework, but some can enhance their related processes, particularly when dealing with external clients, customers, suppliers and contractors.

Conclusion

Agencies can enhance their ethical frameworks by publishing a Statement of Business Ethics, which communicates their values and culture.

5.2 Potential conflicts of interest

Conflicts of interest

All agencies have a conflicts-of-interest policy, but most can improve how they identify, manage and avoid conflicts of interest.

Recommendation

Agencies should improve the way they manage conflicts of interest, particularly by:

  • requiring senior executives to make a conflict-of-interest declaration at least annually
  • implementing processes to identify and address outstanding declarations
  • providing annual training to staff
  • maintaining current registers of conflicts of interest.

Gifts and benefits

While all agencies already have a formal gifts-and-benefits policy, we found gaps in the management of gifts and benefits by some that increase the risk of unethical conduct.

Recommendation

Agencies should improve the way they manage gifts and benefits by promptly updating registers and providing annual training to staff.

Risk management is an integral part of effective corporate governance. It helps agencies to identify, assess and prioritise the risks they face and in turn minimise, monitor and control the impact of unforeseen events. It also means agencies can respond to opportunities that may emerge and improve their services and activities.

This year we looked at the overall maturity of the risk management frameworks that agencies use, along with two important risk management elements: risk culture and risk registers.

Issues Recommendations or conclusions

6.1 Risk management maturity

All agencies have implemented risk management frameworks, but with varying levels of maturity in their application.

Agencies’ averaged a score of 3.1 out of five across five critical assessment criteria for risk management. While strategy and governance fared best, the areas that most need to improve are risk culture, and systems and intelligence.

Conclusion

Agencies have introduced risk management frameworks and practices as required by the Treasury’s:

  • 'Risk Management Toolkit for the NSW Public Sector'
  • 'Internal Audit and Risk Management Policy for the NSW Public Sector'.

However, more can be done to progress risk management maturity and embed risk management in agency culture.

6.2 Risk management elements

Risk culture

Most agencies have started to embed risk management into the culture of their organisation. But only some have successfully done so, and most agencies can improve their risk culture.

 

 

Conclusion

Agencies can improve their risk culture by:

  • setting an appropriate tone from the top
  • training all staff in effective risk management
  • ensuring desired risk behaviours and culture are supported, monitored, and reinforced through business plans, or the equivalent and employees' performance assessments.

Risk registers and reporting

Some agencies do not report their significant risks to their lead agency, which may impair the way resources are allocated in their cluster. Some agencies do not integrate risk registers at a divisional and whole-of-enterprise level.

Conclusion

Agencies not reporting significant risks at the cluster level increases the likelihood that significant risks are not being mitigated appropriately.

Effective risk management can improve agency decision-making, protect reputations and lead to significant efficiencies and cost savings. By embedding risk management directly into their operations, agencies can also derive extra value for their activities and services.

Published

Actions for Transport 2017

Transport 2017

Transport
Asset valuation
Information technology
Internal controls and governance
Project management

The following report focuses on key observations and findings from the most recent financial statement audits of agencies in the Transport cluster.

Unqualified audit opinions were issued for all agencies' financial statements. However, the report notes the agencies can improve their asset revaluation processes.

1. Financial reporting and controls

Audit opinions

Unqualified audit opinions were issued for all agencies' financial statements.

Early close

Early close procedures continue to facilitate timely preparation of financial statements and completion of audits, but agencies can improve their asset revaluation processes. The revaluations were not completed by the early close deadline.
Key audit matters The cluster corrected the value of rail tunnels and earthworks by recording an additional $8.5 billion in infrastructure assets.
Passenger revenue and patronage Revenue increased by seven per cent at a similar rate to patronage. Opal fare structure changes came into effect on 5 September 2016. Continued rises in patronage can increase pressure on public transport punctuality.
Negative balances on Opal Cards

There was $2.6 million in revenue not collected during 2016–17 financial year through negative balance Opal Cards. This represents 0.2 per cent of total annual passenger revenue. Transport advise the cumulative balance of negative balance Opal Cards is $4.2 million as at 30 June 2017.

Recommendation: Transport for NSW (TfNSW) should implement measures to prevent loss of revenue from passengers tapping off with negative balance Opal Cards.

Investment in infrastructure Agencies spent $8.5 billion on assets in 2016–17 and have contractual capital commitments of $11.3 billion over the next five years.
Internal controls IT systems user access administration remains an area of weakness.


2. Service Delivery

Punctuality According to Transport data, average punctuality is above target for Sydney Trains, Ferries and Light Rail, but below target for NSW Trains services. State Transit Authority of NSW (STA) is not meeting punctuality targets. STA continued working with TfNSW on delivering improved punctuality.
Public transport capacity Passenger crowding is above benchmark for many morning peak suburban rail services, as indicated by Transport data. Eleven of the 14 bus contract regions had full buses.

Bus crowding

There are no target measures on crowding for bus operators in any contract region.

Recommendation: TfNSW should develop target measures on crowding for bus operators in all contract regions and publish the results.

Customer satisfaction

Surveys conducted by Transport indicate customer satisfaction exceeded target for all modes of public transport.

This report provides Parliament and other users of Transport cluster agencies' financial statements with audit results, observations, conclusions and recommendations in the following areas:

  • Financial reporting and controls
  • Service delivery.

Confidence in public sector decision-making and transparency is enhanced when financial reporting is accurate and timely. Appropriate financial controls help ensure the efficient and effective use of resources and administration of agency policies.

This chapter outlines our audit observations, conclusions or recommendations related to financial reporting and controls of Transport cluster agencies for 2016–17.

Observation Conclusion or recommendation
Quality of financial reporting
Unqualified opinions were issued for all agencies’ financial statements. Unqualified audit opinions were issued on the 2016–17 financial statements of all agencies in the Transport cluster. Agencies complied with the new disclosure requirements required under accounting standard AASB 124 'Related Party Disclosures'.
Old tunnels and earthworks valued. The cluster corrected the value of rail tunnels and earthworks by recording an additional $8.5 billion in infrastructure assets.
Timeliness of financial reporting  
Most agencies complied with the statutory timeframes for completion of early close procedures and preparation and audit of financial statements. Early close procedures continue to facilitate timely preparation of financial statements and completion of audits, but agencies can make further improvement in the revaluation process.
TfNSW and RailCorp completed asset revaluations after the early close deadline. While all revaluation matters were resolved and corrected, completing the revaluation process earlier would enable more timely review, identification and resolution of matters.
Passenger revenue, patronage and cost recovery
Revenue increased by 7 per cent at a similar rate to patronage. Public transport passenger revenue increased by $93 million (seven per cent) in 2016–17, and patronage increased by 49 million (seven per cent) across all modes of transport. There were some changes in the method of calculating reported patronage between 2015–16 and 2016–17. If the methods had been consistent, the patronage increase would be 6.5 per cent. Opal fare structure changes came into effect on 5 September 2016.
Value of negative balance Opal Cards doubled since last year.

There was $2.6 million in revenue not collected during 2016–17 financial year through negative balance Opal Cards. This represents 0.2 per cent of total annual passenger revenue. Transport advise the cumulative balance of negative balance Opal Cards is $4.2 million as at 30 June 2017.

Recommendation: TfNSW should implement measures to prevent the loss of revenue from passengers tapping off with negative balance Opal cards.

The overall cost recovery from users of public transport increased slightly to 21.3 per cent. Cost of service per passenger journey for buses and ferries decreased. Revenue per passenger journey for all modes remained fairly stable.
Investment in infrastructure
There was a significant investment in transport assets in 2016–17. Agencies spent $8.5 billion on assets in 2016–17, including $3.8 billion on rail systems and $3.8 billion on road and maritime infrastructure systems.
Transport cluster have capital commitment of $11.3 billion over the next five years.
 
The transport cluster has significant contractual commitments over the next five years on rail and road infrastructure projects.
 

Internal controls

User access administration over systems remains an area of weakness. We identified six moderate and eight low risk issues related to user systems access administration across four agencies. This included review of highly privileged/super user account transactions not performed effectively and user access reviews not performed. These weaknesses increase the risk of users having excessive or unauthorised access to critical financial systems and information.

Achievement of government outcomes can be improved through effective delivery of the right mix of services, whether from the public, private or not‑for‑profit sectors. Service delivery reform will be most successful if there is clear accountability for service delivery outcomes, decisions are aligned to strategic direction and performance is monitored and evaluated.

This chapter outlines our audit observations, conclusions or recommendations related to service delivery in the Transport cluster agencies for 2016–17.

Observations Conclusion or recommendation

Punctuality

Average punctuality is above target for Sydney Trains, but below target for NSW Trains services. Punctuality targets are not met by all bus operators. Meeting punctuality targets is a continuing challenge for NSW Trains’ and STA bus services.
The 2017 performance audit 'Passenger Rail Punctuality' reported that based on forecast patronage increases, rail agencies will find it hard to maintain punctuality after 2019 unless the capacity of the network to carry trains and people is increased significantly. The 2017 performance audit found that given the likely lead times involved with major infrastructure projects, there remains a significant risk of poor punctuality after 2019. Transport advised it is currently either delivering or planning rail network upgrades to address current growth and longer-term future demand. This includes investments such as procurement of suburban and intercity trains, Sydney Metro services and further timetable planning into the 2020s.
 
After reaching its punctuality target in 2015–16 for the first time in 13 years, NSW Trains regional services was below the target in 2016–17. NSW Trains regional services achieved an average of 75 per cent punctuality in 2016–17, four per cent less than 2015–16.
The bus contracts do not have an option to impose financial penalties on STA for poor punctuality performance. In 2015–16, we recommended TfNSW should consider including financial penalties for not meeting each punctuality KPI in future contracts with bus operators. An opportunity to implement the recommendation requires a contract renewal process to be finalised with STA, which did not occur during 2016–17.

Public transport capacity

There are no target measures on crowding for bus operators in any contract region. Recommendation: TfNSW should develop target measures on crowding for bus operators in all contract regions and publish the results.

Customer Satisfaction

Customers on ferries continued to be most satisfied, followed by those on light rail. Sydney Trains and NSW Trains had fewer complaints in 2016–17. Customer satisfaction exceeded target for all modes of transport.

Project management

Transport cluster manages many of the State high profile/high risk projects. Major Transport projects include WestConnex, Sydney Metro Northwest, Sydney Metro City and Southwest, Woolgoolga to Ballina - Pacific Highway upgrade, NorthConnex, CBD and South East Light Rail and Newcastle Light Rail.
Safety performance
Road fatalities decreased by eight per cent between July 2016 and June 2017, from 390 to 359 deaths. Road fatalities mainly involved speed, fatigue and vehicle occupants not wearing available restraints.
 

Maintenance

RMS’ maintenance backlog of $3.7 billion is higher than the $3.4 billion reported in 2016. Transport cluster agencies manage $134 billion in property, plant and equipment. The total backlog maintenance of $4.1 billion at 30 June 2017 represents 3.1 per cent of those assets.

Published

Actions for Report on Education 2017

Report on Education 2017

Education
Financial reporting
Internal controls and governance
Management and administration
Procurement
Project management
Workforce and capability

The Auditor-General, Margaret Crawford released her report on the results of the financial audits of agencies in the Education cluster. The report focuses on key observations and findings from the most recent audits of these agencies.

'I am pleased to report that unqualified audit opinions were issued on the financial statements for all agencies in the Education cluster', the Auditor-General said. 'The quality and timeliness of financial reporting remains strong'.

Published

Actions for Managing demand for ambulance services 2017

Managing demand for ambulance services 2017

Health
Information technology
Management and administration
Risk
Service delivery
Shared services and collaboration
Workforce and capability

NSW Ambulance has introduced several initiatives over the past decade to better manage the number of unnecessary ambulance responses and transports to hospital emergency departments. However, there is no overall strategy to guide the development of these initiatives nor do NSW Ambulance's data systems properly monitor their impact. As a result, the Audit Office was unable to assess whether NSW Ambulance's approach to managing demand is improving the efficiency of ambulance services.

Demand for ambulance services is increasing. Demographic factors including population growth and ageing have contributed to this and ongoing growth in demand is likely. It is important that NSW Ambulance finds ways to respond to this demand more efficiently, while maintaining patient safety standards and meeting community expectations.

Most triple zero calls to NSW Ambulance do not involve medical issues that require an emergency response. NSW Ambulance has introduced a range of initiatives to change the way it manages these less urgent requests for assistance. Its major demand management initiatives include using a telephone advice line, referring some patients to services other than hospital emergency departments and using specialist paramedics to respond to less urgent cases.

The role of NSW Ambulance has changed in recent years. It is aiming to become a ‘mobile health service’ that identifies the needs of patients and provides or refers them to the most appropriate type of care. This change involves a significant expansion of the clinical decision-making role of paramedics. Considerable strategic and organisational efforts are required to make this work. The successful implementation of demand management initiatives is important to NSW Ambulance's ability to continue to meet demand for its services.

This audit assessed NSW Ambulance's major demand management initiatives that aim to reduce unnecessary demand for ambulance responses and unnecessary transport to hospital emergency departments. It aimed to assess the extent to which these initiatives have improved the efficiency of its services.

Conclusion

NSW Ambulance has introduced several initiatives that aim to manage demand for its services from less urgent cases more efficiently. There is no overall strategy for these initiatives and NSW Ambulance’s data systems do not measure their outputs or outcomes. As a result, we are unable to assess the impact of NSW Ambulance's demand management initiatives on the efficiency of ambulance services. More focus is needed to ensure these initiatives achieve the efficiency improvements necessary to help NSW Ambulance meet future increases in demand.

Increasing demand for ambulance services is a key issue for NSW Ambulance. Demand has increased at a faster rate than population growth in recent years and continued growth is expected. NSW Ambulance has introduced several initiatives that aim to manage demand for its services from people with less urgent medical issues more efficiently and align its approach with the rest of the health system in New South Wales.

These individual initiatives lack a broader strategy to guide their development. NSW Ambulance’s demand management initiatives also lack clear goals and performance targets, with insufficient organisational resources allocated to support their implementation. NSW Ambulance does not have a data system that allows it to conduct accurate routine monitoring of the activity and performance of these initiatives.

More effort is required to make demand management initiatives a core part of NSW Ambulance's work. Key relationships with other health services to support demand management initiatives have only recently been established. NSW Ambulance has not communicated proactively with the public about its demand management initiatives. To ensure paramedics are as well prepared as possible for their expanded roles, they need better professional development and up to date technology.

Demand for ambulance services in New South Wales is increasing steadily. Forecast future increases in demand due to population growth and ageing mean that NSW Ambulance must improve its efficiency to maintain its performance.

Demand for ambulance services is growing at a rate higher than population growth. The increase in demand is likely to continue as the population continues to grow and age. NSW Ambulance has made several recent changes to remove large parts of demand for its services, including moving non-emergency patient transport to a separate government agency and changing the way triple zero calls are categorised.

These changes were expected to improve emergency response time performance, but the anticipated improvements have not been achieved. If demand continues to increase as forecast, NSW Ambulance will need to find more efficient ways to manage demand to maintain its performance.

NSW Ambulance has introduced initiatives to change the way it manages demand from patients who have less urgent medical issues. These have the potential to achieve positive results, but we were unable to fully assess their impact because of weaknesses in data systems and monitoring. More needs to be done to demonstrate progress toward the efficiency improvements required.

NSW Ambulance uses a telephone referral system to manage triple zero calls from people with medical issues that do not require an ambulance. This has the potential to achieve efficiency improvements but there are weaknesses in NSW Ambulance's use and monitoring of this system. Paramedics are now able to make decisions about whether patients need transport to a hospital emergency department. NSW Ambulance does not routinely measure or monitor the decisions paramedics make, so it does not know whether these decisions are improving efficiency. Extended Care Paramedics who have additional skills in diagnosing and treating patients with less urgent medical issues were introduced in 2007. NSW Ambulance analysis indicates that these paramedics have the potential to improve efficiency, but have not been used as effectively as possible.

Our 2013 audit of NSW Ambulance found that accurate monitoring of activity and performance was not being conducted. More than four years later, this remains the case. 

NSW Ambulance has recognised the need to change the way it manages demand and has developed initiatives that have the potential to improve efficiency. However, there are significant weaknesses in the strategy for and implementation of its demand management initiatives.

NSW Ambulance has identified the goal of moving from an emergency transport provider to a mobile health service and developed several initiatives to support this. Its demand management initiatives have the potential to contribute to the broader policy directions for the health system in New South Wales. However, there is no clear overall strategy guiding these initiatives and their implementation has been poor.

NSW Ambulance's reasons for changing its approach to demand management have not been communicated proactively to the community. Demand management initiatives that have been operating for over a decade still do not have clear performance measures or targets. Project management of new initiatives has been inadequate, with insufficient organisational resources to oversee them and inadequate engagement with other healthcare providers.

NSW Ambulance uses an in-house Vocational Education and Training course to recruit some paramedics, as well as recruiting paramedics who have completed a university degree. No other Australian ambulance services continue to provide their own Vocational Education and Training qualifications. Paramedics will need more support in several key areas to be able to fulfil their expanded roles in providing a mobile health service. Performance and development systems for paramedics are not used effectively. Up to date technology would help paramedics make better decisions and improve NSW Ambulance's ability to monitor demand management activity.

There are gaps in NSW Ambulance's oversight of the risks of some of the initiatives it has introduced, particularly its lack of information on the outcomes for patients who are not transported to hospital. Weaknesses in the way NSW Ambulance uses its data limit its ability to properly assess the risks of the demand management initiatives it has introduced.

Appendix one - Response from agency

Appendix two - About the audit

Appendix three - Performance auditing

 

Parliamentary reference - Report number #295 - released 13 December 2017

Published

Actions for Health 2017

Health 2017

Health
Asset valuation
Compliance
Financial reporting
Fraud
Information technology
Internal controls and governance
Management and administration
Procurement
Project management

The following report highlights results of the financial audits of entities in the NSW health cluster. The report focuses on key observations and findings from the most recent audits of these entities.

The report also includes a range of findings on service delivery. Overall, NSW Health is achieving most of their targets. Some local health districts are continuing to experience increased demand for their services and are finding it more difficult to meet their targets. For example, three local health districts had not achieved some emergency department response time targets for three consecutive years.

1. Financial reporting and controls

Financial Reporting

All health cluster entities received unqualified audit opinions and the quality of financial reporting remains high across the cluster.

Early close procedures were largely completed and all financial statements were submitted by the deadlines.

Financial performance

Overall, NSW Health recorded an operating surplus of $407 million in 2016–17. Eleven local health districts/specialty networks recorded operating deficits in 2016–17, four more than 2015–16.

Expenses across NSW Health increased by 4.4 per cent in 2016–17 (6.0 per cent in 2015–16), lower than the expected long term annual expense growth rate.

Excess annual leave Managing excess annual leave is a continual challenge for NSW Health, with thirty–five per cent of the workforce having excess balances.
Overtime payments NSW Health entities are generally managing overtime well; however NSW Ambulance’s overtime payments, $74.6 million in 2016–17, remain significantly higher than other health entities.
Time and leave recording practices Unapproved employee timesheets continue to be a problem for health entities. Weak timesheet approval controls increase the risk of staff claiming and being paid for hours they have not worked. There is also an increased risk of high volumes of roster adjustments, manual pays, salary overpayments and leave not being recorded accurately.

2. Service Delivery

Service Agreements Most of the service agreements between the Secretary of NSW Health and health entities were signed earlier than prior years.
Performance monitoring Five NSW Health entities are not meeting the Ministry of Health’s performance expectations at 30 June 2017.
Emergency department performance Data provided by the Ministry indicates NSW Health, on average, met emergency department triage response time targets across all triage categories for the fourth consecutive year.
Ambulance response times Data provided by the Ministry shows NSW Ambulance response times for imminently life‑threatening incidents of 7.5 minutes in 2016–17 was within the Ministry’s target of 10.0 minutes.

Data provided by the Ministry indicates NSW Ambulance response times for potentially life‑threatening incidents did not improve in 2016–17. The median response time of 11.1 minutes in 2016–17 was similar to 2015–16 (11.0 minutes). This is despite the number of Priority 1 responses reducing by 4.3 per cent.
Unplanned hospital re-admissions Data provided by the Ministry shows eight local health districts achieved the Ministry of Health’s unplanned hospital re‑admissions target in 2016–17. The target is for local health districts to reduce re‑admission rates from the previous financial year.

This report sets out the results of the 30 June 2017 financial statement audits of Health cluster entities.

The report has been structured into two chapters focusing on:

  • Financial reporting and controls
  • Service delivery.

This chapter outlines audit observations, conclusions and recommendations related to financial reporting and internal controls of entities for 2016-17.

Observation Conclusion or recommendation

2.1 Quality of financial reporting

All cluster entities received unqualified audit opinions and misstatements identified in financial statements fell. The quality of financial reporting remains high across the cluster.

2.2 Timeliness of financial reporting

Early close procedures were largely completed and all financial statements were submitted by the deadlines. Health entities controlled by the Ministry of Health continued submitting their financial statements well ahead of the statutory deadlines.

2.4 Financial and sustainability analysis

NSW Health recorded an operating surplus of $407 million in 2016–17.



Eleven local health districts/specialty networks recorded operating deficits in 2016–17, four more than 2015–16.


Expenses across NSW Health increased by 4.4 per cent in 2016–17 (6.0 per cent in
2015–16).

The capital replacement ratio of local health districts/specialty networks ranged from 0.5 to 5.7 in 2016–17. Seven local health districts had capital replacement ratio higher than one.

The statewide operating surplus was $84 million higher than 2015–16. Net surpluses contribute to NSW Health’s ability to invest in new facilities, upgrades and redevelopments.

The 2016–17 financial results were once again impacted by the NSW Government initiative to improve cash management across the sector.

The expense growth rate for NSW Health is 1.6 percentage points lower than the expected long term annual expense growth rate.

Substantial ongoing investment in hospitals and other assets across NSW Health is evidenced by high capital replacement ratios for some health entities in 2016–17.

2.5 Performance against budget
Ten local health districts/specialty networks’ expense budget variance was outside performance expectations agreed with the Ministry at the beginning of 2016–17. The Ministry continues to manage performance across NSW Health to improve the accuracy of budgeting practices.
2.7 Human Resources    

Thirty-five per cent of NSW Health’s workforce have excess annual leave balances.

 

 

 

 

 

 

NSW Ambulance had the highest average sick leave rate in NSW Health of 85.2 hours per FTE in 2016–17 (78.7 hours in 2015–16). This was higher than the statewide average of 62.1 hours (62.0 hours in 2015–16).

NSW Ambulance’s overtime payments in 2016–17 totalled $74.6 million; $2.8 million more than 2015–16 and significantly higher than other health entities

Other NSW Health entities are generally managing overtime well.

 

Unapproved employee timesheets continue to be a problem for health entities. Weak timesheet approval controls increase the risk of staff claiming and being paid for hours they have not worked.

 

Managing excess annual leave is a continual challenge for health entities.

Recommendation: Health entities should further review the approach to managing excess annual leave in 2017–18. They should:

  • monitor current and projected leave balances to the end of the financial year on a monthly basis
  • agree formal leave plans with employees to reduce leave balances over an acceptable timeframe.


NSW Ambulance continues to face significant challenges in managing sick leave.

Recommendation: NSW Ambulance should further implement and monitor targeted human resource strategies to address the high rates of sick leave taken

Recommendation: NSW Ambulance should further review the effectiveness of its rostering practices to identify strategies to reduce excessive overtime payments.

Recommendation: Health entities should conduct a risk‑based review of time and leave recording practices to ensure control weaknesses are identified and fixed.

This chapter outlines our audit observations, conclusions and recommendations relating to service delivery for 2016–17.

Observation Conclusion or recommendation
3.1 Service agreements in NSW Health

Most of the service agreements between the Secretary of NSW Health and health entities were signed earlier than prior years.

Thirteen local health districts/specialty networks signed their service agreements by the 31 July 2017 due date. This is a significant improvement with only seven local health districts/specialty networks meeting the date in 2015–16.

Having service agreements signed as close as possible to the start of each year provides the Ministry and NSW Health entities with clarity around roles, responsibilities, performance measures, budgets, and service volumes and levels.
3.2 Performance of NSW Health entities
Five NSW Health entities were not meeting the Ministry’s performance expectations at 30 June 2017. The Ministry is managing the five entities in accordance with its performance review process.
3.4 Emergency department response times

Data provided by the Ministry indicates NSW Health again, on average, met emergency department triage response time targets across all triage categories for the fourth consecutive year.

The Ministry manages performance across NSW Health to ensure patients presenting at emergency departments receive care in a clinically appropriate timeframe.

Based on the Ministry’s data, local health districts/specialty networks are, on average, meeting triage targets despite increasing emergency department attendances.

The data shows eleven local health districts met all triage targets in 2016–17, compared to eight in
2015–16. 

3.5 Emergency treatment performance

The Ministry manages public patient access to emergency services in public hospitals.

It has an emergency treatment performance target of 81 per cent of patients leaving emergency departments within four hours.

Data provided by the Ministry indicates NSW Health maintained its overall emergency treatment performance in 2016–17, but did not achieve its target. The State average emergency treatment performance was 74.2 per cent (74.2 per cent in 2015–16).

Based on the Ministry’s data, only four local health districts achieved the target in 2016–17, five in
2015–16.

3.6 Ambulance response times
NSW Ambulance has a response time target of 10.0 minutes for imminently life‑threatening incidents in New South Wales. Data provided by the Ministry indicates NSW Ambulance response times for imminently life-threatening incidents of 7.5 minutes in 2016–17 was within the Ministry’s target.
 
3.7 Transfer of care
The Ministry has a target of 90 per cent for the number of ambulance arrivals within a 30 minute ‘transfer of care’ timeframe. Data provided by the Ministry indicates the rate of ambulance arrivals within a 30 minute 'transfer of care' timeframe improved from 87.6 per cent in
2015–16 to 91.7 per cent in 2016–17, exceeding the Ministry’s target.
3.8 Average length of stay in hospital
Based on the Ministry’s 2016–17 data, the average length of stay for acute episodes was 3.0 days. The average length of stay in New South Wales hospitals is lower than the national average of 3.2 days (in 2015–16). The Ministry’s data shows the average length of stay by patients for acute episodes has remained stable in New South Wales hospitals for four years. 
3.9 Elective surgery access performance
Data provided by the Ministry indicates NSW Health continues to manage waiting times for elective surgery in public hospitals. The Ministry’s data shows NSW Health improved on‑time admission of patients for elective surgery in 2016–17 despite a 1.8 per cent increase in admissions. While the result improved, only one of the three targets for elective surgery waiting times was met in 2016–17.
3.10 Unplanned hospital re-admissions

Data provided by the Ministry indicates NSW Health, on average, did not reduce the rate of unplanned hospital re‑admissions in 2016–17. The Ministry has a target of reducing unplanned hospital re‑admissions compared to the previous financial year.

Low re‑admission rates may indicate good patient management practices and post-discharge care.

The Ministry’s data shows eight local health district met the target to reduce the rate of re‑admissions compared to the previous financial year. The statewide average rate increased from 6.3 per cent to 6.4 per cent.
3.11 Post discharge care for acute mental health patients
NSW Health has a goal to increase community-based care to acute mental health patients after they are discharged. Continuity of care in the community can lead to reduced symptom severity, lower re‑admission rates, and improved quality of life. The Ministry’s 2016–17 data shows the statewide average for post discharge follow-up of acute mental health patients within seven days was 70.0 per cent (66.0 per cent in 2015–16). The statewide average improved and met the NSW Health target of 70 per cent. Nine local health districts exceeded the NSW Health target.
3.12 Mental health acute re-admissions
NSW Health has a goal to reduce acute public sector mental health re-admissions. High re‑admission rates may indicate deficiencies in inpatient treatment and follow up care. The Ministry’s data shows twelve local health districts did not achieve the NSW Health target of 13 per cent mental health acute re‑admissions in 2016–17.
3.13 Unplanned and emergency re‑presentations

NSW Health aims to reduce the number of unplanned and emergency re‑presentations to emergency departments.

The Ministry’s 2016–17 data shows the State average of emergency department re‑presentations decreased marginally from 5.0 per cent in 2015–16 to 4.9 per cent.

Patients attending rural emergency departments are more likely to re‑present within 48 hours of being discharged than those in regional or metropolitan emergency departments.
3.14 Healthcare associated infection
The national target for the rate of Staphylococcus aureus (golden staph) bloodstream infection is two cases per 10,000 bed days. Data provided by the Ministry indicates the rate of golden staph bloodstream infection in New South Wales hospitals continues to be well below the target and national benchmark at 0.72 cases per 10,000 bed days in 2016–17 (0.75 in 2015–16).
3.15 Patient experience and satisfaction

The Bureau of Health Information analyses and reports on the results of patient surveys.

The Bureau’s survey shows 65 per cent of adult admitted patients rated the care they received in hospital as ‘very good’ and 29 per cent rated it as ‘good’.

NSW Health recognises that patient surveys are an important feedback mechanism on the health care system that can only come from personal experiences.

Published

Actions for Justice 2017

Justice 2017

Justice
Asset valuation
Compliance
Financial reporting
Fraud

The following report focuses on key observations and findings from the most recent audits of law and order and emergency services agencies in the Justice cluster.

No qualified audit opinions were issued on Justice agencies' financial statements. However, agencies that used the Department of Justice as their service provider experienced difficulties finalising their accounts. This was due to issues with the department’s implementation of a new financial accounting and reporting system and the continued establishment of its Business Support Centre. The Department is working to remediate the new finance system.

1. Financial reporting and controls

Financial reporting Unqualified audit opinions were issued for all agencies' 30 June 2017 financial statements. However, some agencies' year end financial reporting procedures were impacted by the implementation of a new finance system and processes at the Department.     
Early Close Early close procedures continue to help agencies present audited financial statements on time, but there is room for further improvement.
NSW Police Force Death and Disability Scheme The cost of the NSW Police Force Death and Disability Scheme was higher than the statutory target.
Fire and Rescue NSW Death and Disability Scheme The Fire and Rescue NSW Death and Disability Scheme liability was $179 million, but is projected to reach $257 million by 30 June 2022.
Internal Controls

The Department experienced significant, but avoidable internal control issues in its payroll and finance functions following implementation of a new IT finance system (Justice SAP) and continued establishment of its Business Support Centre.

We found 94 internal controls issues, including 28 findings repeated from the previous year.

Human Resources Agencies have not met State targets for managing annual leave balances.

 2. Service Delivery

Domestic violence reoffending            The Department reports decreases in domestic violence reoffending rates, but they remain above the Premier's target
Rates of reoffending      Adult reoffending rates remain above the State's priority target. Last year, more than half had returned to prison or Corrective Services within two years of release. The Department has introduced initiatives to reduce reoffending, but their impact will not be known for several years
Road Fatalities New South Wales' road fatalities decreased slightly in 2016–17, but remains slightly above the State priority target..
NSW crime trends NSW Bureau of Crime statistics and Research data shows the trend in most crime categories in New South Wales has been better than national trends over the last five years.
Adult inmate numbers Departmental data shows that NSW prisons remained overcrowded in 2016–17, but the rate of growth in inmate numbers slowed.
Adult inmate resources Data from the Department and the Justice Heath and Forensic Mental Health Network shows inmate access to some resources and services has not kept pace with increases in prison populations.
NSW District Court case backlog After falling last year, the backlog of cases in the NSW District Court again increased but the age of backlog cases decreased, according to Departmental data.
Hazard Reduction works The Office of the NSW Rural Fire Service advise adverse weather conditions reduced the total hectares of completed hazard reduction works by 50.7 per cent in 2016–17 compared to 2015–16.

This report provides Parliament and other users of the Justice cluster agencies' financial statements with audit results, observations, conclusions and recommendations for:

  • Financial reporting and controls
  • Service delivery.

The commentary in this report covers the following cluster agencies:

Financial reporting is an important element of good governance. Confidence in public sector decision making and transparency is enhanced when financial reporting is accurate and timely. Appropriate financial controls help ensure the efficient and effective use of resources and administration of agency policies. They are essential for quality and timely decision making.

This chapter outlines audit observations, conclusions and recommendations for financial reporting and controls of Justice cluster agencies.

Observation Conclusion or recommendation
2.1 Financial reporting
Unqualified audit opinions were issued for all agencies' financial statements. Unqualified audit opinions were issued for all agencies' 30 June 2017 financial statements. The Department and agencies that used the Department as their service provider, were impacted by the Department's Justice SAP, and Business Support Centre implementations.
2.2 Timeliness of financial reporting
Most agencies complied with the statutory timeframes for completion of early close procedures and preparation and audit of financial statements. Early close procedures continue to facilitate the timely preparation of financial statements and completion of audits. Early close procedures for some agencies was diminished by the Department's Justice SAP and Business Support Centre implementations.
2.3 Death and disability schemes

The cost of the NSW Police Blue Ribbon scheme reportedly decreased, but remains above the statutory target of 4.6 per cent of total NSW Police Officer's remuneration.

 

The Fire and Rescue Death and Disability Scheme liability has almost doubled over the past five years.

The Blue Ribbon Scheme cost $12.7 million or 10.4 per cent less in 2016–17 following an improvement in claims' experience. The was reflected in the cost of the scheme, which decreased from 6 per cent to 5.45 per cent of total NSW Police Officers’ remuneration.



The Scheme’s liability was $179 million at 30 June 2017, almost double the $92 million recorded at 30 June 2013. A five-year period has been used due to the sensitivity of annual movements in the liability to changes in discount rates. According to Fire and Rescue NSW projections the liability will reach $257 million by 30 June 2022.
2.5 Internal Controls
There were significant payroll and general finance related issues resulting from the Department's Justice SAP system implementation and establishment of the Business Support Centre. Recommendation: The Department should reinstate controls over financial information as soon as possible, and capture and apply lessons learned from recent project implementations, including LifeLink, in any relevant future implementations.
2.7 Human Resources    
More than a third of Justice cluster employees have annual leave balances above the State's target. Recommendation: Cluster agencies with annual leave balances above the State's target should proactively manage their leave balances. Particular focus should be given to employees who have taken little or no leave in the last 12 months.

Achievement of government outcomes can be improved through effective delivery of the right mix of services, whether from the public, private or not for profit sectors. Service delivery reform will be most successful if there is clear accountability for service delivery outcomes, decisions are aligned to strategic direction and performance is monitored and evaluated.

The Justice cluster is an integrated cluster with key service delivery inter-dependencies. Achieving State priorities and ensuring communities are safe requires both upstream and downstream agencies to be adequately resourced. This is a delicate balance. Increases in frontline policing can subsequently impact the court system. Court backlogs can in turn increase prison overcrowding, and limit the opportunities for inmate rehabilitation. Failure to successfully rehabilitate prisoners and prevent reoffending could impact future police resourcing.

This chapter outlines our audit observations, conclusions and recommendations related to service delivery by agencies in the Justice cluster for 2016–17.

Observation Conclusion or recommendation
Data from the NSW Bureau of Crime Statistics and Research shows that domestic violence reoffending decreased from 15.9 per cent in 2014–15 to 15.5 per cent in 2015–16, but remains 4.8 percentage points above the Premier's target. Reducing domestic violence reoffending is challenging. While there was a marginal improvement in 2015–16, the Justice cluster needs to continue efforts to reduce reoffending rates, if the Premier's priority target is to be met by 2019. 
Productivity Commission data shows that in the year to 30 June 2016, 50.7 per cent of released prisoners had returned to prison and 55.1 per cent to Corrective Services, within two years of release. There has been a consistent increase in reoffending rates over the last five years.

Recommendation: The Department should reassess the sufficiency and effectiveness of measures aimed at reducing reoffending, including the recently announced initiatives, if the State priority target is to be met by 2019.

A $237 million program to reduce reoffending was announced in August 2016. While new initiatives were introduced in 2016–17, their impact on reoffending rates will not be known for several years.
New South Wales' road fatalities per 100,000 people slightly exceeded the 2016–17 target. Statistics from the NSW Centre for Road Safety shows that New South Wales' road fatalities decreased to 4.6 deaths per 100,000 people in 2016–17, slightly above the State priority target of 4.3 deaths. This is better than the 5.1 deaths recorded in 2015–16, but worse than the 4.0 deaths in 2014–15.
 
Between 31 December 2012 and 31 December 2016, the number of crimes has trended down in most crime categories, except for sexual assault, which has increased in each of the last five years. The downward trend in most crime categories indicates the cluster is effectively achieving the State’s priority to prevent and reduce crime. However, the Department should assess whether the mix of offered programs is consistent with crime trends.
Department data shows that the NSW prison system remained overcrowded in 2016–17.

Overcrowding of correctional centres can negatively impact all aspects of custodial life, and ultimately higher reoffending rates.

 
Data from the Department shows that the inmate population reached 13,253, compared to an operational capacity of 13,402 beds on 27 August 2017. This equates to an operational vacancy rate of 1.1 per cent, which is significantly less than the recommended 5.0 per cent buffer. However, the rate of inmate growth slowed to 5.1 per cent, from 11.8 per cent in 2015–16.

The Department should ensure that measures aimed at reducing reoffending are not compromised by continued overcrowding. Reoffending, will in the long term contribute to further overcrowding.
 
Adult inmate resources. Inmate access to some resources and services has not kept pace with increases in prison populations, such as the ratio of nurses to inmates. In addition, Productivity Commission information on out-of-cell hours in 2015–16 shows New South Wales prisoners' average time out-of-cell of 7.8 hours was the lowest of any Australian jurisdiction. 
After falling in 2015–16, the backlog of cases in the NSW District Court increased again in 2016–17. The age of cases however decreased in 2016–17 compared to 2015–16. A working group which includes the Department and the Chief Judge of the District Court has identified a number of new measures to address the backlog. The Department needs to assess whether these measures will be sufficient, given that the backlog increased again in 2016–17. As noted in financial reporting and controls chapter, staffing levels in a number of just cluster agencies increased in 2016–17, in response to the backlog.
Department data shows the annual cost of a juvenile detainee decreased from $355,444 to $335,840 (5.5 per cent) in the three-year period between 2014–15 and 2016–17. The Department has been analysing the Juvenile Justice division's operating costs in the context of declining custodial numbers, and has achieved some cost savings. The savings in part reflect decreases in the number of detainees.    
The Office of the NSW Rural Fire Service data shows that completed hazard reduction works decreased in 2016–17. The total hectares of completed hazard reduction works decreased 50.7 per cent in 2016–17 compared to 2015–16. The Office of the NSW Rural Fire Service attributes the decrease to adverse weather conditions during the peak burning period

Published

Actions for Sharing school and community facilities

Sharing school and community facilities

Education
Infrastructure
Management and administration
Risk
Shared services and collaboration

Schools and the community would benefit if school facilities were shared more often. 

The Department of Education’s ‘Community Use of School Facilities Policy’ encourages but does not require schools to share facilities. Sharing depends heavily on the willingness of school principals and there are few incentives. There are many challenges in developing agreements with community users and there is only limited support available from the Department.

There are strategies and plans to support the sharing of facilities between schools and the wider community, but none are backed up with budgets, specific plans or timeframes.

Governments should strive for the best use of assets. This is particularly important in the context of a growing New South Wales population, fiscal constraints and increasing demand for services. 

Lack of available land, rising land costs and population growth highlighted in our April 2017 'Planning for school infrastructure' performance audit report mean that new and existing schools will need to share their facilities with communities more than is currently the case.

This audit assessed how effectively schools share facilities with each other, local councils and community groups. In making this assessment, the audit examined whether the Department of Education (Department):

  • has a clear policy to encourage and support facilities sharing
  • is implementing evidence-based strategies and procedures for facilities sharing
  • can show it is realising an increasing proportion of sharing opportunities.

Facilities sharing is the use of a physical asset, such as a building, rooms, or open spaces, by more than one group for a range of activities at the same time or at different times. For the purposes of this audit, we have divided sharing arrangements into two types: shared use and joint use.

Shared use refers to arrangements where existing school assets are hired out for non-school purposes, usually for a limited time. The assets remain under the control of the school. Generally, there is little alteration or enhancement to the asset required to enable shared use. Shared use can also refer to schools using external facilities, such as council pools, but these arrangements are not included within the scope of this audit. 

Joint use refers to arrangements where new or upgraded school and non-school facilities or community hubs are planned, funded, built and jointly shared between a school and other parties, usually involving significant investment. 

Both shared use and joint use agreements are governed by contractual obligations.

Conclusion
The sharing of school facilities with the community is not fully effective. The Department of Education is implementing strategies to increase shared and joint use but several barriers, some outside the Department’s direct control, must be addressed to fully realise benefits to students and the community of sharing school facilities. In addition, the Department needs to do more to encourage individual schools to share facilities with the community. 

A collaborative, multi-agency approach is needed to overcome barriers to the joint use of facilities, otherwise, the Department may need significantly more funds than planned to deliver sufficient fit-for-purpose school facilities where and when needed.
Government policies encourage, but do not mandate, shared and joint use of facilities.

Since the early 2000’s, several reviews in NSW and other jurisdictions have commented on the benefits of and need to increase the sharing of school facilities. 

Several NSW Government strategies and plans support shared and joint use of facilities between schools and the wider community, but none are backed up with financial incentives, or specific plans with implementation timeframes. In Victoria and Queensland whole-of-government processes are in place to support a more coordinated approach to planning, building and sharing community facilities. For example, Victoria has a comprehensive policy framework encompassing both existing and future use of community facilities and a $50 million program to seed the development of community facilities on school sites over the next four years.  
The Department recognises benefits from the shared use of school facilities, but provides insufficient support to Principals to ensure costs are recovered and that money raised from shared use can be spent by the school in a timely manner. 

There are examples of successful shared use, but more can be done. Information about the available facilities is not readily available to potential community users. Schools should work more closely with councils and other stakeholders to leverage shared use. 

Currently, the administrative burden, costs and risks associated with shared use can exceed the perceived benefits to schools, leading to reluctance amongst some Principals to share. In addition, a substantial backlog of school-initiated infrastructure proposals awaiting Departmental approval means that schools that raise money from sharing their facilities find it difficult to use the funds they raise on improved infrastructure. Some of these proposals have been waiting for approval for more than 12 months. 

The Department could do more to support Principals by ensuring the fees charged for facilities cover the costs incurred by schools, that Principals can access help with negotiating and managing contracts, and that infrastructure proposals initiated and funded by schools are approved in a timely manner. 

The Department is not monitoring shared use across the State, and does not evaluate different approaches as evidence to influence policies and procedures.

Recommendations
By December, 2018, the Department should:
  • increase incentives and reduce impediments for school Principals to share school facilities, including:
    • review the methodology for calculating fees charged for facilities to ensure that shared use of school facilities does not result in a financial burden to schools or the Department 
    • improve support provided to Principals by School Infrastructure NSW, including reducing the backlog of school-initiated infrastructure proposals awaiting approval
    • develop service standards, including timeframes, for assessing and approving school-initiated infrastructure proposals.
  • provide readily-accessible information about available school facilities to community groups and local councils
  • implement processes to monitor and regularly evaluate the implementation of the shared use policy and promote better practice to drive improvements.
The Department is planning a more strategic approach to increase the joint use of school facilities. However, several barriers, some outside the Department’s control, must be addressed to fully realise benefits of joint use agreements.

As discussed in our 2017 audit report on ‘Planning for school infrastructure’, joint use agreements are a key direction of the School Assets Strategic Plan. Joint use of school facilities will be necessary to ensure that there will be enough fit-for-purpose learning spaces for students when and where needed. Under the ‘Community Use of School Facilities Policy’ Principals play the leading role in identifying opportunities, and developing and managing agreements for sharing school facilities. This is impractical for joint use projects which involve substantial investment in new or refurbished assets, in particular for joint use projects in schools that are yet to be built. In addition, the policy does not address joint-use facilities built on land not owned by the Department. For these reasons, the Department is developing a new policy. 

The Department is planning to develop joint use agreements in a more systematic way as part of school community planning, previously known as cluster planning, with a special focus on local councils. Several agreements are currently being piloted, and will be evaluated to provide an evidence-based foundation for this new approach. 

To develop or refurbish school facilities for joint use, the Department, councils and other key stakeholders must work together and prioritise joint use from the earliest stages of any project. A collaborative, multi-agency approach is needed to ensure sufficient fit-for-purpose facilities are available for school students within the funding framework proposed in the School Assets Strategic Plan. 

To increase shared and joint use, the Department is recruiting specialist staff in its Asset Division to assist with the brokerage, community engagement and development of agreements, but these staff are not dedicated to joint use projects and their available time may not be sufficient to provide the necessary support in the timeframes required.

Recommendations
By December, 2018, the Department of Education should:
  • ensure that the implementation of the new ‘Joint Use of School Facilities and Land Policy’ is adequately resourced, and has the support of Principals
  • implement processes to monitor and regularly evaluate the implementation of joint use policy and promote better practice to drive improvements.  

Published

Actions for State Finances 2017

State Finances 2017

Finance
Health
Industry
Justice
Local Government
Planning
Premier and Cabinet
Treasury
Universities
Whole of Government
Environment
Asset valuation
Financial reporting
Information technology
Internal controls and governance

Total State Sector Accounts received an unqualified audit opinion for the fifth consecutive year.

There was a $5.7 billion State budget surplus and continued investment in new infrastructure, in part funded by the long-term leases of Ausgrid and Endeavour Energy assets. This report also comments on key accounting matters, including the correction of some previously reported balances and the first time reporting of combined Cabinet members’ compensation in the Total State Sector Accounts.

Pursuant to the Public Finance and Audit Act 1983, I present my Report on State Finances 2017.

You will note that the format of this report has changed from previous years.

The intent of this change is to draw attention to the key matters that have been the focus of our audit and highlight significant factors that have contributed to the outcome.

First, it is pleasing to report once again that I issued a clear audit opinion on the State’s consolidated financial statements. This outcome demonstrates the Government’s continued focus on the quality of financial reporting across the NSW public sector.

High quality financial management and reporting are crucial to properly inform the public and build community confidence in our system of government.

The Treasury’s Financial Management Transformation program also aims to improve financial governance, budgeting and reporting arrangements across the sector. My Office is working collaboratively with The Treasury on reforms to reduce the burden of reporting, without weakening established safeguards.

The reforms should include measures to provide independent assurance of the budget process, of outcome reporting by agencies, and the power to “follow the dollar” given the increasing use of non-government organisations to deliver Government programs.

This Report also highlights another year of strong financial performance. The State’s budget result was a $5.7 billion surplus, and investment in new infrastructure has continued, in part funded by the long-term leases of Ausgrid and Endeavour Energy assets.

Finally, could I take this opportunity to thank the staff of The Treasury for the way they approached this audit. Our partnership is critical to ensuring NSW is an exemplar of quality financial management and reporting.

02_Margaret_signature.jpg

Margaret Crawford 
24 October 2017

A clear audit opinion on the State’s consolidated financial statements was issued.

Timely and accurate financial reporting is essential for informed decision making, effective management of public funds and enhancing public accountability.

This year’s clear audit opinion reflects the Government’s continued efforts to improve the quality of financial reporting across the NSW public sector.

Since the introduction of ‘early close procedures’ in 2011-12, the number of significant errors in financial statements of agencies has generally fallen largely due to identifying and resolving complex accounting issues early. Agencies’ 2016-17 financial statements submitted for audit contained nine errors exceeding $20 million. All errors were subsequently corrected in the individual agencies financial statements.

Agencies should continue to respond to key accounting issues as soon as they are identified. Where issues are identified, accounting position papers should be prepared for consideration by the Audit Office, their Audit and Risk Committee members, and when relevant, The Treasury.

The State addressed the following key accounting matters during 2016-17. 

The State recognised rail tunnels and earthworks valued at $8.5 billion.

Some rail tunnels and earthworks have never been valued by the State. These include the City Circle, the country rail network and other tunnels and earthworks built before the year 2000. Some of these tunnels and earthworks date back to the early 1900s.

For many years, the State did not account for these assets as they believed that their value could not be reliably measured. This year an independent valuer was engaged to perform a comprehensive valuation. The methodology used demonstrated
that the assets could have been reflected in the financial statements earlier.

The State recorded an additional $8.5 billion to correct the value of infrastructure assets at 1 July 2016.

Cabinet member’s compensation and related party transactions were reviewed.

Due to changes in Accounting Standards, the State had to consider 'related party information' in the financial statements. Previously this only applied to for-profit entities.

This year, requirements to report related party information extended to members of Cabinet, considered to be “key management personnel” of the State, as defined by Accounting Standards.

The Treasury implemented a process to assess and report Cabinet member’s compensation, and transactions between Cabinet members and/or their close family members, and government agencies.

Collectively, Cabinet members’ remuneration was $8.8 million, which was mainly salaries and allowances, and $3.5 million of non-monetary benefits such as security and drivers. The Treasury determined there were no other specific “related party” transactions or balances that required disclosure in the State’s financial statements.

Information system limitations continue at TAFE NSW.

TAFE NSW has experienced ongoing issues with its student administration system.

TAFE NSW has again implemented additional processes to verify the accuracy and completeness of revenue from sales of goods and services.

TAFE NSW expects to spend up to $89 million on a new information system to address these issues. Modules of the new student enrolment system are expected to be in place for the 2018 enrolment period.

Restatements relating to the General Government Sector's investment in the commercial sector.

The State corrected two previously reported balances relating to the General Government Sector’s investment in the commercial sector.

Accounting Standards require the General Government Sector to effectively store gains or losses related to its investment in the commercial sector in reserves until the investment is derecognised.

When these investments are disposed of, the cumulative gains and losses must be cleared and recognised in the operating result. However, the Government had previously cleared the cumulative gains and losses directly to Accumulated Funds within equity.

To comply with Accounting Standards, a total of $6 billion previously reported as a movement in equity  at 30 June 2016, has now been corrected to the operating result.

In addition, Accounting Standards only allow gains or losses on its investments to be stored in reserves. In past years, the State recognised all changes in the value of its investment in Available for Sale Reserves, including the capital contributed to establish the State’s investment. In 2016-17, a total of $23.4 billion of contributed capital was corrected to accumulated funds at 1 July 2015.

The State’s budget result was a $5.7 billion surplus, $2.0 billion higher than the budget estimate.

The Total State Sector comprises 310 entities controlled by the NSW Government.

Of the total, the General Government Sector comprises 215 entities that provide goods and services not directly paid for by consumers.

The non-General Government Sector comprises 95 Government businesses that provide goods and services such as water and electricity, or financial services.

A principal measure of a Government’s overall performance is its Net Operating Balance, or Budget Result. The Net Operating Balance reports the difference between the cost of General Government service delivery and the revenue earned to fund these sectors.

The State has recorded budget surpluses and exceeded the original budget result in nine of the last ten years.

The State maintained its AAA credit rating.

The object of the Act is to maintain the AAA credit rating.

NSW’s finances are managed in alignment with the Fiscal Responsibility Act 2012 (the Act).

The Act established the framework for fiscal responsibility and strategy needed to protect the State’s AAA credit rating and service delivery to the people of NSW.

The purpose of maintaining the AAA credit rating is to reduce the cost of, and ensure the broadest access to, borrowings.

A triple-A credit rating also helps maintain business and consumer confidence so economic activity and employment are sustained. The legislation sets out targets and principles for financial management to achieve this.

New South Wales has credit ratings of AAA/Negative from Standard & Poor’s and Aaa/Stable from Moody’s Investors Service.

The fiscal targets for achieving this objective are:

General Government expenditure growth is lower than long term revenue growth.

General Government expenditure growth was 4.2 per cent in 2016-17, below the long-term revenue growth of 5.6 per cent.

Eliminating unfunded superannuation liabilities by 2030.

The Act sets a target of eliminating unfunded defined benefit superannuation liabilities by 2030. The State’s net superannuation liability was $58.6 billion at 30 June 2017 ($71.2 billion at 30 June 2016).

The Government predicts the 2030 target will be achieved. The State’s funding plan is to contribute amounts escalated by five per cent each year so the schemes will be fully funded by 2030. In 2016-17, the State made employer contributions of $1.5 billion, which is largely consistent with contributions over the past five years.

The liability values in the graph below do not reflect the values recorded in the Total State Sector Accounts. For financial reporting purposes, Accounting Standards (AASB 119 Employee Benefits) require the State to discount its superannuation liability using the government bond rate (refer to page 10 of this report). 

The relevant government bond rate in the current economic climate is 2.62 per cent.

The State’s target for the unfunded superannuation liability is measured using AASB 1056 Superannuation Entities. This is because it adopts a measurement basis that reflects expected earnings on fund assets, which are currently between 5.9 and 7.4 per cent. Using these rates, the liability is $15.0 billion at 30 June 2017 ($16.1 billion at 30 June 2016). The unfunded liability is $2.4 billion less than when the Act was introduced.

The State’s assets grew by $31.6 billion during 2016-17 to $409 billion.

Valuing the State’s physical assets.

When we audit the financial statements, we focus on areas we consider as higher risk. These areas are often complex, and require the use of estimates and judgements.

The State has $307.2 billion of physical assets measured at fair value in accordance with Australian Accounting Standards. Fair value calculations are inherently complex and sensitive to assumptions and estimates, increasing the risk these assets are incorrectly valued.

In our audits, we assess the reasonableness and appropriateness of assumptions used in valuing physical assets. This includes obtaining an understanding of the valuation methodologies applied and judgements made. We also review the completeness of asset registers, and the mathematical accuracy of valuation models.

Net movements between years includes additions, disposals, depreciation and valuations. This year, valuations of physical assets added $16.2 billion to the State’s assets, comprising: 

  • Transport for NSW and Railcorp $8.5 billion

  • New South Wales Land and Housing Corporation $4.8 billion

  • Roads and Maritime Services $930 million

  • Crown Entity $400 million.    

The State’s financial assets increased $27.5 billion in 2016-17

The State’s financial assets have increased by 88 per cent over the past four years. In 2016-17, financial assets increased primarily due to proceeds from the sale of government assets and businesses.

The Government implemented reforms to better use the State’s financial assets. A key element was the creation of an Asset and Liability Committee (ALCO) to provide advice on ways to improve balance sheet management.

Since the creation of the ALCO, reforms include:

  • Establishment of the New South Wales Infrastructure Future Fund (NIFF). The net proceeds from the State’s asset recycling program are invested into the NIFF, which is managed by TCorp, with a balance of $14.6 billion by 30 June 2017. Funds raised are invested through the NIFF until the Government requires them for critical infrastructure projects that are part of the Restart NSW and Rebuilding NSW program of works. ALCO and TCorp provide advice on the NIFF’s performance and management

  • Establishment of the Social and Affordable Housing Fund ($1.1 billion at 30 June 2017). ALCO oversees the Fund to ensure an appropriate investment approach that will maintain funding certainty for new social and affordable housing stock

  • Cash and liquidity management reforms to centralise cash previously held by agencies in the Treasury Banking System. This reform is designed to ensure agencies have adequate levels of liquidity but with surplus funds invested centrally for better returns.

The State’s liabilities decreased by $13.1 billion during 2016-17 to $182 billion.

Valuing the State’s liabilities relies on an actuarial assessment.

Nearly half of the State’s liabilities relate to its employees. This includes unfunded superannuation, and employee benefits, such as long service and recreation leave.

Valuation of these obligations is subject to complex estimation techniques and significant judgements. Small changes in assumptions can materially impact the financial statements.

We address the risk associated with auditing these balances:

  • using actuarial specialists

  • testing controls around underlying employee data used in data models, and testing the accuracy of the calculations

  • evaluating assumptions applied in calculating employee entitlements such as the discount rate and the probability of long service leave vesting conditions being met.

The State’s superannuation obligations reduced by $12.6 billion in 2016-17.

The State’s $58.6 billion superannuation liability represents obligations for past and present employees, less the value of assets set aside to meet those obligations. The superannuation liability decreased from $71.2 billion to $58.6 billion, largely due to an increase in the discount rate from 1.99 per cent to 2.62 per cent. This alone reduced the liability by $9.2 billion

The State’s borrowings totalled $70.6 billion at 30 June 2017.

The State’s borrowings totalled $70.6 billion at 30 June 2017, $9.5 billion less than the previous year. This was largely due to the repayment of borrowings when the assets of Ausgrid and Endeavour Energy were leased to the private sector.

TCorp issues bonds to raise funds for NSW Government agencies. The bonds are actively traded in financial markets providing price transparency and liquidity to public sector borrowers and institutional investors. All TCorp bonds are guaranteed by the NSW Government.

The Government manages its debt liabilities through its balance sheet management strategy. The strategy extends to TCorp, which applies an active risk management strategy to the Government’s debt portfolio.

General Government Sector debt is being restructured by replacing shorter-term debt with longer-term debt. This lengthens the portfolio to better match liabilities with the funding requirements of infrastructure assets and reduces refinancing risks. It also allows the Government to take advantage of the low interest rate environment.

The State recorded revenue of $83.5 billion in  2016-17, an increase of $5.3 billion from 2015-16.

The State’s results are underpinned by revenue growth in taxation, fees and fines.

Taxation, fees, fines and other revenue comprises $30.5 billion of taxation ($28.7 billion in 2015-16) and $5.3 billion of fees, fines and other revenue ($4.6 billion).

Tax revenue for the Total State Sector increased by $1.8 billion, or 6.4 per cent compared to 2015-16, primarily due to:

  • one-off business asset sales and lease transactions, including $718 million in transfer duty from the Ausgrid and Endeavour Energy lease transactions

  • $385 million increase in payroll tax from growth in NSW employment and average employee compensation

  • a $426 million increase in land taxes.

Growth in stamp duty is expected to slow over the next 4 years.

General Government Sector stamp duties have increased from $6.2 billion in 2012-13 to $11.5 billion in 2016-17, an annual average growth rate of 16.5 per cent. The Government’s budget forecasts the growth in stamp duties to decline, to an average annual growth rate of 2.6 per cent between 2016-17 and 2020-21.

The State received Commonwealth grants and subsidies of $30.8 billion in 2016-17.

The State received $30.8 billion from the Commonwealth Government in 2016-17, $1.6 billion more than in 2015-16. This was primarily due to transaction based asset recycling grants of $1.0 billion and a $720 million increase in national land transport grants. This increase was offset by a $435 million decrease in General Purpose Grants, which mainly comprises New South Wales’ share of the Goods and Services Tax (GST). 

The State spent $79.4 billion in 2016-17 to deliver services to the community, an increase of $3.9 billion from 2015-16.

Overall expenses increased 5.2 per cent from last year. Most of the increase was due to higher employee costs and operating costs.

Total salaries and wages increased by 4.2 per cent from 2015-16.

Total salaries and wages increased to $30 billion from $28.8 billion in 2015-16. The Government wages policy aims to limit the growth in remuneration and other employee costs to no more than 2.5 per cent per annum.

Operating expenses increased by 12.4 per cent from 2015-16.

Within operating expenses, payments for supplies, services and other expenses increased, in part, due to the State:

  • reacquiring mining licenses worth $482 million and additional land remediation costs of $101 million

  • spending more on health including additional drug supplies relating to Hepatitis C.

State spend on transport and communications increased by 68.1 per cent since 2012-13.

While spending on health and education remain the largest functional areas provided by Government, expenditure on transport and communication increased, on average, by 13.9 per cent annually between 2012-13 and 2016-17. This increase reflects the Government’s investment in transport infrastructure such as the Sydney Metro and Westconnex. Over the same period, spending on health increased by $3.9 billion.

Expenditure on fuel and energy has decreased by an average of 44.7 per cent since 2012-13, reflecting the State’s leases of electricity network assets.

In 2011, the Government established Restart NSW to fund high priority infrastructure projects.

Restart NSW projects are primarily funded from the proceeds from the asset recycling program enabling Government to deliver new infrastructure investment.

Restart NSW provides funding for the delivery of Rebuilding NSW, which is the Government’s 10-year plan to invest $20 billion in new infrastructure.

The State finalised long-term leases of Ausgrid and Endeavour Energy assets.

In June 2017, the Government finalised its long-term lease of 50.4 per cent of Endeavour Energy. This transaction follows on from the long-term leases of TransGrid in December 2015 and 50.4 per cent of Ausgrid in December 2016. Net proceeds of $15.0 billion were paid into Restart NSW relating to these transactions.

The Government also finalised an arrangement for the private sector to provide land titling and registry services to the public for 35 years. The State, through Restart NSW, received an upfront payment of $2.6 billion from the new operator.

Restart NSW is funding $29.8 billion of new infrastructure.

The Government has detailed its plan to invest $20 billion into the Rebuilding NSW plan from Restart NSW.

At 30 June 2017, around $2.9 billion has already been spent on Rebuilding NSW projects from Restart NSW, with a further $9 billion included in the budget aggregates. The Government has also earmarked a further $8.1 billion in Restart NSW for future projects.

The most significant project is the Sydney Metro. The Government has committed $7.0 billion from Restart NSW to build a 30-kilometre metro line, linking Sydney Metro Northwest at Chatswood, through new stations in the lower North Shore, the Sydney CBD and southwest to Bankstown. At 30 June 2017, $2.4 billion has been spent on this project from Restart NSW.

Other significant projects funded by Restart NSW include a $1.8 billion contribution to WestConnex and reserved funding of $1 billion towards the State’s Major Stadia Network program.

The Treasury initiated the Financial Management Transformation (FMT) program with the aim of changing and improving financial governance, budgeting and reporting arrangements of the New South Wales public sector.

FMT aims to deliver better outcomes for the people of New South Wales and focuses on transparency and accountability for expenditure, and better value for money.

New Financial Management System

PRIME is the Information Technology (IT) solution component of the FMT program, replacing several historical systems. PRIME will provide both financial and performance information within one IT platform for all agencies in the NSW public sector.

It is expected to give Government more timely information to plan and deliver its policy priorities and the budget.

Independent assurance over the budget process would improve confidence in the reliability of the State’s financial information.

Published

Actions for Information and Communication Technologies in schools for teaching and learning

Information and Communication Technologies in schools for teaching and learning

Education
Information technology
Infrastructure
Management and administration
Service delivery
Workforce and capability

Several factors are reducing effective use of information and communication technology (ICT) in the classroom.

These are primarily:

  • ageing ICT equipment and inadequate wireless networks
  • variable student access to devices at school
  • variable teacher access to centrally provided devices for use outside of the classroom.

Information and communication technologies (ICT) are pervasive in modern life. Australian research has identified that the workforce demand for digital literacy and advanced digital skills is growing across most areas of work. There is broad agreement internationally and in Australian school systems that digital literacy is a core skill for the workforce and students will need to be confident with ICT. Education systems around the world are using ICT in classrooms to support learning and employment goals.  

The New South Wales Department of Education’s (the Department’s) overall strategic directions for teaching and learning with ICT are set in the 'Strategic Information Technology Plan 2016–19'. The Department centrally provides a base level of resources to schools for ICT and schools supplement funding from their existing school budget and Parents and Citizens Associations. Each school decides how to allocate these funds to meet local needs. Schools also set expectations for how teachers and students will use technology to help deliver outcomes.

This audit assessed how well New South Wales public schools are using ICT to improve teaching and learning. It focussed on planning and teacher and student use of ICT. We examined whether:

  • the Department identifies key strategic opportunities to enhance the use of ICT platforms and technologies in schools
  • teachers are integrating ICT into classroom practice
  • the Department monitors the impact of ICT on student learning.
Conclusion 

Several factors are reducing the effective use of ICT in the classroom. These are primarily:

  • ageing ICT equipment and inadequate wireless networks
  • variable student access to devices at school
  • variable teacher access to centrally provided devices to use outside of the classroom.

Many schools are struggling to keep up with growing ICT needs within available funding. The Department needs to review whether its current technology programs provide schools with sufficient resources and support to meet the Department’s strategic goals for 21st Century classrooms. The Department should also target additional support to schools to improve planning for ICT resources.  

Most teachers are using ICT in the classroom, however, teacher access to devices outside the classroom varies between schools. In practice, teacher working days extend outside classroom hours. Teachers need access to devices for activities such as lesson preparation and student assessment. With limited access to devices outside of the classroom, teachers may not be able to effectively integrate ICT into lessons. Teachers also require further professional learning to support them to develop their skills in using ICT.  

The Department is not sufficiently monitoring the digital literacy of New South Wales students, which has declined in national tests. Teachers could benefit from support to assess these skills at a school level. The Department also needs to investigate links between student use of ICT and learning outcomes, so they can better support teachers with evidence-based approaches to enhancing learning through ICT.

Old equipment and wireless networks are not keeping pace with modern demands

The Department’s vision for ICT is to enable ‘any learning opportunity, anywhere, anytime’. This vision is at risk due to an ageing stock of devices and wireless networks. The average age of devices in New South Wales schools is over four years. Older devices are less reliable, require greater maintenance and support, and cannot run demanding applications. Further, many school wireless networks are beyond the end of their useful life. This limits the number of teachers and students who can access online content on wireless networks at the same time.

The central funding model for ICT in schools is not meeting current needs

Funding for the Technology for Learning program to deliver ICT in schools has not increased since 2004, despite an increase in the number of students and emphasis placed on ICT in teaching and learning during this time. Schools supplement funding for ICT from their existing school budget and Parents and Citizens Associations.  

The Department’s current funding model for ICT is not adequately addressing a growing gap in the provision of contemporary ICT in classrooms between schools able to access funding from other sources and those which cannot. The Department needs to review whether the Technology for Learning program is equitable in equipping all schools with the modern technology needed to achieve its vision.

Many teachers are not provided with devices for use outside of the classroom

School Principals we interviewed reported that technology is an essential part of a modern classroom and teacher access to devices outside of the classroom can impact how they use ICT. This is because, in practice, teacher working days extend outside classroom hours and teachers need access to devices for activities such as lesson preparation and student assessment. The Department provides teachers with access to a suite of software tools for these tasks.

The Commonwealth Government’s Digital Education Revolution program provided teachers of secondary school students with laptops from 2009 to 2013. The Department’s evaluation of the Digital Education Revolution program found that teachers reported greater confidence with, and use of, ICT throughout the program.  
Providing desktop computers, laptops or tablets for teachers is now a school level decision and arrangements vary across schools. Each school must trade-off between allocating devices for students and teachers. Most other States and Territories provide all teachers with a laptop for use in and outside of the classroom or offer subsidised access to one.  

There is limited teacher professional learning in the use of ICT

The Department’s research has identified that professional learning is an important factor in how effectively teachers use ICT to enhance teaching and learning. Despite this, the Department provides few courses on using ICT in the classroom directly, and most of these are offered in Sydney. This limits accessibility for teachers outside of the metropolitan area. Schools we visited reported that the costs of courses and providing relief teachers limits the number of external courses or events that teachers attend, especially for rural and regional schools. Increasing the use of online learning would improve access for teachers in these areas.  

The Department is not adequately monitoring trends in professional learning in ICT or evaluating the overall effectiveness of courses. A recent upgrade to the professional learning system may provide the Department with better quality data to do this.

Greater monitoring and reporting on technology use in schools is required

The Local Schools, Local Decisions policy gives schools greater authority to make strategic decisions on the use of ICT appropriate to their local contexts. To support this, the Department needs to better monitor current trends, and identify emerging needs to determine future direction and how best to support schools.  

For example, the Department does not currently know how many devices are allocated to teachers or how many schools have implemented a student Bring Your Own Device scheme. This affects how schools are using ICT, and places demand on the network and the type of support the Department must provide. An assessment of the ICT maturity of schools would help the Department target its resources to schools requiring greater assistance with planning.

The Department does not regularly monitor or report on student capabilities with ICT. A national assessment found that the ICT literacy of a sample of Year 6 and Year 10 New South Wales students fell between 2011 and 2014. The fall was greater in New South Wales than in other States and Territories. Without more regular assessment or reporting, the reasons behind this fall and the distribution of student capabilities between schools will remain unknown. 

By July 2018, the Department of Education should:

  1. Review the Technology for Learning program and school ICT support resourcing to determine whether resourcing is adequate for modern school requirements.
     
  2. Develop a program to improve wireless networks in all NSW schools, for instance by expanding the Connecting Country Schools Program to all NSW schools.  
     
  3. Implement an assessment of school ‘ICT maturity’ and use this to target assistance to those schools requiring support with forward planning for ICT.
     
  4. Improve the use of evidence to inform plans and strategies, including:
    • more detailed monitoring of teacher and student access to and use of ICT
    • evaluating the impact of teacher professional learning on student outcomes 
    • further examining the links between ICT and student outcomes.
       
  5. Improve teacher access to devices for use outside of the classroom to improve how effectively they integrate ICT into teaching and learning.
     
  6. Improve teacher professional learning by providing more:
    • online learning opportunities for teachers in regional and remote areas
    • courses focused on pedagogy to make best use of ICT.
       
  7. Identify the ICT skills students need, and provide teaching resources to develop these skills and monitor their achievement.

Appendix One - Response from the Agency

Appendix Two - About the audit

Appendix Three - Performance auditing

 

Parliamentary reference - Report number #289 - released 6 July 2017 

Published

Actions for Sydney Road Maintenance Contracts

Sydney Road Maintenance Contracts

Transport
Infrastructure
Internal controls and governance
Management and administration
Procurement
Project management

In November 2013, Roads and Maritime Services (RMS) outsourced the maintenance of State roads in the Sydney region south and west zones using an innovative contracting approach called the Stewardship Maintenance Contract (SMC). The SMC links risk to reward, and uses a performance framework where outcomes should drive improved performance over time.

RMS’ SMC contract management includes most elements of good practice, including governance and dispute resolution mechanisms. However, key elements are missing which reduces its effectiveness.

Roads and Maritime Services (RMS) is responsible for the Sydney region State roads network This includes over 2,800 kilometres of roads and associated road corridor infrastructure such as bridges, tunnels and drainage structures. RMS divides the network into three geographical areas: south, west and north zones.

In 1995, RMS first outsourced road corridor infrastructure maintenance for the north zone through a Performance Specified Maintenance Contract (PSMC). The current 10-year PSMC for the north zone will expire in October 2018. Prior to November 2013, RMS maintained roads in the south and west zones through its Road and Fleet Services unit. 

In November 2013, RMS outsourced road maintenance services for the south and west zones using Stewardship Maintenance Contracts (SMC). The contracts run for seven years with an option for a further three years at RMS’ discretion. RMS estimated that the annual cost of these contracts was around $240 million in total. In March 2018, the contract prices are due to be reset by negotiation to reflect the contractors’ experience with, and better information about, the road networks and routine maintenance requirements. 

The SMC model adopted stewardship principles to improve value for money. RMS defined stewardship principles as a broad set of values, attitudes and behaviours, required of the contractor to effectively manage the assets on behalf of RMS. The SMC also includes commercial principles, such as linking risk to reward, and a performance framework where outcomes drive performance.

This audit assessed whether RMS had effectively managed the outsourcing of road maintenance in the Sydney region south and west zones. In making this assessment, we answered the following questions:

  1. Did RMS justify the decision to adopt the SMC model?
  2. Do SMCs include key performance indicators (KPIs) and incentives which promote efficiency and effectiveness? 
  3. Does RMS collect high quality information on contractor performance and take action to correct performance deficiencies?
  4. Are the expected benefits being achieved?

Conclusion

RMS developed an innovative contracting approach with the SMC. RMS has realised some benefits in the first year, including savings, from outsourcing road maintenance in the Sydney region south and west zones using the SMC. However, RMS’ management of the SMC has key elements missing which reduces its effectiveness.

The SMC includes performance measures and incentives to drive efficiency and effectiveness improvements over time.  

RMS has established a contract management framework which includes most elements of good practice, including governance and dispute resolution mechanisms. However, it does not have procedures to guide its contract managers in managing specific provisions of the SMC. Consequently, RMS has not exercised several significant SMC requirements, such as having the contractor account for an efficiency dividend in its pricing at the start of each three-year works period. It also has not done enough to assure itself that the contractor provided performance and financial data are correct. This is important because the data is used to measure performance and calculate contractor payments.  

RMS assessed that it had achieved around 80 per cent of the expected cost benefit in the initial year of the SMC. However, it has not tracked its achievement of benefits since then.

The Stewardship Maintenance Contract

RMS justified adopting the SMC model and included KPIs to drive efficiency and effectiveness

The SMC model includes features that RMS had not previously used for road maintenance contracts. These included adopting stewardship principles and transferring price risk to the contractor over time as the contractor becomes familiar with the assets being maintained.

The SMC model meets RMS’ requirements for flexibility in pricing models, the need for collaboration in asset maintenance planning, promoting innovation and effective performance management.

RMS used many good practices to develop the SMC model, including:

  • preparing a robust business case comparing the SMC model to RMS maintaining the road network itself, as well as assessing whether two other contracting models
    (traditional and alliance) would meet its requirements
  • assessing experiences with similar arrangements in other jurisdictions and identifying elements that worked to get the best outcomes
  • developing a robust performance framework, which included a mix of efficiency and effectiveness KPIs that reflected NSW Government policy and RMS priorities
  • incorporating risk and reward incentives delivered through cost sharing arrangements which change as the contract matures
  • using a contract duration that supports RMS priorities and provides an incentive for better quality outcomes.

RMS uses data provided by the contractor to measure performance and calculate payments to the contractor. The SMC includes a specific sanction if RMS finds that the contractor provided incorrect performance data, but no specific sanction if the contractor provides incorrect financial data. If RMS finds that the contactor provided incorrect performance or financial data, RMS can only recover over-payments which may have been made using the incorrect data.  

To provide a stronger incentive for the contractor to ensure data it provides is accurate, RMS should consider whether to incorporate stronger sanctions when negotiating the commercial reset due in mid-2018 for south and west zones. RMS should also consider this for the new contract for the north zone when the current PSMC contract expires in October 2018.

RMS' contract management approach and benefits realization

RMS can improve the effectiveness of its oversight and management of the SMC

RMS does not have SMC specific contract procedures to guide its contract managers. Consequently, RMS has not exercised several significant SMC requirements, such as having the contractors account for an efficiency dividend in their pricing at the start of each three-year works period. Effective contract management should be supported by contract specific procedures, with explanations of, and allocation of responsibility for, the various interventions that RMS may be required to exercise in the SMC.

Performance and financial reporting under the SMC is based on a mix of RMS and contractor provided data. While there are a range of audits of contractor provided performance and financial data that RMS can conduct each year under the SMC, it does not have a schedule of audits it will conduct and when.  
During the first year of the SMC, RMS commissioned some limited audits of financial data. In the first three years of the SMC, RMS did not conduct any audits of performance data. Had there been SMC specific procedures in place, this would have reduced the risk of RMS not implementing a systematic audit program to give it reasonable assurance on the quality of the data that the contractor has provided. This is important because the data is used to measure performance and calculate contractor payments.

RMS has been aware of data quality issues since 2015. While RMS advised that it commenced addressing some data quality issues in response to a series of reviews conducted in 2015, a recent internal audit report indicates that RMS has not resolved the data quality issues.  

RMS achieved benefits in the first year, but has not tracked benefits since

As part of the business case, RMS agreed to implement a benefits realisation strategy, including a benefits tracking tool. RMS commenced tracking benefits, but did not establish a comparative baseline pre-SMC on non-financial benefits, and has not tracked benefits past year one.

In 2015, a benchmarking study commissioned by RMS found that it had achieved 80 per cent of the expected recurrent cost savings and other benefits, such as improved workplace safety, in the first full year of the SMC. However, there was no clear baseline to measure
non-financial performance. The study was qualified due to gaps in available data. The study also did not reconcile the actual one-off transition costs to the business case estimate.

During the course of the audit, RMS advised that it intends to repeat this type of study to determine whether it has achieved all expected benefits (and their value), and that it would use the results to inform its negotiation with the SMC contractors as part of the commercial reset due in mid-2018.

Roads and Maritime Services is responsible for the State Roads network in the Sydney region

Roads and Maritime Services (RMS) is responsible for the Sydney region State roads network. This includes over 2,800 kilometres of roads and associated road corridor infrastructure such as bridges, tunnels and drainage structures. The network is divided into three geographical areas: south, west and north zones. Prior to November 2013, RMS maintained roads in the Sydney region south and west zones through its Road and Fleet Services unit.  

In 1995, RMS first outsourced road corridor infrastructure maintenance for the north zone through a Performance Specified Maintenance Contract (PSMC). The current 10-year PSMC for the north zone will expire in October 2018. This contract is worth around $35 million per annum.  

NSW Government priorities and road maintenance

Efficient and effective road maintenance contributes to the following NSW Government priorities:

  • improving road travel reliability
  • ensuring on-time running of public transport
  • reducing road fatalities
  • improving government services
  • keeping our environment clean.

The NSW Commission of Audit recommended outsourcing the maintenance of State roads

The NSW Commission of Audit in its Final Report on Government Expenditure (May 2012) recommended contestability as an appropriate strategy to consider for improving road maintenance service delivery for State roads.  

The Commission benchmarked RMS’ road surface quality and cost per lane kilometre against those of Western Australia, Victoria, and Queensland. This showed that New South Wales lagged the other states on both these measures.  

Exhibit 1: Interjurisdictional comparison of road maintenance outcomes 2009–10
  WA VIC QLD NSW
Roads managed (lane kms) 52,659 50,510 71,353 80,348
Estimated spend ($/lane km) 5,000 4,500 6,000 7,000
Road quality measure (%) 99 99 94 91

Source: NSW Commission of Audit Final Report May 2012.

The Commission noted that RMS had conducted two independent reviews to examine the potential for extending road maintenance contestability. The Commission found that there was inadequate and inconclusive benchmarking to establish the efficiency of RMS’ Road and Fleet Services unit when compared to outsourcing. It recommended that RMS bring forward a proposal to conduct a competitive tender for the road maintenance of the Sydney region south zone road network to inform the feasibility of a progressive rollout of road maintenance contestability across other areas of the State. In August 2012, the NSW Government adopted the Commission’s recommendation.

The NSW Government introduced road maintenance contestability through Stewardship Maintenance Contracts

In April 2013, the NSW Government announced that it would introduce road maintenance contestability across the Sydney region, using a Stewardship Maintenance Contract (SMC) model to improve value for money. In doing so, it excluded RMS’ Road and Fleet Services unit from tendering.  

The SMC model is based on the following key commercial and performance principles set by RMS:

  • performance driven by outcomes
  • flexible and adaptable
  • transparent and measurable
  • linking risk to reward
  • continuous improvement
  • criteria for selection of, and transition to, different payment models.

The following key stewardship principles underpin the SMC’s broad set of values, attitudes and behaviours, which are required of the contractor to effectively manage the assets on behalf of RMS:

  • putting RMS’ customers (road users and the general public) first and being responsive to them
  • being responsible and accountable for the outcomes resulting from the management of the assets
  • managing the assets diligently, efficiently and effectively with limited direction from RMS
  • working collaboratively with RMS to deliver services that are tailored to meet RMS’ evolving needs
  • acting with integrity and transparency in performing the services
  • performing the services in the best interests of RMS and asset users.

Other key features of the SMC include:

  • service requirements which describe the scope of the services, and the standards the contractor must meet
  • a commercial framework which defines how payments are structured, how performance assessment will impact on payments and outlines the key commercial principles. SMCs primarily divide payments into two main mechanisms, these being the priced component (or fixed price) and the target cost calculated as follows:
    • fixed price – the contractor is paid a pre-agreed amount for specific services being provided, regardless of the actual costs incurred
    • target cost – RMS and the contractor agree on a target cost for a project, and any cost overruns or underruns are shared between them
  • a performance framework which provides mechanisms for assessing contractor performance. This includes a comprehensive listing of the key result areas (KRAs) and key performance indicators (KPIs) against which RMS measures the contractor’s performance. The framework also outlines the scoring methodology that RMS uses to determine whether the contractor’s bid margin (profit and overheads) is reduced due to less than satisfactory performance or whether a bonus is paid if a threshold performance score is exceeded.

Road maintenance under SMCs for Sydney region south and west zones commenced in November 2013

In November 2013, RMS awarded SMCs to the Leighton Boral Amey consortium, now named Ventia Boral Amey (VBA), for the south zone and the DownerMouchel (DM) consortium for the west zone. The contracts run for seven years with an option for a further three years at RMS’ discretion. In April 2014, full services commenced following a four-month transition period. RMS estimated that the annual cost of these contracts was around $240 million in total. In March 2018, the contract prices are due to be reset by negotiation to reflect the contractors’ experience with, and better information about, the road networks and routine maintenance requirements. 

  1. Roads and Maritime Services should consider whether to incorporate stronger sanctions in the Stewardship Maintenance Contract if the contractor provides incorrect performance or financial data to RMS, when:
     
    1. negotiating the commercial reset for the next works period with the Sydney region south and west zone contractors due in July 2018.
    2. finalising a new SMC contract for the Sydney region north zone, due to commence in October 2018.

Roads and Maritime Services should, by September 2017:

2.  Review its contract management framework for SMCs to ensure that all authorities and accountabilities of
     contract managers are clearly defined, including:

a) accountability and procedures for exercising all operational clauses in the SMC where RMS may opt to, or be required to intervene, or make a decision

b) authority to approve or initiate the interventions RMS is required to, or may, exercise under the SMC

c) the audits that RMS will conduct to systematically validate the performance and financial data that the SMC contractors provide

d) the accountabilities of RMS contract managers to systematically review audits and quality reviews that the SMC contractors must conduct to demonstrate compliance with their service plans

e) the accountabilities of RMS contract managers to check that the monthly and annual reports provided by SMC contractors do not contain errors, omissions or inaccuracies.

3.  Improve its management of benefits realisation by:

a) initiating a further benefits realisation review and record the benefits delivered against those
    estimated following the tender process, including the one-off transition costs

b) identify any benefits, including savings, not yet attained and develop strategies to address any short-falls

c) establish a tool to track the ongoing realisation of benefits.