Demand for ambulance services is increasing. Demographic factors including population growth and ageing have contributed to this and ongoing growth in demand is likely. It is important that NSW Ambulance finds ways to respond to this demand more efficiently, while maintaining patient safety standards and meeting community expectations.

Most triple zero calls to NSW Ambulance do not involve medical issues that require an emergency response. NSW Ambulance has introduced a range of initiatives to change the way it manages these less urgent requests for assistance. Its major demand management initiatives include using a telephone advice line, referring some patients to services other than hospital emergency departments and using specialist paramedics to respond to less urgent cases.

The role of NSW Ambulance has changed in recent years. It is aiming to become a ‘mobile health service’ that identifies the needs of patients and provides or refers them to the most appropriate type of care. This change involves a significant expansion of the clinical decision-making role of paramedics. Considerable strategic and organisational efforts are required to make this work. The successful implementation of demand management initiatives is important to NSW Ambulance's ability to continue to meet demand for its services.

This audit assessed NSW Ambulance's major demand management initiatives that aim to reduce unnecessary demand for ambulance responses and unnecessary transport to hospital emergency departments. It aimed to assess the extent to which these initiatives have improved the efficiency of its services.

Appendix one - Response from agency

Appendix two - About the audit

Appendix three - Performance auditing

Palliative care is an essential component of modern health care services and an increasingly important part of the wider health and social care systems. Palliative care is healthcare and support for people with a life-limiting illness, their families and carers. It is provided by, or informed by, professionals who specialise in palliative care. ‘End of life’ care is provided to people approaching the end of life by health professionals, who may work in the health, community or aged care systems. Not everyone receiving end of life care needs palliative care.

NSW Health has a policy and planning role in palliative and end-of-life care, and it coordinates a wide range of service providers. Local Health Districts (LHDs) provide care services in settings such as homes, hospitals and clinics to patients with varying needs. There are several care providers that can be involved.

Due to this shared nature of palliative care — where many people, services and settings are involved in delivering care to the patient — availability and communication of information is critical. For service planning, data and evidence must be drawn from various sources in a timely and efficient way.

This audit assessed whether NSW Health is effectively planning and evaluating palliative care services, in the context of rising demand, increasingly complex needs, and the diversity of service providers.

1. By July 2018, NSW Health should develop an integrated palliative and end-of-life care policy framework that:

• clearly articulates the interface between palliative and end of life care and outlines the priorities for the respective areas
• defines policy goals and objectives, and a performance and evaluation framework for palliative care service planning and delivery
• informs a related workforce plan which supports the policy framework and is linked to the Health Professional Workforce Plan 2012–2022
• reviews the funding allocation model to ensure future enhancement funds are distributed equitably and transparently based on the need and population of districts.

By December 2018, NSW Health should:

2. assess how the functionality provided in data collection programs such as the Palliative Care Outcomes Collaboration program can be provided across all palliative care services in NSW

3. complete its statewide review of systems and reporting for end of life management including specialist palliative care, and develop a business case to implement a more integrated set of solutions to:

• support providers delivering end of life and palliative care
• help monitor service quality and quantity
• provide comprehensive data for service planning

4. improve stakeholder engagement by:

• developing a statewide stakeholder engagement strategy that brings together current activity and good practice, and is transparent and publicly available
• defining accountability for overseeing and implementing the strategy at state and district levels.

1. Performance monitoring is inadequate

NSW Government policy on palliative care is outlined in the NSW Government Plan to Increase Access to Palliative Care 2012–2016 (the Plan). Under the Plan, the overarching policy is ‘to ensure that everyone has access to quality palliative care regardless of their economic or social circumstances, their geographical location or their medical condition.’ Some initiatives under the Plan are still being implemented.

NSW Health only has measures in place to assess some processes and activities for individual initiatives under the Plan. There is no tracking of outcomes relating to the policy goals set out in the Plan, such as increased choice to die at home or the location of the patient’s choice, and improved access to specialist palliative care services. NSW Health has not conducted an overall assessment of the Plan’s outcomes to guide future priorities.

Further, there is no overall performance and reporting framework for palliative and end of life care, meaning there is no monitoring of performance of palliative care services for NSW as a whole. This lack of evaluation and performance measurement impacts on NSW Health's ability to monitor progress and achievements, address gaps in service, and plan for future service enhancement. 

2. Statewide planning and evaluation lacks coordination

Currently, palliative care services are complex to plan and evaluate. Many policies, strategies, guidelines, directives and data collections currently inform services. Even definitions of services vary. The split of policy functions for palliative care and end-of-life care between different branches within NSW Health adds further complexity. These arrangements create the risk of confusion, gaps in advice and support for LHDs.

Consistency is needed in the use of terminology and planning to achieve an integrated approach at all levels, including:

• standard definitions of palliative care and end-of-life care
• planning within a single structured policy framework to help clarify what services are to be delivered, who is accountable for delivering them and how to measure their outcomes.

Workforce planning is also affected. While NSW Health has identified significant gaps in the specialist palliative care workforce (especially in regional and remote areas) and it previously made workforce capacity one of its priorities, limited work has been undertaken in producing a statewide strategy to reduce these gaps.

3. District planning is not systematic and some external providers are poorly managed

An integrated approach would inform district-level service planning for palliative care. Planning in the districts we visited was sometimes ad hoc and accountability for performance unclear. Districts would benefit from:

• better integrating data collection systems with planning
• clearer guidelines, easy-to-use tools, monitoring and accountability systems.

The recently developed guide – A Blueprint for Improvement, from the Agency for Clinical Innovation – should help districts plan more effectively and consistently as it rolls out more widely in 2017. This takes an integrated approach to palliative and end-of-life care. Only one district we visited has finalised a comprehensive plan using the Blueprint.

Issues with district planning extend to external agreements with service providers, as these are sometimes poorly managed and do not support improved patient outcomes. Examples we reviewed showed a significant reporting burden with process-focused reporting. We also found little evidence of monitoring or action as a result of these reports.

4. Diverse information systems mean data collection and use are inconsistent

NSW Health gathers a broad range of data from many collection points and systems to inform palliative care services at hospital, ward or unit level, and community teams. However, the current data is limited because: 

• activity is under-reported, particularly in community-based services
• collection is not universal across districts and services.

Districts also struggle with evidence-based planning and service delivery because multiple information systems mean data may be incomplete or inaccurate. Too often, clinicians and service managers rely on manual collection and paper-based systems. 

eHealth, which coordinates information communication technology (ICT) for the state’s healthcare, is planning a statewide approach to capture information and report on all palliative care activity. The current plans of eHealth to review and improve systems should make data more complete, robust and accessible for quality improvement and planning.

5. An overarching stakeholder strategy would strengthen engagement

Just as data is central to effective planning and evaluation, so too is stakeholder engagement. However, there is currently no explicit stakeholder strategy, which means consultation is inconsistent across the state and not systematic at a district level.

While NSW Health uses a range of platforms to consult, the purpose and value is often not clear to stakeholders. Individual districts have some good practices, but there are limited mechanisms to identify and share these with other areas. A state-wide strategy would improve the quality and consistency of engagement, which will in turn inform service planning and delivery.

A stakeholder engagement strategy would integrate current initiatives, such as the two major networks that consult with health planning staff and clinicians. But it will also need to extend the feedback gathered from families, carers and volunteers, and from the peak bodies that represent them. 

Appendix one - Response from the Agency

Appendix two -  National and NSW data on palliative care activity and outcomes

Appendix three -  About the audit

• ageing ICT equipment and inadequate wireless networks
• variable student access to devices at school
• variable teacher access to centrally provided devices for use outside of the classroom.

Information and communication technologies (ICT) are pervasive in modern life. Australian research has identified that the workforce demand for digital literacy and advanced digital skills is growing across most areas of work. There is broad agreement internationally and in Australian school systems that digital literacy is a core skill for the workforce and students will need to be confident with ICT. Education systems around the world are using ICT in classrooms to support learning and employment goals.  

The New South Wales Department of Education’s (the Department’s) overall strategic directions for teaching and learning with ICT are set in the 'Strategic Information Technology Plan 2016–19'. The Department centrally provides a base level of resources to schools for ICT and schools supplement funding from their existing school budget and Parents and Citizens Associations. Each school decides how to allocate these funds to meet local needs. Schools also set expectations for how teachers and students will use technology to help deliver outcomes.

This audit assessed how well New South Wales public schools are using ICT to improve teaching and learning. It focussed on planning and teacher and student use of ICT. We examined whether:

• the Department identifies key strategic opportunities to enhance the use of ICT platforms and technologies in schools
• teachers are integrating ICT into classroom practice
• the Department monitors the impact of ICT on student learning.

Old equipment and wireless networks are not keeping pace with modern demands

The Department’s vision for ICT is to enable ‘any learning opportunity, anywhere, anytime’. This vision is at risk due to an ageing stock of devices and wireless networks. The average age of devices in New South Wales schools is over four years. Older devices are less reliable, require greater maintenance and support, and cannot run demanding applications. Further, many school wireless networks are beyond the end of their useful life. This limits the number of teachers and students who can access online content on wireless networks at the same time.

The central funding model for ICT in schools is not meeting current needs

Funding for the Technology for Learning program to deliver ICT in schools has not increased since 2004, despite an increase in the number of students and emphasis placed on ICT in teaching and learning during this time. Schools supplement funding for ICT from their existing school budget and Parents and Citizens Associations.  

The Department’s current funding model for ICT is not adequately addressing a growing gap in the provision of contemporary ICT in classrooms between schools able to access funding from other sources and those which cannot. The Department needs to review whether the Technology for Learning program is equitable in equipping all schools with the modern technology needed to achieve its vision.

Many teachers are not provided with devices for use outside of the classroom

School Principals we interviewed reported that technology is an essential part of a modern classroom and teacher access to devices outside of the classroom can impact how they use ICT. This is because, in practice, teacher working days extend outside classroom hours and teachers need access to devices for activities such as lesson preparation and student assessment. The Department provides teachers with access to a suite of software tools for these tasks.

The Commonwealth Government’s Digital Education Revolution program provided teachers of secondary school students with laptops from 2009 to 2013. The Department’s evaluation of the Digital Education Revolution program found that teachers reported greater confidence with, and use of, ICT throughout the program.  
Providing desktop computers, laptops or tablets for teachers is now a school level decision and arrangements vary across schools. Each school must trade-off between allocating devices for students and teachers. Most other States and Territories provide all teachers with a laptop for use in and outside of the classroom or offer subsidised access to one.  

There is limited teacher professional learning in the use of ICT

The Department’s research has identified that professional learning is an important factor in how effectively teachers use ICT to enhance teaching and learning. Despite this, the Department provides few courses on using ICT in the classroom directly, and most of these are offered in Sydney. This limits accessibility for teachers outside of the metropolitan area. Schools we visited reported that the costs of courses and providing relief teachers limits the number of external courses or events that teachers attend, especially for rural and regional schools. Increasing the use of online learning would improve access for teachers in these areas.  

The Department is not adequately monitoring trends in professional learning in ICT or evaluating the overall effectiveness of courses. A recent upgrade to the professional learning system may provide the Department with better quality data to do this.

Greater monitoring and reporting on technology use in schools is required

The Local Schools, Local Decisions policy gives schools greater authority to make strategic decisions on the use of ICT appropriate to their local contexts. To support this, the Department needs to better monitor current trends, and identify emerging needs to determine future direction and how best to support schools.  

For example, the Department does not currently know how many devices are allocated to teachers or how many schools have implemented a student Bring Your Own Device scheme. This affects how schools are using ICT, and places demand on the network and the type of support the Department must provide. An assessment of the ICT maturity of schools would help the Department target its resources to schools requiring greater assistance with planning.

The Department does not regularly monitor or report on student capabilities with ICT. A national assessment found that the ICT literacy of a sample of Year 6 and Year 10 New South Wales students fell between 2011 and 2014. The fall was greater in New South Wales than in other States and Territories. Without more regular assessment or reporting, the reasons behind this fall and the distribution of student capabilities between schools will remain unknown. 

By July 2018, the Department of Education should:

1. Review the Technology for Learning program and school ICT support resourcing to determine whether resourcing is adequate for modern school requirements.
    
2. Develop a program to improve wireless networks in all NSW schools, for instance by expanding the Connecting Country Schools Program to all NSW schools.  
    
3. Implement an assessment of school ‘ICT maturity’ and use this to target assistance to those schools requiring support with forward planning for ICT.
    
4. Improve the use of evidence to inform plans and strategies, including:
   • more detailed monitoring of teacher and student access to and use of ICT
   • evaluating the impact of teacher professional learning on student outcomes 
   • further examining the links between ICT and student outcomes.
      
5. Improve teacher access to devices for use outside of the classroom to improve how effectively they integrate ICT into teaching and learning.
    
6. Improve teacher professional learning by providing more:
   • online learning opportunities for teachers in regional and remote areas
   • courses focused on pedagogy to make best use of ICT.
      
7. Identify the ICT skills students need, and provide teaching resources to develop these skills and monitor their achievement.

Appendix One - Response from the Agency

Appendix Two - About the audit

Appendix Three - Performance auditing

Based on forecast patronage increases, the rail agencies will find it hard to maintain punctuality after 2019 unless the capacity of the network to carry trains and people is increased significantly. If recent higher than forecast patronage growth continues, the network may struggle to maintain punctuality before 2019.

A NSW Government priority is to ‘maintain or improve reliability of public transport services over the next four years’. Punctuality is a key element of reliability, and the level of patronage is a critical factor in the ability to maintain punctuality. Increasing patronage places pressure on the length of time trains need to wait at stations to load and offload passengers which can lead to delays. The NSW Long Term Transport Master Plan forecasts that rail patronage could increase by 26 per cent between 2012 and 2031.  

Passenger rail services in NSW are provided under a purchaser-provider model. Transport for NSW enters contracts with:

• Sydney Trains for Sydney suburban passenger rail services
• NSW Trains for services that commence or terminate outside Sydney, including intercity services that operate between Central station and the South Coast, Southern Highlands, Blue Mountains and Central Coast and Newcastle.

Transport for NSW sets performance targets and standards for these services, develops the timetables, procures trains for the service providers, and is responsible for long term planning.

This audit assessed whether these rail agencies have plans and strategies to maintain or improve performance in getting the growing number of suburban and intercity rail passengers to their destinations on time.

Punctuality measurement is satisfactory, but agencies could publish more information

Passenger rail punctuality indicators adopted in NSW are good practice. The key train punctuality indicator is better than indicators used by many other rail operators. It is also better than the on-time-running indicator that it replaced. Unlike the on-time-running indicator, the punctuality indicator classifies trains that have been cancelled or skipped stations as late and results are not adjusted to take account of delays caused by factors such as extreme weather or police operations.

NSW also has a customer delay measure which represents good practice. Work has started on refining and embedding customer delay as a key performance measure for the planned new Rail Operations Centre.

As train frequency approaches a ‘turn up and go’ level of service, rather than running to a timetable, more emphasis will need to be placed on excess waiting time and customer delay when assessing performance.

Measurement of punctuality is reasonably precise. There are some measurement inaccuracies which should be addressed, such as the estimated arrival time of a train being incorrect at some destination stations, but these do not affect punctuality results materially.  

Train punctuality is reported publicly, but not to the detail of the indicators in the contracts between Transport for NSW and Sydney Trains and NSW Trains. There is very limited public reporting of customer delay.

Overall punctuality is good, but some services are relatively poor

System-wide train punctuality has usually exceeded target since 2005, but some services suffer from poor punctuality compared to the rest of the network.  

The part of the network around North Sydney is creating problems for the punctuality of afternoon peak services heading through it and out to Western Sydney and to Hornsby via Strathfield. Transport for NSW and Sydney Trains are well advanced with strategies to address this up to 2019.  

The East Hills express trains in the afternoon peak also performed well below target. The rail agencies recently analysed this issue and believe it relates to the train timetable and signalling which restricts how close trains can run behind each other into Campbelltown. It further advises that this will be corrected over the next three years.  

Intercity train punctuality is below that of suburban trains and there was an extended period of declining punctuality between 2011 and 2014. Transport for NSW suggested that the old age of trains is a factor, and the recently announced intercity fleet acquisition may help address this. Apart from ensuring that train crew and station staff are available and perform their duties adequately, NSW Trains can do little to impact the punctuality of its intercity services directly. Train maintenance, track and signal maintenance, and management of trains on the rail network are performed by Sydney Trains. NSW Trains’ ability to influence improvement is hampered by key indicators in some contracts being undefined. Transport for NSW, Sydney Trains and NSW Trains are now working collaboratively to make improvements to the contracts.

Initiatives are in place or are planned to deliver good punctuality until 2019

Patronage increases, which can lead to overcrowding and trains having to wait longer at stations, are likely to present a significant challenge to maintaining punctuality into the future.

Based on patronage projections, the rail agencies have strategies to maintain punctuality up to and including joining the Sydney Metro Northwest to the network at Chatswood in 2019. These include improving infrastructure at particular parts of the network, increasing staff training, reducing the number of speed restrictions, and a new Rail Operations Centre. The projects are being managed by experienced staff, with good governance arrangements, quality assurance processes and planning systems in place. New timetables should provide more services and cater for more passengers, including off peak. They should increase network efficiency through better utilisation of capacity, but some passengers may face longer journey times and more may need to change trains mid-journey.  

The planned Rail Operations Centre has the potential to make operational decision-making more customer-focussed, by placing more emphasis on minimising customer delay during disruptions. If implemented well, it will also generate information to help agencies better identify the root cause of incidents that delay trains and improve communication with passengers so they can make better real-time travel decisions.

Predicted passenger growth presents a risk to punctuality after 2019

The rail system will struggle to maintain punctuality much beyond 2019 based on current patronage forecasts and system limitations.

From 2024, the Sydney Metro City and Southwest will help by extending the metro network from Chatswood under Sydney Harbour, through the city and out to Bankstown. Announced fleet upgrades will also help. Transport for NSW advises that it is also working with the Greater Sydney Commission to ensure network capacity constraints are considered in future urban planning.

In addition to investment in new metro networks, sustained and substantial investment needs to be made into the existing heavy rail network to meet demand and ensure its ongoing reliability. Transport for NSW has been developing strategies for this purpose, including an Advanced Train Control system. Its aim is to put a costed plan to the government by the third quarter of this (2017) calendar year. Given the likely lead times involved with major infrastructure projects, there remains a significant risk of poor punctuality after 2019.

Punctuality could be at risk sooner if recent patronage growth continues

If patronage continues to increase at a faster rate than forecast, particularly during the morning peak, the network will struggle to cope before 2019. Transport for NSW forecast that between 2011 and 2026 morning peak rail patronage would increase each year by approximately 3.3 per cent. Between 2011 and 2016 the number of passengers travelling to the city during the morning peak grew by an average of 4.4 per cent each year, including annual growth of 6.6 per cent since May 2014.

A good understanding of patronage levels, trends and drivers is critical to effective planning. The audit identified some shortcomings in measurement of peak passenger loads. Transport for NSW advised that measurement approaches have been improved recently, and this will soon flow into improved data quality.  

Given the increasing flexibility in work practices available to many city workers, the relatively new field of behavioural insights may offer opportunities to ‘nudge’ some passengers away from travelling at the height of the peak with benefits for them and the network.

1. Transport for NSW should ensure that programs to address rail patronage growth over the next five to ten years are provided to the government for Cabinet consideration as soon as possible.
    
2. Sydney Trains and Transport for NSW should:
   a) maintain effective oversight and resourcing for all strategies designed to address rail patronage growth
   b) adjust strategies for any patronage growth above projection.
    
3. Sydney Trains, NSW Trains and Transport for NSW should publish Customer Delay results by June 2018.
    
4. Transport for NSW, Sydney Trains and NSW Trains should agree by December 2017:
   a) specific performance requirements for intercity train, track and signal availability and reliability
   b) guidelines for train priorities during disruptions and indicators of control centre performance in implementing these guidelines.
    
5. Sydney Trains, NSW Trains and Transport for NSW should by June 2018:
   a) improve the accuracy of patronage measurement and develop a better understanding of patronage growth trends
   b) address small errors in the adjustment factors used for determining a train’s punctuality status
   c) improve their understanding of the factors impacting on intercity punctuality.
    
6. Transport for NSW should, commencing June 2017, explore the potential to use behavioural insights to encourage more passengers to travel outside the height of the morning peak (8 am to 9 am).