The Auditor-General for New South Wales, Margaret Crawford, has released a report on how the New South Wales Education and Standards Authority (NESA) and the Department of Education (the Department) ensure teaching quality in NSW public schools.

Around 2,200 NSW public school principals are responsible for accrediting their teachers in line with the Australian Professional Standards for Teachers. The report found that NESA does not oversight principals’ decisions to ensure that minimum standards for teaching quality are consistently met.

The Department does not effectively monitor teaching quality across the state. With limited data, it is difficult for the Department to ensure its strategies to improve teaching quality are appropriately targeted to improve teaching quality.

The Department’s Performance and Development Framework does not adequately support principals and supervisors to effectively manage and improve teacher performance or actively improve teaching quality. The Department manages those teachers formally identified as underperforming through teacher improvement programs. Only 53 of over 66,000 teachers employed by the Department were involved in these programs in 2018.

The report makes three recommendations towards NESA to improve accreditation processes, and four recommendations to the Department to improve its systems and processes for ensuring teaching quality across the State.

Australian research has shown that quality teaching is the greatest in-school influence on student engagement and outcomes, accounting for 30 per cent of the variance in student performance. An international comparative study of 15-year-old students showed the performance of New South Wales students in reading, mathematics and science has declined between 2006 and 2015.

The Australian Professional Standards for Teachers (the Standards) describe the knowledge, skills and understanding expected of effective teachers at different career stages. Teachers must be accredited against the Standards to be employed in NSW schools. The NSW Education Standards Authority (NESA) is responsible for ensuring all teachers in NSW schools are accredited. As part of the accreditation process the NSW Department of Education (The Department) assesses whether public school teachers meet proficient accreditation standards and advises NESA of its decisions.

The School Excellence Framework provides a method for the Department to monitor teaching quality at a school level across four elements of effective teaching practice. The Performance and Development Framework provides a method for teachers and their supervisors to monitor and improve teaching quality through setting professional goals to guide their performance and development.

The Department has a strategic goal that every student, every teacher, every leader and every school improves every year. In line with this goal, the Department has a range of strategies targeted to improving teaching quality at different career stages. These include additional resources to support new teachers, a program to support teachers to gain higher-level accreditation, support for principals to manage underperforming teachers, and a professional learning program where teachers observe and discuss each other's practice.

The objective of this audit was to assess the effectiveness of the NSW Department of Education's and the NSW Education Standards Authority's arrangements to ensure teaching quality in NSW public schools. To address this objective, the audit examined whether:

• agencies effectively monitor the quality of teaching in NSW public schools
• strategies to improve the quality of teaching are planned, communicated, implemented and monitored well.

Appendix one – Response from agencies

Appendix two – About the audit

Appendix three – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary Reference: Report number #327 - released 26 September 2019

36

A report released by the Auditor-General for New South Wales, Margaret Crawford, has found that NSW Health is not forming effective partnerships with Aboriginal communities to plan, design and deliver appropriate mental health services. There is limited evidence that NSW Health is using the knowledge and expertise of Aboriginal communities to guide how mental health care is structured and delivered.

Mental illness (including substance use disorders) is the main contributor to lower life expectancy and increased mortality in the Aboriginal population of New South Wales. It contributes to a higher burden of disease and premature death at rates that are 40 per cent higher than the next highest chronic disease group, cardiovascular disease.¹ 

Aboriginal people have significantly higher rates of mental illness than non Aboriginal people in New South Wales. They are more likely to present at emergency departments in crisis or acute phases of mental illness than the rest of the population and are more likely to be admitted to hospital for mental health treatments.² 

In acknowledgement of the significant health disparities between Aboriginal and non Aboriginal people, NSW Health implemented the NSW Aboriginal Health Plan 2013 2023 (the Aboriginal Health Plan). The overarching message of the Aboriginal Health Plan is ‘to build respectful, trusting and effective partnerships with Aboriginal communities’ and to implement ‘integrated planning and service delivery’ with sector partners. Through the Plan, NSW Health commits to providing culturally appropriate and ‘holistic approaches to the health of Aboriginal people'.

The mental health sector is complex, involving Commonwealth, state and non government service providers. In broad terms, NSW Health has responsibility to support patients requiring higher levels of clinical support for mental illnesses, while the Commonwealth and non government organisations offer non acute care such as assessments, referrals and early intervention treatments.

The NSW Health network includes 15 Local Health Districts and the Justice Health and Forensic Mental Health Network that provide care to patients during acute and severe phases of mental illness in hospitals, prisons and community service environments. This includes care to Aboriginal patients in the community at rates that are more than four times higher than the non Aboriginal population. Community services are usually provided as follow up after acute admissions or interactions with hospital services. The environments where NSW Health delivers mental health care include:

• hospital emergency departments, for short term assessment and referral
• inpatient hospital care for patients in acute and sub acute phases of mental illness
• mental health outpatient services in the community, such as support with medications
• custodial mental health services in adult prisons and juvenile justice centres.

The NSW Government is reforming its mental health funding model to incrementally shift the balance from hospital care to enhanced community care. In 2018–19, the NSW Government committed $400 million over four years into early intervention and specialist community mental health teams.

This audit assessed the effectiveness of NSW Health’s planning and coordination of mental health services and service pathways for Aboriginal people in New South Wales. We addressed the audit objective by answering three questions: 

1. Is NSW Health using evidence to plan and inform the availability of mental health services for Aboriginal people in New South Wales?
2. Is NSW Health collaborating with partners to create accessible mental health service pathways for Aboriginal people?
3. Is NSW Health collaborating with partners to ensure the appropriateness and quality of mental health services for Aboriginal people?

In this report, the term ‘Aboriginal people’ is used to describe both Aboriginal and Torres Strait Islander peoples. The Audit Office of NSW acknowledges the diversity of traditional countries and Aboriginal language groups across the state of New South Wales.

In May 2019, the Audit Office of New South Wales invited Aboriginal mental health clinicians and policy experts from government and non-government organisations to attend a one-day workshop. Workshop attendees advised on factors that improve the quality and appropriateness of mental health care for Aboriginal people in New South Wales. They described appropriate mental health care as:

• culturally safe, allowing Aboriginal people to draw strength in their identity, culture and community
• person centred and focussed on individual needs
• delivered by culturally competent staff with no bias
• holistic, trauma-informed and focussed on early intervention where possible
• delivered in places that are appropriate including outreach to homes and communities
• welcoming of the involvement of local Aboriginal community and connected to local knowledge and expertise including totems and kinship structures. 

The definition of 'appropriate' mental health care for Aboriginal people throughout this report is based on this advice.

Aboriginal people access emergency services at much higher rates than non-Aboriginal people

The choices that people make in relation to health service options provide some insight into the suitability and appropriateness of the service to their needs.

Aboriginal people have different mental health service use patterns than non-Aboriginal people. Aboriginal people are much more likely to be in a crisis situation before receiving mental health services, usually in an emergency department of a hospital.

Aboriginal people make up three per cent of the total New South Wales population, but they constitute 11 per cent of emergency department presentations for mental health treatments. In regional areas, Aboriginal people make up 20.5 per cent of presentations at emergency departments for mental health reasons. 

A number of factors help to explain Aboriginal mental health service usage patterns. According to government and non-government mental health organisations:

• emergency department services are better known to Aboriginal people than other mental health services
• community-based models of care are not appropriate for Aboriginal people
• Aboriginal people are reluctant to access community-based mental health services to prevent crisis situations
• community mental health services are not available for Aboriginal people after hours and during the weekend, so emergency services are the only option.

The statewide proportions of Aboriginal people presenting at emergency departments for mental health treatments has been increasing over time (Exhibit 6).

Appendix one – Response from agency

Appendix two – The NSW Aboriginal Health Plan

Appendix three – About the audit

Appendix four – Performance auditing

Parliamentary Reference: Report number #326 - released 29 August 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

This report examines whether the Department of Education has the required contract management capability to effectively manage high-value goods and services contracts (over $250,000). In 2017–18, the department managed high-value goods and services contracts worth $3.08 billion, with most of the contracts running over multiple years.

NSW government agencies are increasingly delivering services and projects through contracts with third parties. These contracts can be complex and governments face challenges in negotiating and implementing them effectively.

Contract management capability is a broad term, which can include aspects of individual staff capability as well as organisational capability (such as policies, frameworks and processes).

In 2017–18, the Department of Education (the Department) managed high-value (over $250,000) goods and services contracts worth $3.08 billion, with most of the contracts running over multiple years. The Department delivers, funds and regulates education services for NSW students from early childhood to secondary school.

This audit examined whether the Department has the required capability to effectively manage high-value goods and services contracts.

We did not examine infrastructure, construction or information communication and technology contracts. We assessed the Department against the following criteria:

1. The Department’s policies and procedures support effective contract management and are consistent with relevant frameworks, policies and guidelines.
2. The Department has capable personnel to effectively conduct the monitoring activities throughout the life of the contract.

The NSW Public Service Commission and the Department of Finance, Services and Innovation are included as auditees as they administer policies which directly affect contract management capability, including:

• NSW Procurement Board Directions and policies
• NSW Procurement Agency Accreditation Scheme
• NSW Public Sector Capability Framework.

The Department of Finance, Services and Innovation's responsibility for NSW Procurement will transfer to NSW Treasury on 1 July 2019 as part of changes to government administrative arrangements announced on 2 April 2019 and amended on 1 May 2019.

Appendix one - Response from agencies

Appendix two - About the audit

Appendix three - Performance auditing

Parliamentary Reference: Report number #325 - released 28 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

The report found the clearing of native vegetation on rural land is not effectively regulated and managed. The processes supporting the regulatory framework are weak and there is no evidence-based assurance that clearing of native vegetation is carried out in accordance with approvals. 

In 2014 an expert panel completed a review of biodiversity legislation in NSW. The panel’s recommendations included repealing the Native Vegetation Act 2003, proposing a new Act with the goal of maintaining a healthy, productive and resilient environment for the greatest wellbeing of the community, and recommending that management of native vegetation in the context of existing agricultural management would be assisted and supervised by Local Land Services (LLS).

Following the panel report, the NSW Government undertook major biodiversity conservation and land management reforms which saw the introduction of the Biodiversity Conservation Act 2016 (NSW) and the Local Land Services Amendment Act 2016 (NSW). The reforms commenced in August 2017. The Native Vegetation Act 2003, the Threatened Species Conservation Act 1995, the Nature Conservation Trust Act 2001, and parts of the National Parks and Wildlife Act 1974 were repealed.

Under the legislative reforms, the Biodiversity Conservation Act 2016 and Local Land Services Amendment Act 2016, which amended the Local Land Services Act 2013, aim to ensure a balanced approach to land management and biodiversity conservation in NSW.

A core objective of the Biodiversity Conservation Act 2016 is to conserve biodiversity at bioregional and state scales. A core objective of the Local Land Service Act 2013 is to ensure the proper management of natural resources in the social, economic and environmental interests of the state, consistently with the principles of ecologically sustainable development.

The integrated package of reforms included:

• new arrangements that allow land owners to improve productivity while responding to environmental risks
• new ways to assess and manage the biodiversity impacts of development
• a new state Environmental Planning Policy for managing impacts on native vegetation in urban areas
• significant investment in conservation of private land
• a risk-based system for regulating human and business interactions with native plants and animals
• streamlined approvals and dedicated resources to help reduce the regulatory burden.

Transition to this land management framework began on 25 August 2017 with the commencement of the Land Management (Native Vegetation) Code.

The overall objectives of the reforms are:

• to arrest and ultimately reverse the current decline in the state’s biodiversity while facilitating ecologically sustainable development, in particular efficient and sustainable agricultural development
• enable landholders to improve the efficiency of their agricultural systems and take a more active role in providing incentive and supporting landholders to improve the condition and function of their ecological systems. 

The objective of this audit is to assess whether the clearing of native vegetation in rural areas is effectively regulated and managed by the Office of Environment and Heritage (OEH) and LLS under these legislative frameworks. The audit also examined the progress of the Biodiversity Conservation Trust in implementing the Biodiversity Conservation Investment Strategy as a counterbalance to rural land clearing. 

At the time of this audit OEH was responsible for preparing the Native Vegetation Regulatory map and for compliance enforcement in relation to unlawful land clearing. Post 1 July 2019, under machinery of government changes, OEH will be abolished and its activities relevant to this audit will be moved to the new Department of Planning, Industry and Environment. For the purposes of this audit we will continue to refer to it as OEH. 

Local Land Services (LLS) is responsible for processing notifications and issuing certificates to landholders for managing the thinning or clearing of native vegetation on rural land through the ‘Land Management (Native Vegetation) Code 2018’ (the Code). This work includes monitoring and reporting on the implementation of the Code, including the establishment and management of set asides.

OEH is responsible for compliance and enforcement in relation to unlawful land clearing. It is also responsible for producing the NVR map, designed to show landholders where land clearing can occur without approval, where approval is required, and where land clearing is not permitted. Post 1 July 2019, under machinery of government changes, OEH will be abolished and its activities relevant to this audit will be moved to the new Department of Planning, Industry and Environment.

Appendix one - Response from agencies

Appendix two - Authorisations for thinning and clearing, and restoration initiatives under the Native Vegetation Act 2003

Appendix three - About the audit

Appendix four - Performance auditing

Parliamentary Reference: Report number #324 - released 27 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

This report found the Department of Family and Community Services (FACS) needs to do more to demonstrate it is effectively and efficiently contracting NGOs to deliver community services in the Permanency Support Program (a component of out-of-home-care services) and Specialist Homelessness Services. It notes that FACS is moving to an outcomes-based commissioning model and recommends this be escalated consistent with government policy.

Government agencies, such as the Department of Family and Community Services (FACS), are increasingly contracting non-government organisations (NGOs) to deliver human services in New South Wales. In doing so, agencies are responsible for ensuring these services are achieving expected outcomes. Since the introduction of the Commissioning and Contestability Policy in 2016, all NSW Government agencies are expected to include plans for customer and community outcomes and look for ways to use contestability to raise standards.

Two of the areas receiving the greatest funding from FACS are the Permanency Support Program and Specialist Homelessness Services. In the financial year 2017–18, nearly 500 organisations received $784 million for out-of-home care programs, including the Permanency Support Program. Across New South Wales, specialist homelessness providers assist more than 54,000 people each year and in the financial year 2017–18, 145 organisations received $243 million for providing short term accommodation and homelessness support, including Specialist Homelessness Services.

In the financial year 2017–18, FACS entered into 230 contracts for out-of-home care, of which 49 were for the Permanency Support Program, representing $322 million. FACS also entered into 157 contracts for the provision of Specialist Homelessness Services which totalled $170 million. We reviewed the Permanency Support Program and Specialist Homelessness Services for this audit.

This audit assessed how effectively and efficiently FACS contracts NGOs to deliver community services. The audit could not assess how NGOs used the funds they received from FACS as the Audit Office does not have a mandate that could provide direct assurance that NGOs are using government funds effectively.

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

Parliamentary Reference: Report number #323 - released 26 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

The Department of Justice has relied heavily on temporary responses to accommodate growing prisoner numbers according to a report released today by the Acting Auditor-General for New South Wales, Ian Goodwin.

At the time of this audit, the NSW Department of Justice (DOJ) was responsible for delivering custodial corrections services in New South Wales through its Corrective Services NSW division (Corrective Services NSW). From 1 July 2019, the Department of Family and Community Services and Justice will be responsible for these functions. 

Within DOJ, Corrective Services NSW is responsible for administering sentences and legal orders through custodial and community-based management of adult offenders. Its key priorities are:

• providing safe, secure and humane management of prisoners
• reducing reoffending
• improving community safety and confidence in the justice system. 

The prison population in New South Wales grew by around 40 per cent between 2012 to 2018, from 9,602 to 13,630 inmates. This rate of growth was higher than experienced prior to 2012. DOJ forecasts growth to continue over the short and longer-term. 

DOJ has responded to inmate population growth by doubling-up and tripling-up the number of prison beds in cells, reactivating previously closed prisons, and a $3.8 billion program of new prison capacity. DOJ has also developed a long-term prison infrastructure strategy that projects long-term needs and recommended investments to meet these needs. 

This audit assessed how efficiently and effectively DOJ is responding to growth in the NSW prison population. In this report, we have not analysed the sources of demand or recommended ways that custody may be avoided. These are largely government policy issues. 

The Productivity Commission’s Report on Government Services outlines the performance indicator framework for corrective services in Australia (Appendix three). We have used measures from this framework to assess the efficiency and effectiveness of DOJ’s responses to prison bed capacity needs. 

In this section, we analyse system-wide indicators as DOJ has not consistently published or reported data for individual correctional centres over the period of review.
 

Appendix one - Response from agency

Appendix two - Managing women in custody

Appendix three - Corrective services performance indicator framework

Appendix four - About the audit

Appendix five – Performance auditing

Parliamentary Reference: Report number #319 - released 24 May 2019

The Department of Education has a strong focus on supporting secondary school students’ wellbeing. However, it is difficult to assess how well the Department is progressing as it is yet to measure or report on the outcomes of this work at a whole-of-state level.

The Department of Education’s (the Department) purpose is to prepare young people for rewarding lives as engaged citizens in a complex and dynamic society. The Department commits to creating quality learning opportunities for children and young people, including a commitment to student wellbeing, which is seen as directly linked to positive learning outcomes. Wellbeing is defined broadly by the Department as “the quality of a person’s life…It is more than the absence of physical or psychological illness”. Student wellbeing can be supported by everything a school does to enhance a student's learning—from curriculum to teacher quality to targeted policies and programs to whole-school approaches to wellbeing.

Several reforms have aimed to support student wellbeing in recent years. 'Local Schools, Local Decisions' gave NSW schools more local authority to make decisions, including schools' approaches to support student wellbeing. In 2016, the 'Supported Students, Successful Students' initiative provided $167 million over four years to support the wellbeing of students. From 2018, the 'Every Student is Known, Valued and Cared For' initiative provides a principal led mentoring program, and a website with policies, procedures and resources to support student wellbeing.

This audit assessed how well the Department of Education supports secondary schools to promote and support the wellbeing of their students and how well secondary schools are promoting and supporting the wellbeing of their students.

The NSW Department of Education commits to creating quality learning opportunities for students. This includes strengthening students’ physical, social, emotional and spiritual development. The Department sets out to enable students to be healthy, happy, engaged and successful.

Welfare and wellbeing

The Department’s approach has significantly shifted from student welfare to wellbeing of the whole child and young person. Wellbeing is defined in departmental policy and strategy documents broadly, and as directly linked to learning and positive learning outcomes. “Wellbeing can be described as the quality of a person’s life…It is more than the absence of physical or psychological illness…Wellbeing, or the lack of it, can affect a student’s engagement and success in learning…”

Student wellbeing can be supported by everything a school does to enhance a student's learning—from curriculum to teacher quality to targeted policies and programs to whole-school approaches to wellbeing. Distinctions between wellbeing and welfare in the school context are outlined below.

Appendix one - Response from agency

Appendix two - Key policies, guidance, and systems

Appendix three - Funding and resources for schools

Appendix four - Measuring wellbeing

Appendix five - About the audit

Appendix six - Performance auditing

Parliamentary Reference: Report number #318 - released 23 May 2019

The Inner West Council and the Snowy Monaro and Queanbeyan-Palerang Regional Councils have all made progress towards efficient organisational structures following the amalgamation of their former council areas in 2016, according to a report released today by the Auditor-General of New South Wales.

All three councils are now operating with a single workforce and have largely achieved the milestones they planned for the first stage of their amalgamations. None have finished reviewing and aligning services across their former council areas nor integrated their ICT systems. They need to do this to be in a position to implement an optimal structure. 

On 12 May 2016, the NSW Government announced the amalgamation of 42 councils into 19 new councils. This followed a period of 18 months during which the NSW Independent Pricing and Regulatory Tribunal (IPART) had assessed councils' ‘fitness for the future’, and communities were consulted about proposed mergers. A further amalgamated council was created on 9 September 2016.

Upon amalgamation, existing elected councils were abolished, interim General Managers appointed, and Administrators engaged to undertake the role of the previously elected councils until Local Government elections were held 18 months later. During the period of administration, councils were asked to report on the progress of their amalgamations to the Department of Premier and Cabinet (DPC).

Council amalgamations not only require a re-drawing of boundaries, but re-establishment of local representation, decisions about alignment of services across the former council areas, and establishment of an amalgamated workforce.

The objective of this audit was to assess whether three councils, Inner West Council, Queanbeyan-Palerang Regional Council and Snowy Monaro Regional Council, are effectively reforming their organisation structures to realise efficiency benefits from amalgamation and managing the impact on staff.

Appendix one - Response from councils and Office of Local Government

Appendix two - Compliance with staff protections in the Local Government Act 1993

Appendix three - About the audit

Appendix four - Performance auditing

Parliamentary Reference: Report number #317 - released 1 May 2019

The NSW Department of Education’s plans and strategies to respond to the demand for secondary teachers in STEM-related disciplines are limited by incomplete data and underperforming scholarship and sponsorship program. The Department does not collect sufficient information to monitor what disciplines teachers actually teach nor does it predict supply and demand for teachers by discipline and location. This restricts the Department’s ability to track and forecast the supply and demand for secondary teachers in STEM-related disciplines.

In recent years, Australian and international education policy has focused on improving outcomes in Science, Technology, Engineering and Mathematics (STEM) subjects. However, research has identified a shortage of qualified secondary teachers in STEM-related disciplines ¹. This is projected to worsen due to a combination of student population increases, an ageing workforce, and fewer people going into teaching. Shortfalls are likely to be more acute in rural and remote areas, and areas of low socio-economic status.

The Department of Education (the Department) has a variety of strategies to encourage teachers to practise in locations or disciplines of need. These include scholarships for tertiary students going into teaching, sponsorships for teachers seeking approval to teach additional disciplines, and incentives to attract teachers to rural and remote locations. 

This audit assessed the effectiveness of the Department's workforce plans and strategies in responding to the demand for secondary teachers in STEM-related disciplines. We assessed:

• how well the Department tracks the supply and demand for secondary teachers in STEM-related disciplines across NSW
• whether the Department has effective strategies to attract and retain secondary teachers in STEM-related disciplines.

Appendix one - Response from agency

Appendix two - About the audit

Appendix three - Performance auditing

Parliamentary Reference - Report number #313 - released 29 January 2019.

The State Insurance Regulatory Authority’s (SIRA) ‘green slip refund’ campaign, and the TAFE semester one 2018 student recruitment campaign, complied with most requirements of the Government Advertising Act 2011 and the Government Advertising Guidelines, according to a report released today by the Auditor-General for New South Wales, Margaret Crawford.

The Government Advertising Act 2011 (the Act) requires the Auditor-General to conduct a performance audit on the activities of one or more government agencies in relation to government advertising campaigns in each financial year. The performance audit assesses whether a government agency or agencies has carried out activities in relation to government advertising in an effective, economical and efficient manner and in compliance with the Act, the regulations, other laws and the Government Advertising Guidelines (the Guidelines).

This audit examined two campaigns conducted in 2017–18:

• the 'Green slip refund' campaign run by the State Insurance Regulatory Authority (SIRA)
• the semester one component of the 'TAFE NSW 2018 Student Recruitment Annual Campaign Program' run by the NSW TAFE Commission (TAFE).

Section 6 of the Act prohibits political advertising. Under this section, material that is part of a government advertising campaign must not contain the name, voice or image of a minister, member of parliament or a candidate nominated for election to parliament or the name, logo or any slogan of a political party. Further, a campaign must not be designed to influence (directly or indirectly) support for a political party.

The State Insurance Regulatory Authority (SIRA) conducted the 'Green slip refund' campaign between March and June 2018. SIRA ran this campaign to raise awareness of the Compulsory Third Party (CTP) refunds and reforms after the Motor Accidents Injuries Act 2017 commenced in December 2017. SIRA's view is that the reforms include a reduced cost for CTP insurance, benefits for at-fault drivers, reduced opportunity for fraud and attempts to lower insurance company profits. Green slip holders are also able to claim partial refunds on their 2017 green slip insurance premium. The campaign aimed to make green slip holders aware of the refunds available, encourage them to claim online and to inform people about the changes to the green slip scheme. The campaign focused on the first two of these objectives. The total cost of the campaign was $1.9 million. See Appendix two for more details on this campaign.

Campaign materials we reviewed did not breach section 6 of the Act

Section 6 of the Act prohibits political advertising as part of a government advertising campaign. A government advertising campaign must not:

• be designed to influence (directly or indirectly) support for a political party
• contain the name, voice or image of a minister, a member of parliament or a candidate nominated for election to parliament
• contain the name, logo, slogan or any other reference to a political party.

The audit team found no breaches of section 6 of the Act in the campaign material we reviewed.
 
Before the start of the campaign, SIRA conducted a survey which asked people whether they agreed ‘that the NSW Government is helping to reduce the cost of living by making positive reforms to:

• reduce the cost of green slips
• reduce the cost of health insurance
• increase the number of jobs
• increase investment in the state.'

SIRA's initial submission to peer review listed one of the campaign objectives as improving the perception of the government as a positive reformer. DPC advised SIRA that this should not be included. SIRA removed this objective.

Even though SIRA appropriately removed this objective, the post-campaign evaluation still measured agreement with the above statements, three of which did not relate to this campaign or SIRA's responsibilities. SIRA advised that these three additional statements were included to provide a broader context for any change in the green slip campaign survey results. For example, if all four measures reported an increase in positive responses of roughly the same size, then the increase may have been due to factors other than the advertising campaign.

This is not an appropriate use of the post-campaign evaluation, which should measure the success of the campaign against its stated objectives. The Guidelines list the purposes that government advertising may serve and none of these relate to improving the perception of the government. The inclusion of the above questions in SIRA's post-campaign evaluation creates a risk that the results may be used for party political purposes.

The campaign met most targets, however some were not challenging to achieve

The post-campaign evaluation demonstrated that the campaign met the targets for 12 of its 13 objectives including the targets relating to raising awareness of the refunds and the proportion of people claiming their refunds online. A fourteenth objective, the percentage of people aware that they should contact SIRA after a road accident injury, did not have a target set, meaning that it is not possible to say whether the campaign had the desired impact in this case.

In August 2017, before the campaign commenced, SIRA conducted a survey to determine the baselines for some of its objectives. This is a good practice to support an effective post campaign evaluation process. The survey found that 20 per cent of people were aware of the green slip reforms. SIRA's objective was to raise this to 25 per cent, which represents a small gain relative to the proposed campaign expenditure. The campaign aimed for 40 per cent of motorists to be aware of refunds, which is very low given that this was the primary focus of the campaign. SIRA followed the advice of its survey provider when setting these targets. 

In the survey carried out after the campaign, 66 per cent of people were aware of the availability of green slip refunds for most motorists. The campaign also aimed to get 83 per cent of motorists to claim their refunds via online channels. It met this target, with a total of 84 per cent. Finally, 62 per cent of people in the post-campaign survey were aware of the green slip reforms. This result is discussed further below.

The overall target for total number of refunds claimed is 85 per cent of eligible drivers, that is to say CTP holders. SIRA will evaluate the results of this objective after the conclusion of the refund period in June 2019.

The campaign did little to inform the public about the broader green slip reforms

One objective of the green slip refund campaign was to inform the public about the green slip reforms. The final campaign creative material focused almost entirely on the green slip refunds rather than the range of other reforms. This was because the peer review raised concerns that the creative material was attempting to deliver too many messages. 
 
The campaign submission stated that the advertising campaign would raise awareness of the broader reforms to the CTP scheme, citing several examples such as reduced opportunities for fraud and reduced insurer profits. SIRA also advised the Minister for Finance, Services and Property that secondary messaging in the campaign would benefit public understanding of the reforms.

Some of the television and radio advertisements referred to ‘more protection’ or ‘better protection’ for people injured on New South Wales roads, however advertisements did not refer to other elements of the reforms. Other campaign creative materials contained messages solely relating to the green slip refund and made no further reference to the broader reforms. SIRA used other communication channels, such as giving wallet cards to health service providers, to spread these messages to people, particularly those who had been injured.

Sixty two per cent of people in the post-campaign survey were aware of the green slip reforms. SIRA asked these people which benefits they associated with the reforms. The results of this survey are in Exhibit 4. Seventy-one per cent of this sample identified the reduced costs of green slips as one of the changes, but awareness of other elements of the reforms remains low. Though 29 per cent of people perceive the reforms to make the green slip scheme ‘fairer’, no more than 15 per cent of people could list a specific benefit which did not relate to insurance prices.

Another campaign target was to ensure that people understood that they should contact SIRA in case of an injury. None of the campaign creative materials contained this information. SIRA did some limited work to inform the public about this through its social media channels. One of the pieces of creative material directed the reader to SIRA's website for further information on the reforms, which contained this information. During the campaign period, there was an increase in the number of calls received by SIRA's CTP Assist phone line. However, in the post-campaign evaluation, only two per cent of surveyed people identified that they should contact SIRA in case of an injury.

The media plan allowed sufficient time for cost-efficient media placement

During the peer review process, DPC provides advice to agencies about the time they should allow to ensure cost-efficient media placement. For example, DPC advise that agencies book television advertising six to 12 weeks in advance and that agencies book radio advertising two to eight weeks in advance.

SIRA allowed sufficient time between the completion of the peer review process and the commencement of the first advertising. SIRA signed the agreement with the approved Media Agency Services provider eight weeks before the campaign started, meaning that it could achieve cost-efficient media placement for all types of media used in this campaign.

SIRA directly negotiated with a single supplier, making it difficult to demonstrate value for money

SIRA directly negotiated with a single supplier to procure the campaign's creative material. A direct negotiation occurs when an agency negotiates with a proponent without first undergoing a competitive process. It is difficult to demonstrate value for money using direct negotiation due to the lack of competition. 

ICAC's 'Guidelines for managing risks in direct negotiations' (ICAC Guidelines) provide guidance on how to undertake direct negotiations. SIRA has a direct negotiation checklist that aligns to the ICAC Guidelines. The SIRA checklist advises that staff should confirm that existing New South Wales prequalification schemes cannot provide the procurement before undertaking a direct negotiation. SIRA did not do this.

To procure creative materials, agencies can access the Advertising and Digital Communication Services prequalification scheme (the prequalification scheme). Using the prequalification scheme allows agencies to quickly seek quotes from suppliers who have a demonstrated track record and expertise. While agencies are not required to use the prequalification scheme, the NSW Procurement Board advises that agencies should use prequalification schemes where they are available to promote competition. 

By using direct negotiation when the prequalification scheme was available, and by not seeking quotes from other suppliers, SIRA was acting in a way that reduced competition. This increases the risk that SIRA did not achieve value for money in its procurement of creative materials.

SIRA advised that it sought to ensure value for money by comparing the quote from its selected supplier with the amount spent on creative materials in other campaigns of similar size. SIRA did not document this analysis at the time or include it as part of the briefing note staff used to seek approval for undertaking direct negotiation. As a result, decision-makers were not fully informed when approving this engagement. 

SIRA reported in a briefing note that it engaged in direct negotiations because:

• it believed that the original timeframe did not allow for a competitive tender process
• the supplier had done previous work on a related campaign for SIRA
• the supplier provided sample work which received positive feedback from focus groups.

In July 2017, when peer review commenced, SIRA planned to launch the campaign in November 2017 to coincide with the beginning of the green slip reforms. SIRA believed that this timeframe was narrow enough to warrant entering direct negotiations. The ICAC Guidelines advise that a narrow timeframe is not a valid reason to enter into a direct negotiation. In late October 2017, the campaign launch was delayed until March 2018 to stagger the demand on the resources of Service NSW, which is administering the refund. 

The ICAC Guidelines also advise against re-appointing a supplier because it has performed previous work. Instead, agencies could consider previous experience as one of several factors when deciding between quotes. In cases where an agency asks a supplier to provide sample work, the ICAC Guidelines advise that agencies should request sample work from multiple potential suppliers to promote competition.

The campaign's cost benefit analysis complied with the Act and Guidelines 

The Act requires a cost benefit analysis (CBA) for any government advertising campaign likely to exceed $1.0 million in value. Section six of the Guidelines set out the requirements for a government advertising CBA. The campaign's CBA complied with the requirements of the Act and the Guidelines.

The campaign CBA could have demonstrated further cost effectiveness if it considered alternative media mixes as outlined in NSW Treasury's 'Cost Benefit Analysis Framework for Government Advertising and Information Campaigns'. This would also have been consistent with the Handbook.

The cluster Secretary signed the compliance certificate instead of the head of SIRA

The Act requires the head of the agency running the campaign to sign a compliance certificate. 

The Secretary of the Department of Finance, Services and Innovation, the cluster to which SIRA belongs, signed the campaign's compliance certificate. However, section 17(2) of the State Insurance and Care Governance Act 2015 states that SIRA is ‘for the purposes of any Act, a NSW Government agency.’ Given this, the Chief Executive of SIRA was responsible for signing the compliance certificate for this campaign.

This is a minor non-compliance with the Act because the Chief Executive had reviewed the campaign and recommended that the Secretary sign the compliance certificate.  

The NSW TAFE Commission (TAFE) ran the 'TAFE NSW 2018 Student Recruitment Annual Campaign Program' from November 2017 to September 2018. The aim of the campaign was to assist TAFE in achieving its 2018 student enrolment target by improving the perception of TAFE's brand and generating student enquiries. This is the first state-wide campaign run by TAFE operating under the One TAFE model. Previously, each TAFE Institute ran its own campaigns. The total budget of the campaign was $19.5 million. This audit examined only the semester one 2018 component of the campaign, which ran from November 2017 to April 2018 at a total cost of $9.5 million. See Appendix two for more details on this campaign.

The campaign materials we reviewed did not breach section 6 of the Act

Section 6 of the Act prohibits political advertising as part of a government advertising campaign. A government advertising campaign must not:

• be designed to influence (directly or indirectly) support for a political party
• contain the name, voice or image of a minister, a member of parliament or a candidate nominated for election to parliament
• contain the name, logo, slogan or any other reference to a political party.

The audit team found no breaches of section 6 of the Act in the campaign material we reviewed.

The campaign achieved 16 of 24 objectives, but did not reach its enrolment target

The campaign had 24 objectives which had a target for semester one. TAFE set these targets using a combination of previous experience, corporate objectives and brand surveys.

The overall objective of the combined semester one and two campaigns was to support TAFE achieving its 2018 total enrolment target of 549,636. TAFE's semester one target was 361,350, which it did not achieve. This indicates that the campaign was not fully effective.

The campaign achieved 11 of its 16 output objectives. The output targets related to TAFE's media placements and ability to reach an audience efficiently. TAFE tracked progress against many of the campaign's output objectives daily. TAFE altered its media channels throughout the campaign meaning that some of the output objectives were not met because TAFE decided to focus on alternative media channels. The campaign also achieved all seven of its outcome objectives. The outcome objectives related to changing the public perception of TAFE.

TAFE's initial media plan allowed for efficient media placement

During the peer review process, DPC provides advice to agencies about the time they should allow to ensure cost-efficient media placement. For example, DPC advise that agencies book television advertising six to 12 weeks in advance and that agencies book radio advertising two to eight weeks in advance. 

While TAFE's initial media plan allowed sufficient time between the approval of the campaign and its launch, a delay in receiving final approval for the campaign meant TAFE could not purchase media placements until two months later than planned. Most purchases still remained within DPC's recommended timeframes, but Indigenous television advertisements and metropolitan out of home advertisements both fell outside DPC's recommended time periods by one week. These delays did not impact on TAFE's efficiency.

TAFE re-used many creative materials, achieving some cost-savings

Rather than commissioning new creative materials, TAFE re-used many creative materials from the previous campaign and supplemented these with a selection of new creative materials. TAFE advised that this led to a cost saving of approximately $130,000.
TAFE sought quotes from suppliers on the government's Advertising and Digital Communication Services prequalification scheme for two creative material contracts. These contracts covered updates to existing materials and a selection of new materials.

The campaign's cost-benefit analysis did not comply with three requirements of the Guidelines

The Act requires an agency to conduct a cost-benefit analysis (CBA) if the cost of an advertising campaign is likely to exceed $1.0 million. The Guidelines set out the requirements of this CBA. TAFE did not comply with three of these requirements, outlined in Exhibit 5.

In this circumstance, section 6.2 of the Guidelines required the CBA to identify the number of enrolments TAFE would expect if it did not advertise. TAFE advised us that it is not possible to say what this scenario would look like because there had always been some degree of advertising, however, this argument is not reflected in the CBA. 

TAFE used 2017 as the baseline in the CBA. In 2017, TAFE spent $13.2 million on advertising. As such, the CBA was only able to isolate the impact of the increased expenditure rather than the impact of the campaign's entire $19.5 million expenditure. TAFE advised that 2017 had the most reliable state-wide data and this contributed to the decision to use it as the baseline.

During the audit, TAFE sought advice from NSW Treasury regarding whether a 2017 baseline was appropriate and NSW Treasury advised that it was. Regardless, TAFE did not receive this advice prior to writing the CBA and did not put commentary around this in the CBA. This would also not be sufficient for fulfilling the requirements of the Guidelines.

The CBA did not comply with sections 6.3 and 6.4 of the Guidelines. The CBA briefly considered the impact of spending the campaign budget directly on new training courses, however there was no sustained analysis of this option. TAFE staff advised that there are no realistic alternatives to advertising for achieving the campaign's objectives. However we did not see analysis to support this conclusion in documents provided to us. 

The campaign CBA could have better demonstrated cost effectiveness if it considered alternative media mixes as outlined in NSW Treasury's 'Cost Benefit Analysis Framework for Government Advertising and Information Campaigns'. This would also have been consistent with the Handbook.

TAFE made one inaccurate claim in its advertising and overstated a second

The Guidelines set out rules regarding the content of a government advertising campaign. Exhibit 6 sets out one of the principles with which agencies must comply.

TAFE made one inaccurate claim in its advertising and overstated a second.

In some campaign creative material, TAFE claimed that 78 per cent of its own graduates are employed after training (Exhibit 15 in Appendix 2). According to the National Centre for Vocational Education Research, 78 per cent of New South Wales Vocational Education and Training (VET) graduates (i.e. from all training providers) are employed after training. The result for TAFE graduates is 70.4 per cent.

One of the campaign's television advertisements refers to TAFE as ‘Australia's most reputable education provider’. This statement referred to a survey of current TAFE students who were asked where they would consider studying in future: TAFE, University or a private college. The current TAFE students selected TAFE by a large margin. The limited scope of TAFE's student survey and its results do not support the claim that it is ‘Australia's most reputable education provider’.

DPC did not consistently communicate the transitional arrangements for the Brand Guidelines and as such much of TAFE's creative material did not comply at campaign launch

On 7 August 2017, the government released the NSW Government Brand Guidelines (Brand Guidelines), setting out how agencies use the NSW Government logo. The Brand Guidelines replaced the Branding Style Guide which had been in place since September 2015. Some agencies were exempt from using the Branding Style Guide and the introduction of the new Brand Guidelines required these agencies to apply for a new exemption.

TAFE had recently commenced the peer review process for this campaign when the Brand Guidelines were released. TAFE was exempt from the requirements of the Branding Style Guide and as such the material which TAFE was planning to re-use in the new campaign did not contain the NSW Government logo.

Communication about how long agencies had to make themselves compliant with the Brand Guidelines was unclear. On 11 August 2017, the Chair of the Cabinet Standing Committee on Communication and Government Advertising (the Committee) sent a letter to the Secretary of the Department of Industry informing him that the Department must update all its material to be compliant with the Brand Guidelines ‘as soon as practicable within an 18-month transition period’. The Department of Industry advised TAFE that new advertising would need to be immediately compliant, however it was not clear if this included materials which agencies were re-using from previous campaigns. DPC advised the audit team that it expected re-used materials to be compliant when agencies launched new campaigns. DPC provided this advice to some agencies but did not communicate it more broadly. We could not source evidence that DPC provided this advice to TAFE.

DPC ran workshops to explain the transitional arrangements in September 2017 for the changes in the Brand Guidelines, however these did not specifically address the transitional timeframes for new advertising campaigns.

The Department of Industry, on behalf of TAFE, applied to the Committee for approval to co-brand the TAFE logo with the NSW Government logo. This was approved in October 2017. The requirements for co-branding are in Exhibit 7.

Appendix one - Responses from agencies 

Appendix two - About the campaigns

Appendix three - About the audit

Appendix four - Performance auditing

Parliamentary reference - Report number #311 - released 18 December 2018