Refine search Expand filter

Reports

Published

Actions for Ensuring teaching quality in NSW public schools

Ensuring teaching quality in NSW public schools

Education
Management and administration
Regulation
Service delivery
Workforce and capability

The Auditor-General for New South Wales, Margaret Crawford, has released a report on how the New South Wales Education and Standards Authority (NESA) and the Department of Education (the Department) ensure teaching quality in NSW public schools.

Around 2,200 NSW public school principals are responsible for accrediting their teachers in line with the Australian Professional Standards for Teachers. The report found that NESA does not oversight principals’ decisions to ensure that minimum standards for teaching quality are consistently met.

The Department does not effectively monitor teaching quality across the state. With limited data, it is difficult for the Department to ensure its strategies to improve teaching quality are appropriately targeted to improve teaching quality.

The Department’s Performance and Development Framework does not adequately support principals and supervisors to effectively manage and improve teacher performance or actively improve teaching quality. The Department manages those teachers formally identified as underperforming through teacher improvement programs. Only 53 of over 66,000 teachers employed by the Department were involved in these programs in 2018.

The report makes three recommendations towards NESA to improve accreditation processes, and four recommendations to the Department to improve its systems and processes for ensuring teaching quality across the State.

Australian research has shown that quality teaching is the greatest in-school influence on student engagement and outcomes, accounting for 30 per cent of the variance in student performance. An international comparative study of 15-year-old students showed the performance of New South Wales students in reading, mathematics and science has declined between 2006 and 2015.

The Australian Professional Standards for Teachers (the Standards) describe the knowledge, skills and understanding expected of effective teachers at different career stages. Teachers must be accredited against the Standards to be employed in NSW schools. The NSW Education Standards Authority (NESA) is responsible for ensuring all teachers in NSW schools are accredited. As part of the accreditation process the NSW Department of Education (The Department) assesses whether public school teachers meet proficient accreditation standards and advises NESA of its decisions.

The School Excellence Framework provides a method for the Department to monitor teaching quality at a school level across four elements of effective teaching practice. The Performance and Development Framework provides a method for teachers and their supervisors to monitor and improve teaching quality through setting professional goals to guide their performance and development.

The Department has a strategic goal that every student, every teacher, every leader and every school improves every year. In line with this goal, the Department has a range of strategies targeted to improving teaching quality at different career stages. These include additional resources to support new teachers, a program to support teachers to gain higher-level accreditation, support for principals to manage underperforming teachers, and a professional learning program where teachers observe and discuss each other's practice.

The objective of this audit was to assess the effectiveness of the NSW Department of Education's and the NSW Education Standards Authority's arrangements to ensure teaching quality in NSW public schools. To address this objective, the audit examined whether:

  • agencies effectively monitor the quality of teaching in NSW public schools
  • strategies to improve the quality of teaching are planned, communicated, implemented and monitored well.
The NSW Education Standards Authority does not oversight principals’ decisions to accredit teachers as proficient. This means it is not ensuring minimum standards for teaching quality are consistently met.
NESA does not have a process to ensure principals’ decisions to accredit teachers are in line with the Standards. The decision to accredit teachers is one of the main ways to ensure teaching quality. In New South Wales public schools, around 2,200 principals are tasked with making decisions to accredit their teachers as proficient. NESA provides training and guidelines for principals to encourage consistent accreditation decisions but regular turnover of principals makes it difficult to ensure that all principals are adequately supported. NESA has more oversight of provisional and conditional accreditation for beginning teachers, as well as higher-level accreditation for highly effective teachers. That said, there are only limited numbers of teachers with higher-level accreditation across the state.
The Department of Education does not effectively monitor teaching quality at a system level. This makes it difficult to ensure strategies to improve teaching quality are appropriately targeted.
The Department is not collecting sufficient information to monitor teaching quality across the state. No information on teacher assessment against the Performance and Development Framework is collected centrally. Schools self-assess their performance against the School Excellence Framework but this does not assess teaching quality for all teachers. The Department also surveys students about their experiences of teaching quality but schools opt-in to this survey, with 65 per cent of public schools participating in 2018. These factors limit the ability of the Department to target efforts to areas of concern.
We examined five key strategies that support the critical parts of a teacher’s career. Most strategies were based on research and consultation, planned, trialled, reviewed and adjusted before wider rollout. Guidance and training is provided to communicate requirements and help schools implement strategies at a local level. Monitoring of strategies implemented at a local level is variable. We identified several instances where Quality Teaching, Successful Students funding was used outside guidelines. Two strategies have not yet been evaluated, which prevents the Department from determining whether they are having the desired impact.
The Performance and Development Framework is not structured in a way that supports principals and supervisors to actively improve teacher performance and teaching quality.
There is limited opportunity for supervisors to set goals, conduct observations of teaching practice, or provide constructive written feedback on a teacher’s progress towards achieving their goals under this framework. Guidance on how to use the Standards to construct quality goals, observe teaching practice and provide valuable feedback is also insufficient. The framework focuses on teachers’ self-identified development goals but there is no requirement to align these with the Standards. These limitations reduce the ability of supervisors to use this framework to effectively manage teacher performance and improve teaching quality.
The Department manages those teachers formally identified as underperforming through teacher improvement programs. Only 53 of over 66,000 teachers employed by the Department were involved in these programs in 2018. By comparison, a report on inspections conducted in the United Kingdom assessed the quality of teaching as ‘inadequate’ in three per cent of schools.

Appendix one – Response from agencies

Appendix two – About the audit

Appendix three – Performance auditing

© Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Parliamentary Reference: Report number #327 - released 26 September 2019

36

Published

Actions for Managing native vegetation

Managing native vegetation

Environment
Management and administration
Project management
Regulation
Service delivery

The report found the clearing of native vegetation on rural land is not effectively regulated and managed. The processes supporting the regulatory framework are weak and there is no evidence-based assurance that clearing of native vegetation is carried out in accordance with approvals. 

In 2014 an expert panel completed a review of biodiversity legislation in NSW. The panel’s recommendations included repealing the Native Vegetation Act 2003, proposing a new Act with the goal of maintaining a healthy, productive and resilient environment for the greatest wellbeing of the community, and recommending that management of native vegetation in the context of existing agricultural management would be assisted and supervised by Local Land Services (LLS).

Following the panel report, the NSW Government undertook major biodiversity conservation and land management reforms which saw the introduction of the Biodiversity Conservation Act 2016 (NSW) and the Local Land Services Amendment Act 2016 (NSW). The reforms commenced in August 2017. The Native Vegetation Act 2003, the Threatened Species Conservation Act 1995, the Nature Conservation Trust Act 2001, and parts of the National Parks and Wildlife Act 1974 were repealed.

Under the legislative reforms, the Biodiversity Conservation Act 2016 and Local Land Services Amendment Act 2016, which amended the Local Land Services Act 2013, aim to ensure a balanced approach to land management and biodiversity conservation in NSW.

A core objective of the Biodiversity Conservation Act 2016 is to conserve biodiversity at bioregional and state scales. A core objective of the Local Land Service Act 2013 is to ensure the proper management of natural resources in the social, economic and environmental interests of the state, consistently with the principles of ecologically sustainable development.

The integrated package of reforms included:

  • new arrangements that allow land owners to improve productivity while responding to environmental risks
  • new ways to assess and manage the biodiversity impacts of development
  • a new state Environmental Planning Policy for managing impacts on native vegetation in urban areas
  • significant investment in conservation of private land
  • a risk-based system for regulating human and business interactions with native plants and animals
  • streamlined approvals and dedicated resources to help reduce the regulatory burden.

Transition to this land management framework began on 25 August 2017 with the commencement of the Land Management (Native Vegetation) Code.

The overall objectives of the reforms are:

  • to arrest and ultimately reverse the current decline in the state’s biodiversity while facilitating ecologically sustainable development, in particular efficient and sustainable agricultural development
  • enable landholders to improve the efficiency of their agricultural systems and take a more active role in providing incentive and supporting landholders to improve the condition and function of their ecological systems. 

The objective of this audit is to assess whether the clearing of native vegetation in rural areas is effectively regulated and managed by the Office of Environment and Heritage (OEH) and LLS under these legislative frameworks. The audit also examined the progress of the Biodiversity Conservation Trust in implementing the Biodiversity Conservation Investment Strategy as a counterbalance to rural land clearing. 

At the time of this audit OEH was responsible for preparing the Native Vegetation Regulatory map and for compliance enforcement in relation to unlawful land clearing. Post 1 July 2019, under machinery of government changes, OEH will be abolished and its activities relevant to this audit will be moved to the new Department of Planning, Industry and Environment. For the purposes of this audit we will continue to refer to it as OEH. 

Conclusion
The clearing of native vegetation on rural land is not effectively regulated and managed because the processes in place to support the regulatory framework are weak. There is no evidence-based assurance that clearing of native vegetation is being carried out in accordance with approvals. Responses to incidents of unlawful clearing are slow, with few tangible outcomes. Enforcement action is rarely taken against landholders who unlawfully clear native vegetation. 

There are processes in place for approving land clearing but there is limited follow-up to ensure approvals are complied with.
Procedures and systems are in place for assessing applications and issuing approvals for land clearing. Approvals contain conditions for managing clearing and setting aside land for conservation as a counterbalance to permitted clearing. 
There is limited follow-up or capacity to gauge whether landholders are complying with the conditions of approvals and effectively managing areas of their land that have been set aside for conservation (i.e. 'set asides'). 
Certificate assessments are used to grant landholders permission to clear. All assessments we reviewed generally complied with the Land Management (Native Vegetation) Code 2018 (the Code). 
The rules around land clearing may not be responding adequately to environmental risks.
The Code, which contains conditions under which the thinning or clearing of native vegetation can be approved on regulated land, is intended to allow landholders to improve productivity while responding to environmental risks. That said, it may not be achieving this balance. For example, the Code allows some native species to be treated as ‘invasive’ when they may not be invading an area, provides little protection for groundcover and limited management requirements for set asides. There is also limited ability under the Code to reject applications for higher risk clearing proposals.
The release of the Native Vegetation Regulatory (NVR) map has been delayed, limiting landholders' ability to determine if their plans for clearing are lawful.
OEH has applied significant effort in developing a native vegetation regulatory map to guide landholders on which land they can and can’t clear without approval. However, in November 2016 the then Minister for Primary Industries advised Parliament that the two largest land categories of the NVR map will not come into effect until the relevant Ministers are satisfied stakeholders have sufficient confidence in the maps’ accuracy. Not releasing the map has made it harder for landholders to identify the portions of their land that are regulated and ensure they comply with land clearing rules. It has also limited OEH’s ability to consult on and improve the accuracy of the map.
There are significant delays in identifying unlawful clearing and few penalties imposed.
Unexplained land clearing can take over two years to identify and analyse, making it difficult to minimise environmental harm or gather evidence to prosecute unlawful clearing. Despite around 1,000 instances of unexplained clearing identified by OEH and over 500 reports to the environmental hotline each year, with around 300 investigations in progress at any one time, there are only two to three prosecutions, three to five remediation orders and around ten penalty notices issued each year for unlawful clearing. Further, OEH is yet to commence any prosecutions under the current legislation which commenced in August 2017.
Land clearing and private land conservation investment have both increased.
Clearing of native vegetation has increased in recent years. At the same time, the government is also investing in properties with high environmental value with a focus on improving the mix of endangered ecological communities conserved in perpetuity. Processes are in place for identifying and prioritising areas of land for investment but the funding provided to each region is not always consistent with these priorities. 

Local Land Services (LLS) is responsible for processing notifications and issuing certificates to landholders for managing the thinning or clearing of native vegetation on rural land through the ‘Land Management (Native Vegetation) Code 2018’ (the Code). This work includes monitoring and reporting on the implementation of the Code, including the establishment and management of set asides.

OEH is responsible for compliance and enforcement in relation to unlawful land clearing. It is also responsible for producing the NVR map, designed to show landholders where land clearing can occur without approval, where approval is required, and where land clearing is not permitted. Post 1 July 2019, under machinery of government changes, OEH will be abolished and its activities relevant to this audit will be moved to the new Department of Planning, Industry and Environment.

Appendix one - Response from agencies

Appendix two - Authorisations for thinning and clearing, and restoration initiatives under the Native Vegetation Act 2003

Appendix three - About the audit

Appendix four - Performance auditing

 

Parliamentary Reference: Report number #324 - released 27 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Contracting non-government organisations

Contracting non-government organisations

Community Services
Compliance
Fraud
Management and administration
Procurement
Regulation
Service delivery

This report found the Department of Family and Community Services (FACS) needs to do more to demonstrate it is effectively and efficiently contracting NGOs to deliver community services in the Permanency Support Program (a component of out-of-home-care services) and Specialist Homelessness Services. It notes that FACS is moving to an outcomes-based commissioning model and recommends this be escalated consistent with government policy.

Government agencies, such as the Department of Family and Community Services (FACS), are increasingly contracting non-government organisations (NGOs) to deliver human services in New South Wales. In doing so, agencies are responsible for ensuring these services are achieving expected outcomes. Since the introduction of the Commissioning and Contestability Policy in 2016, all NSW Government agencies are expected to include plans for customer and community outcomes and look for ways to use contestability to raise standards.

Two of the areas receiving the greatest funding from FACS are the Permanency Support Program and Specialist Homelessness Services. In the financial year 2017–18, nearly 500 organisations received $784 million for out-of-home care programs, including the Permanency Support Program. Across New South Wales, specialist homelessness providers assist more than 54,000 people each year and in the financial year 2017–18, 145 organisations received $243 million for providing short term accommodation and homelessness support, including Specialist Homelessness Services.

In the financial year 2017–18, FACS entered into 230 contracts for out-of-home care, of which 49 were for the Permanency Support Program, representing $322 million. FACS also entered into 157 contracts for the provision of Specialist Homelessness Services which totalled $170 million. We reviewed the Permanency Support Program and Specialist Homelessness Services for this audit.

This audit assessed how effectively and efficiently FACS contracts NGOs to deliver community services. The audit could not assess how NGOs used the funds they received from FACS as the Audit Office does not have a mandate that could provide direct assurance that NGOs are using government funds effectively.

Conclusion
FACS cannot demonstrate it is effectively and efficiently contracting NGOs to deliver community services because it does not always use open tenders to test the market when contracting NGOs, and does not collect adequate performance data to ensure safe and quality services are being provided. While there are some valid reasons for using restricted tenders, it means that new service providers are excluded from consideration - limiting contestability. In the service delivery areas we assessed, FACS does not measure client outcomes as it has not yet moved to outcomes-based contracts. 
FACS' procurement approach sometimes restricts the selection of NGOs for the Permanency Support Program and Specialist Homelessness Services
FACS has a procurement policy and plan which it follows when contracting NGOs for the provision of human services. This includes the option to use restricted tenders, which FACS sometimes uses rather than opening the process to the market. The use of restricted tenders is consistent with its procurement plan where there is a limited number of possible providers and the services are highly specialised. However, this approach perpetuates existing arrangements and makes it very difficult for new service providers to enter the market. The recontracting of existing providers means FACS may miss the opportunity to benchmark existing providers against the whole market. 
FACS does not effectively use client data to monitor the performance of NGOs funded under the Permanency Support Program and Specialist Homelessness Services
FACS' contract management staff monitor individual NGO performance including safety, quality of services and compliance with contract requirements. Although FACS does provide training materials on its intranet, FACS does not provide these staff with sufficient training, support or guidance to monitor NGO performance efficiently or effectively. FACS also requires NGOs to self-report their financial performance and contract compliance annually. FACS verifies the accuracy of the financial data but conducts limited validation of client data reported by NGOs to verify its accuracy. Instead, FACS relies on contract management staff to identify errors or inaccurate reporting by NGOs.
FACS' ongoing monitoring of the performance of providers under the Permanency Support Program is particularly limited due to problems with timely data collection at the program level. This reduces FACS' ability to monitor and analyse NGO performance at the program level as it does not have access to ongoing performance data for monitoring service quality.
In the Specialist Homelessness Services program, FACS and NGOs both provide the data required for the National Minimum Data Set on homelessness and provide it to the Australian Institute of Health and Welfare, as they are required to do. However, this data is not used for NGO performance monitoring or management.
FACS does not yet track outcomes for clients of NGOs
FACS began to develop an approach to outcomes-based contracting in 2015. Despite this, none of the contracts we reviewed are using outcomes as a measure of success. Currently, NGOs are required to demonstrate their performance is consistent with the measures stipulated in their contracts as part of an annual check of their contract compliance and financial accounts. NGOs report against activity-based measures (Key Performance Indicators) and not outcomes.
FACS advises that the transition to outcomes-based contracting will be made with the new rounds of funding which will take place in 2020–2021 for Specialist Homelessness Services and 2023 for the Permanency Support Program. Once these contracts are in place, FACS can transition NGOs to outcomes based reporting.
Incomplete data limits FACS' effectiveness in continuous improvement for the Permanency Support Program and Specialist Homelessness Services
FACS has policies and procedures in place to learn from past experiences and use this to inform future contracting decisions. However, FACS has limited client data related to the Permanency Support Program which restricts the amount of continuous improvement it can undertake. In the Specialist Homelessness Support Program data is collected to inform routine contract management discussions with service providers but FACS is not using this data for continuous improvement. 

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

 

Parliamentary Reference: Report number #323 - released 26 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Volume Eight 2013 focusing on Transport and Ports

Volume Eight 2013 focusing on Transport and Ports

Transport
Industry
Compliance
Financial reporting
Procurement
Project management
Regulation
Workforce and capability

Unqualified audit opinions were issued on the above corporations’ 30 June 2013 financial statements. During the year, Treasury issued TC 13/01 ‘Mandatory early close procedures for 2013’. This Circular aimed to improve the quality and timeliness of agencies’ annual financial statements. In 2012-13, application of the circular was made mandatory for State owned corporations. As a result, the port corporations were required to perform the early close procedures. All the port corporations were successful in performing the procedures, which helped them submit financial statements by an earlier due date. The early close procedures also resulted in general improvements to the quality of most financial statements.

The report recommends all transport entities should do more to reduce excessive annual leave balances to ensure they will comply with new targets set by the Premier, RailCorp, Sydney Trains and NSW Trains should minimise the amount of overtime bonuses paid to train drivers and that Transport for NSW should set targets to measure the overall satisfaction of train users.

Published

Actions for Volume Four 2013 focusing on Electricity

Volume Four 2013 focusing on Electricity

Planning
Industry
Compliance
Financial reporting
Regulation

During the year, Treasury issued TC 13/01 ‘Mandatory early close procedures for 2013’. This circular aimed to improve the quality and timeliness of agencies’ annual financial statements. In 2012-13, application of the circular was made mandatory for State owned corporations. As a result, the NSW Generators, Distributors and Transgrid were required to perform the early close procedures. All the electricity entities were broadly successful in performing the procedures, which helped them submit financial statements by an earlier due date.

This in turn enabled the financial statement audits to be finalised within an earlier timeframe of eight weeks (nine weeks in 2011-12), with the exception of Eraring Energy’s audit, which is yet to be finalised. The early close procedures also resulted in improvements to the quality of the financial statements, as evidenced by fewer reported misstatements in 2012-13 compared to 2011-12.

Published

Actions for Cost of Alcohol Abuse to the NSW Government

Cost of Alcohol Abuse to the NSW Government

Treasury
Justice
Health
Premier and Cabinet
Management and administration
Regulation

The NSW Government does not estimate or report the total cost of alcohol abuse. The Audit Office of New South Wales’ sponsored research estimates it costs the government over $1 billion a year, or around $416 from each NSW household.

 

Parliamentary reference - Report number #235 - released 6 August 2013

Published

Actions for Making the Best Use of Public Housing

Making the Best Use of Public Housing

Community Services
Internal controls and governance
Management and administration
Regulation

There are 55,000 eligible applicants on the social housing waiting list, with some people waiting for more than ten years to get a house. The waiting list could be more than 86,000 by 2016 unless things change.
 
Social housing only meets about 44 per cent of need in New South Wales even though we have the largest social housing portfolio in Australia. Social housing falls into three groups. About 80 per cent is public housing which is owned and operated by government. The remaining stock is community housing and Aboriginal housing.

 

Parliamentary reference - Report number #234 - released 30 July 2013

Published

Actions for Volume Two 2013 focusing on Universities

Volume Two 2013 focusing on Universities

Universities
Financial reporting
Fraud
Management and administration
Regulation

Except for the matters noted, the Members we reviewed substantially complied with the requirements of the Parliamentary Remuneration Tribunal’s Determination (the PRT Determination) for the year ended 30 June 2012.

The review identified the following material exceptions:

  • nine Member claims were not submitted for payment within 60 days of receipt or occurrence of the expense 
  • eight Members did not return their unspent Sydney Allowance amounts by 30 September 2012
  • sixteen Members did not complete an annual declaration stating the benefits accrued by way of loyalty/incentive schemes, as a consequence of using their allowance and entitlements, were used only for Parliamentary duties and not for private purposes.

There are inherent limitations in undertaking an engagement of this nature. The work was conducted as a review engagement, not an audit. Consequently, the procedures were not designed to detect all instances of non-compliance. The review provides limited assurance and expresses our conclusion about whether the Members reviewed complied with the PRT Determination’s requirements for Member entitlements.

Published

Actions for Management of the ClubGRANTS Scheme

Management of the ClubGRANTS Scheme

Industry
Compliance
Management and administration
Regulation

The ClubGRANTS scheme gives tax rebates to clubs for supporting their local community. Since 2002, $417 million of ClubGRANTS tax rebates have been given to clubs. The scheme recognises the valuable role played by registered clubs in their local communities. However, the public must have confidence that the scheme is delivering genuine services to the community.

 

Parliamentary reference - Report number #229 - released 2 May 2013

Published

Actions for Volume One 2013 focusing on themes from 2012

Volume One 2013 focusing on themes from 2012

Whole of Government
Asset valuation
Compliance
Financial reporting
Fraud
Information technology
Internal controls and governance
Management and administration
Procurement
Project management
Regulation
Shared services and collaboration
Workforce and capability

This overview summarises the significant findings included in my 2012 financial audit report, volumes three to eleven, and highlights NSW agencies’ overall achievements and challenges. The overview summarises key themes and messages arising from these audits to help readers understand common findings. Agencies and their audit and risk committees can use the overview to self-assess and identify issues that may be relevant to their organisations.

It found more than 85 per cent of the recommendations in my 2011 financial audit reports to Parliament were implemented in 2012. Whilst this is less than 100 per cent, NSW government agencies clearly acted on my significant recommendations. However, NSW government agencies need to do more to follow up more detailed recommendations that are made directly to management.