Refine search Expand filter

Reports

Published

Actions for Contracting non-government organisations

Contracting non-government organisations

Community Services
Compliance
Fraud
Management and administration
Procurement
Regulation
Service delivery

This report found the Department of Family and Community Services (FACS) needs to do more to demonstrate it is effectively and efficiently contracting NGOs to deliver community services in the Permanency Support Program (a component of out-of-home-care services) and Specialist Homelessness Services. It notes that FACS is moving to an outcomes-based commissioning model and recommends this be escalated consistent with government policy.

Government agencies, such as the Department of Family and Community Services (FACS), are increasingly contracting non-government organisations (NGOs) to deliver human services in New South Wales. In doing so, agencies are responsible for ensuring these services are achieving expected outcomes. Since the introduction of the Commissioning and Contestability Policy in 2016, all NSW Government agencies are expected to include plans for customer and community outcomes and look for ways to use contestability to raise standards.

Two of the areas receiving the greatest funding from FACS are the Permanency Support Program and Specialist Homelessness Services. In the financial year 2017–18, nearly 500 organisations received $784 million for out-of-home care programs, including the Permanency Support Program. Across New South Wales, specialist homelessness providers assist more than 54,000 people each year and in the financial year 2017–18, 145 organisations received $243 million for providing short term accommodation and homelessness support, including Specialist Homelessness Services.

In the financial year 2017–18, FACS entered into 230 contracts for out-of-home care, of which 49 were for the Permanency Support Program, representing $322 million. FACS also entered into 157 contracts for the provision of Specialist Homelessness Services which totalled $170 million. We reviewed the Permanency Support Program and Specialist Homelessness Services for this audit.

This audit assessed how effectively and efficiently FACS contracts NGOs to deliver community services. The audit could not assess how NGOs used the funds they received from FACS as the Audit Office does not have a mandate that could provide direct assurance that NGOs are using government funds effectively.

Conclusion
FACS cannot demonstrate it is effectively and efficiently contracting NGOs to deliver community services because it does not always use open tenders to test the market when contracting NGOs, and does not collect adequate performance data to ensure safe and quality services are being provided. While there are some valid reasons for using restricted tenders, it means that new service providers are excluded from consideration - limiting contestability. In the service delivery areas we assessed, FACS does not measure client outcomes as it has not yet moved to outcomes-based contracts. 
FACS' procurement approach sometimes restricts the selection of NGOs for the Permanency Support Program and Specialist Homelessness Services
FACS has a procurement policy and plan which it follows when contracting NGOs for the provision of human services. This includes the option to use restricted tenders, which FACS sometimes uses rather than opening the process to the market. The use of restricted tenders is consistent with its procurement plan where there is a limited number of possible providers and the services are highly specialised. However, this approach perpetuates existing arrangements and makes it very difficult for new service providers to enter the market. The recontracting of existing providers means FACS may miss the opportunity to benchmark existing providers against the whole market. 
FACS does not effectively use client data to monitor the performance of NGOs funded under the Permanency Support Program and Specialist Homelessness Services
FACS' contract management staff monitor individual NGO performance including safety, quality of services and compliance with contract requirements. Although FACS does provide training materials on its intranet, FACS does not provide these staff with sufficient training, support or guidance to monitor NGO performance efficiently or effectively. FACS also requires NGOs to self-report their financial performance and contract compliance annually. FACS verifies the accuracy of the financial data but conducts limited validation of client data reported by NGOs to verify its accuracy. Instead, FACS relies on contract management staff to identify errors or inaccurate reporting by NGOs.
FACS' ongoing monitoring of the performance of providers under the Permanency Support Program is particularly limited due to problems with timely data collection at the program level. This reduces FACS' ability to monitor and analyse NGO performance at the program level as it does not have access to ongoing performance data for monitoring service quality.
In the Specialist Homelessness Services program, FACS and NGOs both provide the data required for the National Minimum Data Set on homelessness and provide it to the Australian Institute of Health and Welfare, as they are required to do. However, this data is not used for NGO performance monitoring or management.
FACS does not yet track outcomes for clients of NGOs
FACS began to develop an approach to outcomes-based contracting in 2015. Despite this, none of the contracts we reviewed are using outcomes as a measure of success. Currently, NGOs are required to demonstrate their performance is consistent with the measures stipulated in their contracts as part of an annual check of their contract compliance and financial accounts. NGOs report against activity-based measures (Key Performance Indicators) and not outcomes.
FACS advises that the transition to outcomes-based contracting will be made with the new rounds of funding which will take place in 2020–2021 for Specialist Homelessness Services and 2023 for the Permanency Support Program. Once these contracts are in place, FACS can transition NGOs to outcomes based reporting.
Incomplete data limits FACS' effectiveness in continuous improvement for the Permanency Support Program and Specialist Homelessness Services
FACS has policies and procedures in place to learn from past experiences and use this to inform future contracting decisions. However, FACS has limited client data related to the Permanency Support Program which restricts the amount of continuous improvement it can undertake. In the Specialist Homelessness Support Program data is collected to inform routine contract management discussions with service providers but FACS is not using this data for continuous improvement. 

Appendix one – Response from agency

Appendix two – About the audit

Appendix three – Performance auditing

 

Parliamentary Reference: Report number #323 - released 26 June 2019

Copyright reserved by the Audit Office of New South Wales. All rights reserved. No part of this publication may be reproduced without prior consent of the Audit Office of New South Wales. The Audit Office does not accept responsibility for loss or damage suffered by any person acting on or refraining from action as a result of any of this material.

Published

Actions for Energy rebates for low income households

Energy rebates for low income households

Planning
Industry
Compliance
Fraud
Internal controls and governance
Management and administration

The Department of Planning and Environment provides more than $245 million in energy rebates to around 27 percent of NSW households. This report highlights that the department is not monitoring the rebate schemes to understand whether they are delivering the best outcomes.

Most rebates are ongoing payments applied directly to energy bills reducing the amount payable by the householder. The structure of these rebates is complex and can be inequitable. Some households are eligible for four different rebates, each with its own eligibility criteria.  Also, some households in very similar circumstances receive different levels of support depending on what type of energy is used in their home or which adult in the house is the energy account holder. For example, a household using both electricity and gas receives more assistance than a household with electricity alone even if total energy bills are the same. 

The Department of Planning and Environment (Department) administers five energy rebate schemes targeted to low-income households. The five rebates are of two key types:

1. Ongoing support to pay energy bills
2. Crisis Support  

More than one million rebates are paid each year to over 800,000, or around 27 per cent, of NSW households. Households learn about rebates from a variety of sources including: Service NSW, government and energy retailer websites, energy retailer welcome packs, Department marketing efforts, information on energy bills, and Centrelink.  

The budget for energy rebates is increasing every year and in 2017–18 is more than $245 million. The Department delivers most rebates through a network of partnership arrangements with:

  • energy retailers, who apply rebates directly onto energy bills
  • more than 340 charities and other NGOs who assess households' eligibility for crisis support and distribute support through the Energy Accounts Payment Assistance scheme (EAPA)
  • Service NSW, who informs NSW households about rebates through their call centre.

The energy rebates budget is substantial and the distribution arrangements are complex. The objective of the audit was to assess whether the current design and distribution of energy rebates schemes is effective.

Conclusion
The Department administers the rebate schemes using partners to ensure funds are directed towards energy bills as intended. Ongoing support schemes provide assistance to low-income households as intended, but have no measurable objectives or outcome measures and therefore can't be assessed for their effectiveness. Crisis support (EAPA) has a clear objective, to keep households experiencing financial crisis connected to energy services, but the Department does not monitor the performance of EAPA against this objective.  

The structure of rebates providing ongoing support is complex and can be inequitable for some households. Reducing the number of separate schemes and simplifying eligibility requirements offers the most scope for improving effectiveness of ongoing support schemes.  

The growth of embedded networks1 represents a future administrative risk to the Department.

Partnering with energy retailers, charities and NGOs delivers advantages, but stronger oversight is required over partner organisations.

The Department and partner organisations administer the rebate schemes as designed

The Department oversees a complex package of rebate schemes in partnership with 25 retailers and around 340 charities and NGOs. The partnership arrangements ensure that funds are distributed directly to energy bills as intended. The schemes provide support to recipients and are administered in line with government decisions about eligibility.  

Communication about rebates does not reach all eligible households

Households learn about rebate schemes through a mix of communication channels including retailer websites and call centres, Department websites, Centrelink, financial counsellors, EAPA Providers, the Energy and Water Ombudsman and Service NSW. Some low-income groups, such as those with poor English language skills, do not find out about energy rebates.

Scheme objectives are not measurable

Rebate schemes that provide ongoing support do not have measurable objectives or outcome measures. Without clear and measurable objectives, the Department cannot report to government on whether the schemes are achieving the intended policy outcomes, nor recommend improvements to ensure the schemes deliver the greatest benefit to the most financially vulnerable households.

The EAPA crisis support scheme has a clearer objective in that it aims to keep households experiencing financial crisis connected to energy services. However, the Department does not measure outcomes from providing this type of support, and does not know if the crisis support achieves this objective.  

The structure of rebate schemes for ongoing support is complex

The Low Income Household Rebate accounts for 80 per cent of the budget for ongoing support rebates. The remaining 20 per cent of the budget is administered through four separate schemes: Gas Rebate, Medical Energy Rebate, Family Energy Rebate and Life Support Rebate.

Each of these rebates has its own eligibility criteria and some require separate application processes. The Family Energy Rebate is complex to access and apply for, and around one third of households do not reapply each year. Eligible households that receive energy through embedded networks apply directly to the Department for rebates, which are paid by the Department into bank accounts. Embedded networks are energy supply arrangements where the manager of a residential facility such as a caravan park, retirement village or apartment block, buys energy in bulk and then on-sells it to residents. The Department is yet to develop strategies to address a forecast increase in such households.

The design of the rebate schemes creates some inequities

Households in similar circumstances can receive different levels of assistance depending on which adult in the house is the energy account holder, the mix of energy types used in the home, or the EAPA Provider they turn to when in financial crisis.

Households with both gas and electricity connections receive more assistance than those with only electricity. Households in rural and regional areas receive the same value rebate as households closer to Sydney, despite higher distribution charges. Family Energy Rebate is a two-tier payment, with a higher amount available to families with greater means. Lower-income families receive a much smaller Family Energy Rebate on the assumption that they already receive Low Income Household Rebate. Charities and NGOs distributing EAPA crisis support apply inconsistent standards when assessing household need, which leads to inequitable levels of assistance.

Departmental oversight of energy retailers and EAPA Providers is not strong enough

While partnering with energy retailers and EAPA Providers delivers advantages, stronger management is needed to ensure that partners follow Departmental guidelines and to minimise the potential for fraud. The Department's accreditation process for potential EAPA Providers does not consider the applicant's financial governance standards and the most recent audit of EAPA Providers was 2013.


[1] Embedded networks are energy supply arrangements where the manager of a residential facility such as a caravan park, retirement village or apartment block, buys energy in bulk and then on-sells it to residents.

By September 2018, the Department of Planning and Environment should:

  1. Ensure effective strategies are in place to make information about rebates available to all eligible, low-income households
     
  2. Evaluate alternative models and develop advice for government to reduce complexity and improve equity of ongoing rebates
     
  3. Establish measurable objectives for schemes that provide ongoing support, and monitor and measure performance of all schemes against objectives and outcome measures
     
  4. Assess the impacts of the forecast increase in embedded networks and develop strategies to manage any increased administrative risk
     
  5. Strengthen assurance that EAPA is being provided in accordance with its objectives and guidelines by implementing accreditation and compliance programs
     
  6. Ensure those eligible for EAPA financial support are not disadvantaged by inflexible payments, inconsistent provider practices, or inability to access an EAPA provider in a timely manner. Options include:
    • moving from a fixed-value voucher to a flexible payment based on need irrespective of energy type
    • establishing a ‘Provider of Last Resort’ facility for households that cannot access an EAPA Provider.

Appendix one - Response from the Agency

Appendix two - About the audit

 

Parliamentary reference - Report number #292 - released 19 September 2017 

Published

Actions for Assessing major development applications

Assessing major development applications

Planning
Compliance
Internal controls and governance
Management and administration
Risk
Shared services and collaboration

The Planning Assessment Commission (the Commission) has improved its decision-making processes for major development applications in recent years. The Commission has improved how it consults the public and manages conflicts of interest, and now also publishes records of its meetings with applicants and stakeholders.

The Planning Assessment Commission (the Commission) is an independent body established in 2008 under the Environmental Planning and Assessment Act 1979 (the EP&A Act). It makes decisions on major development applications in New South Wales. Along with the Department of Planning and Environment (the Department) and the Land and Environment Court, it is one of three bodies that have a role in making decisions on these applications.

The Department refers development applications to the Commission where 25 or more objections have been received from the community, a local council objects to the proposal, or the applicant has donated to a political party.

These applications are often complex and controversial, and can attract a high level of public interest. This may mean that, regardless of the process, not all stakeholders are satisfied with the outcome.

The Commission is required to take into account section 79C of the EP&A Act when making decisions. Section 79C includes consideration of the likely environmental, social and economic impacts of the development.

This audit assessed the extent to which the Commission’s decisions on major development applications are made in a consistent and transparent manner. To assist us in making this assessment, we asked whether the Commission:

  • has sound processes in place to help it make decisions on major development applications that are informed and made in a consistent manner
  • ensures its decisions are free from bias and transparent to stakeholders and the public.

Conclusion

Over the last two years, the Commission has improved its decision-making process. It has improved how it consults the public and manages conflicts of interest, and now also publishes records of its meetings with applicants and stakeholders.

However, there are still some vital issues to be addressed to ensure it makes decisions in a consistent and transparent manner. Most importantly, the Commission was not able to show in every decision we reviewed how it met its statutory obligation to consider the matters in section 79C of the EP&A Act.

Despite improved probity measures put in place by the Commission, there is a perception among some stakeholders that it is not independent of the Department. The reasons for some of these concerns are outside of the Commission’s control. For example, the Commission becomes involved after the Department has prepared an assessment report which recommends whether a development should proceed. This creates the perception that the Commission is acting on the recommendation of the Department. The Department’s assessment report should state whether an application meets relevant legislative and policy requirements, but not recommend whether a development should be approved or not.

More can also be done to improve transparency in decision-making and the public’s perception of the independence of Commissioners. The Commission should continue to improve how it communicates the reasons for its decisions and also publish on its website a summary of Commissioners’ conflict of interest declarations for each development application.

Decision-making processes have improved but some key aspects need to be addressed

Although not articulated in one document, there is a framework in place to assist Commissioners make decisions on major development applications. This includes setting out the information to be considered, who to consult, and that a report is to be prepared. The Commission has recently improved how it conducts public meetings and the level of support provided to Commissioners to ensure they understand the decision-making process. The Commissioners we interviewed all showed a good understanding of their role.

As a consent authority, the Commission is required to consider the matters in section 79C of the EP&A Act when making a decision. However, it was not able to show how it met this requirement in every decision we reviewed. We found some evidence of these considerations in six of the nine cases we reviewed, for example in meeting notes or in its report on a decision. Of these six cases, the degree to which the Commission considered all matters under section 79C varied considerably. The larger, more complex applications were more likely to address these considerations. To demonstrate compliance with the EP&A Act, the Commission must be able to show how it considers all matters in section 79C for each decision it makes.

We found that the Commission has access to relevant information to make a decision and consults stakeholders for their views of the development. The level of consultation depends on the size and complexity of an application. If Commissioners decide they need more information to make a decision, they consult local councils, the community, other government agencies and experts as needed.

The Commission’s public meetings are a valuable part of the decision-making process, where new perspectives or issues are often raised. However, some aspects could be improved. For example, many stakeholders thought the five minutes allowed for individual speakers was insufficient. The Commission could be more flexible with this timeframe. Identifying new ways to notify the public of its meetings, other than advertisements on its website and in newspapers, would also ensure it reaches as many interested parties as possible.

Improved transparency and probity but the Commission is not seen by some as impartial

The Commission has sound processes in place to ensure that its decisions are impartial and transparent to the community. It has improved its probity measures over the last two years, following a review by the NSW Ombudsman in 2014. We found that the Commission:

  • has probity policies and procedures which are available on its website
  • has improved its record keeping of some processes, such as meetings with applicants and stakeholders
  • publishes its decision and supporting documentation, such as meeting notes, on its website.

Conflicts of interest are a significant risk for the Commission because they could lead to corruption, abuse of public office, and affect the public’s view of its independence. The Commission manages this risk well. It has a policy in place to address potential, perceived or actual conflicts. Commissioners update their conflicts of interest records annually, and declare any conflicts when the Commission assigns them to a development application. Unlike the Commission’s probity polices, Commissioners’ conflict of interest declarations are not available on its website. Providing a summary of this information on its website when Commissioners are allocated to a development application would further improve transparency around conflicts of interest.

The Commission has been improving how it communicates its decisions to the public. It now produces fact sheets for its decisions on matters that attract a high level of public interest. Its reports on decisions for complex applications also discuss issues raised by the community. However, the level of detail varied in the decisions we reviewed, and it was not always clear how conditions placed on a development would resolve identified issues. Similarly, the reports did not clearly address the matters under section 79C of the EP&A Act. Reporting this would further improve the transparency of its decisions, and clearly demonstrate compliance with the EP&A Act.

While we did not find any issues that would make us question the integrity or independence of Commissioners, there remains a perception among some stakeholders that the Commission is not impartial. Some of these concerns are within the Commission’s control to fix, such as allowing individual speakers at public meetings extra time to discuss their issues, therefore avoiding perceptions of bias.

Other perceptions, such as the Commission being part of the Department and not an independent decision making authority, are outside the Commission’s immediate control. For example, the Commission receives applications at the end of the assessment process, after the Department has prepared an assessment report recommending whether the application should be approved. This means there are effectively two reports on an application; the Department’s assessment report and the Commission’s report on its decision. However, there is only one decision-maker: the Commission. This may cause community confusion about the roles of the Department and the Commission in the decision-making process. Clearer separation of their roles in assessing applications and preparing reports is needed.

To minimise the perception that the Commission is simply ‘rubber stamping’ the Department’s recommendations, assessment reports should not recommend whether or not a project be approved. Instead, they should provide the Department’s views on whether a project meets relevant legislative and policy requirements. The Commission should also be involved earlier in the process, so it can establish key facts and identify relevant issues sooner. It should request that the Department’s assessment report covers matters Commissioners consider particularly important when assessing projects under section 79C. Earlier referral of applications should also help the Commission to plan its work in assessing applications, and may reduce the time taken to reach a decision.

Unless these issues are addressed, stakeholders will continue to believe the Commission does not act in a transparent and impartial manner, which could erode public confidence in the Commission.

The Planning Assessment Commission

The Planning Assessment Commission (the Commission) is a planning authority established in 2008 under the Environmental Planning and Assessment Act 1979 (the EP&A Act). One of its functions is to make decisions on major development applications.

The Commission is independent of the Department of Planning and Environment (the Department) and the Minister for Planning. This means its decisions are not subject to the direction or control of the Department or the Minister.

The Department refers applications for major development to the Commission, including state significant development and infrastructure applications. These projects are generally initiated by the private sector. Applications are referred to the Commission when one or more of the following criteria are met:

  • more than 25 objections are received about the proposal
  • the local council objects to the proposal
  • the applicant has donated $1,000 or more to a political party or member of parliament.

These applications are often controversial and may attract a high level of public interest. Of the 29 development applications the Commission received in 2015–16, almost 40 per cent were in the mining and energy sectors, and another 40 per cent related to urban development.

Section 79C of the EP&A Act outlines the matters the Commission must consider when making decisions about major development applications. These include:

  • any relevant environmental and planning instruments
  • likely environmental, social and economic impacts of the development
  • suitability of the site for the development
  • submissions received about the application
  • the public interest.

In addition to making decisions about major development applications, the Commission also reviews major developments as part of the planning process, and provides independent expert advice to the government on planning and development matters. Since the Commission’s inception, it has provided advice on 76 matters, conducted 39 reviews, and made 444 decisions on development applications.

Process for approving major development applications

The Commission is one of three bodies that have a role in the planning and approval process for major development applications in New South Wales, as seen in Exhibit 1. The other two bodies are the Department of Planning and Environment, and the Land and Environment Court.

The Department determines the outcomes of major development applications. When an application meets one of the criteria listed above, it refers these to the Commission to make the decision. In certain circumstances, the Land and Environment Court hears appeals against decisions made by either the Department or the Commission.

A Memorandum of Understanding between the Commission and the Department sets out timeframes the Commission must meet when making a decision, specifically:

  • two weeks where no stakeholder meetings are required
  • three weeks where stakeholder meetings are required
  • six weeks when a public meeting is required.

The Planning Assessment Commission should:

By July 2017:

  1. improve transparency by publishing on its website a summary of the Commissioners’ conflict of interest declarations for each development application referred to the Commission for determination, and how any conflicts were handled
     
  2. keep better records of how it considers each matter under section 79C of the EP&A Act for all decisions it makes on major development applications
     
  3. improve the public’s involvement in public meetings by:
    1. identifying and implementing additional mechanisms to notify the community of public meetings to ensure as many interested parties are advised as possible
    2. allowing the chair of decision-making panels discretion to extend the time allowed for individual speakers beyond five minutes
  1. continue to improve how it communicates the reasons for its decisions to the public by:
    1. including a summary in its reports of the issues raised during the consultation process and how they were considered by the Commission
    2. clearly outlining in its reports how any conditions placed on a development will address the issues raised
    3. detailing in its reports how section 79C of the EP&A Act has been addressed
    4. issuing fact sheets to accompany its reports for all decisions where public meetings were held
  1. work with the Department of Planning and Environment to:
    1. develop an agreed approach to presenting the Department’s views in its assessment reports on whether the project meets relevant legislative and policy requirements, reflecting the Commission’s status as an independent decision-maker
    2. refer applications to the Commission earlier in the process to ensure the Department’s assessment report covers matters that Commissioners consider important when assessing projects under section 79C of the EP&A Act.

Published

Actions for Helping older people access a residential aged care facility

Helping older people access a residential aged care facility

Health
Community Services
Compliance
Internal controls and governance
Management and administration
Risk
Service delivery
Shared services and collaboration
Workforce and capability

Assessment processes for older people needing to go to an Residential Aged Care Facility (RACF) vary depending on the processes of the Aged Care Assessement Teams (ACAT) they see and whether or not they are in hospital. The data collected on ACAT performance was significantly revised during 2004 making comparisons with subsequent years problematic. ACATs have more responsibilities than assessing older people for residential care. It is not clear whether they have sufficient resources for this additional workload.

 

Parliamentary reference - Report number #160 - released 5 December 2006

Published

Actions for Controlling and reducing pollution from industry

Controlling and reducing pollution from industry

Planning
Environment
Compliance
Management and administration
Regulation

The regulatory framework introduced under the Protection of the Environment Operations Act 1997, along with other initiatives progressively being implemented by the Environment Protection Authority (EPA), should enhance the overall effectiveness of environment protection in NSW. The Audit Office is of the opinion that the framework is consistent with best practice and once fully implemented, should contribute to the achievement of further improvements in the environmental performance of industry.

However while the legislative framework supports best practice in regulation and enforcement, there are a number of issues which limit the effectiveness of the reforms. Some of the problems, such as the quality of licences and the effectiveness of compliance activities, have been identified by the EPA and may be addressed through recent initiatives.

 

Parliamentary reference - Report number #82 - released 18 April 2001