Summary of Report 00-030

May 2000

Report Number 00-030

Reliability of audited performance measures decreased to 54 percent during this performance measures audit period as compared to previous audits, which had an average certification rate of 68 percent. This decrease in accuracy may be because this was the first certification audit for the majority of agencies in this phase. Although decision makers cannot rely on a number of key measures as they have been reported, recommended improvements to performance measurement systems as stated in this report and the Guide to Performance Measures Management (SAO Report No. 00-318, December 1999) would enhance measure reliability.

• Fifty-four percent of 43 performance measures reviewed were reliable. In comparison, the average accuracy rate for the five previous performance measures audits was 68 percent. However, Phase 13 was the first performance measures audit for the majority of agencies audited. The 54 percent reliability rate is consistent with that of the first audits of performance measures, which we completed in fiscal years 1994 and 1995.
• Twenty-three percent of the audited measures were inaccurate, and factors prevented certification of the remaining 23 percent.
• Inadequate source documentation, failure to follow measure definitions, calculation errors, and lack of supervisory reviews were the primary causes of inaccurate data.
• However, it should be noted that four agencies' audited measures were 100 percent reliable:
  • Office of the State Prosecuting Attorney
  • Securities Board
  • Research and Oversight Council on Workers' Compensation
  • State Office of Risk Management
• The State Auditor's Office plans to publish a self-assessment tool on the Internet this summer. This tool will provide detailed guidance to help agencies assess and improve their performance measures.

Contact the SAO about this report.

Download the PDF version of this report. (.pdf)

HTML Equivalent (utilizing Adobe's PDF Conversion by Simple Form).