The SAI PMF provides Supreme Audit Institutions (SAIs) with a framework for voluntary assessments of their performance against the International Standards for Supreme Audit Institutions (ISSAIs) and other established international good practices for external public auditing. SAI PMF is a multi-purpose, universal framework, and can be applied in all types of SAIs, regardless of governance structure, mandate, national context and development level.
SAI PMF was officially endorsed as an INTOSAI tool at the INTOSAI Congress in Abu Dhabi in December 2016.
Click on image to enlarge
The framework can be used to contribute to improved SAI capacity development and strategic planning through promoting the use of performance measurement and management, as well as identifying opportunities to strengthen and monitor SAI performance and to strengthen accountability. It is relevant for those SAIs that have adopted, aspire to adopt, or wish to benchmark themselves against the ISSAIs and other international good practices. It is a voluntary tool and not intended to be obligatory in all or parts of the INTOSAI community.
In line with the objectives of ISSAI 12 The Value and Benefits of Supreme Audit Institutions – making a difference to the lives of citizens, the SAI PMF also provides SAIs with an objective basis for demonstrating their ongoing relevance to citizens and other stakeholders. It aspires to assess SAI contribution towards strengthened accountability, transparency and integrity. It gives SAIs an opportunity to become model organizations, leading by example in promoting transparency and accountability through credible public reporting on their own performance.
The Supreme Audit Institutions Performance Measurement Framework (SAI PMF) was developed by the INTOSAI Working Group on the Value and Benefits of SAIs (WGVBS) following a decision at the INTOSAI Congress in South Africa in 2010. The 2016 version, which was subject to extensive consultation and testing through more than 20 pilot assessments, and several official rounds of consultation endorsed at the INTOSAI Congress in Abu Dhabi in 2016, reflects experiences from the Pilot Version (from July 2013), which was with numerous stakeholders during 2013-15.
Prior to the SAI PMF Task Team making a decision to develop a new tool for assessing the performance of SAIs, the INTOSAI-Donor Secretariat conducted a mapping of existing tools used within the INTOSAI and donor communities to assess the performance of SAIs. The purpose of the mapping was to gain an understanding of the existing tools, and to consider the usefulness of different tools, in whole or in part, to inform the development of a future SAI PMF. The mapping exercise showed that none of the existing tools met all the defined requirements that such a tool should meet in order for it to serve the needs of different stakeholders. The main recommendation from the mapping report was to develop a new SAI performance measurement tool, with the aim of meeting as many of the requirements as possible building on already existing tools so as not to duplicate efforts.
Experiences of SAI's with SAI PMF
SAI PMF is a cornerstone of INTOSAI Strategic Goal 2 “Capacity Development”, and is identified as a strong basis for assessing needs to inform SAI strategic plans and capacity development efforts. The INTOSAI Capacity Building Committee (CBC) has the strategic governance lead for SAI PMF. Importantly, the CBC is to “serve as the custodian of the SAI PMF and advocate for its use among SAI” and to “provide strategic direction for and oversee the implementation, maintenance, use, and relevance of the SAI Performance Measurement Framework”.
The SAI PMF Unit within IDI is the operational lead on SAI PMF support, coordination, and facilitation. It acts as a global coordinator and provider of SAI PMF support functions, under the supervision and strategic guidance of the CBC as the custodian of the SAI PMF.
In order to strengthen the development and implementation of the SAI PMF, a SAI PMF Independent Advisory Group (IAG) of volunteer donors, SAIs and INTOSAI bodies was established The IAG provides strategic advice and recommendations to support the CBC and the SAI PMF Unit in their efforts to continuously develop and implement the SAI PMF strategy. It is also tasked with ensuring continued and appropriate donor engagement in the SAI PMF.
Current members of the IAG are:
When the INTOSAI approved the SAI PMF in December 2016, they also gave support to the SAI PMF Implementation Strategy 2017-19. The SAI PMF strategy was developed by a working group established on the request of the INTOSAI Goal chairs, comprised of the CBC (SAI South Africa and SAI Sweden), the INTOSAI-Donor Secretariat, the INTOSAI Development Initiative and the Chair of the WGVBS (SAI Mexico).
The overall purpose of the strategy is to guide the global rollout of SAI PMF after endorsement at INCOSAI 2016 to achieve sustainable improvement in SAI performance globally, through use of SAI PMF.
To achieve this purpose, the following two strategic outcomes have been identified:
The SAI PMF Implementation Strategy emphasizes the need for regionally tailored SAI PMF implementation plans based on needs and resources. The plans are being developed in cooperation between the SAI PMF Unit within IDI, INTOSAI Regions and other relevant committees at the regional level. Those implementation plans shall lay down agreements for delivery of regional training courses and events, knowledge-sharing activities, and other needs-based support. They will include the planned SAI PMF activities such as:
The SAI PMF Unit has received a number of requests from INTOSAI regions, individual SAIs and donors for programs that facilitate the conduct of SAI PMF assessments and use of its results. A program to facilitate the conduct of SAI PMF assessments would be a coordinated regional approach to undertaking SAI PMF, where the assessment teams will be given appropriate training through a series of sequenced modules, in addition to support and guidance from resource persons and peers during the assessment. A facilitated programme supports monitoring of SAI and regional level strategic plans for sustainable institutional, organizational and professional development.
Each group of SAIs participating in a facilitated programme will consist of approximately 5-6 SAIs and the aim would be for the participating SAIs to complete all modules and their SAI PFM report within a period of about one year.
The structure of a facilitated programme is flexible, meaning that it can be adjusted and elements can be added according to demand and need.
The SAI PMF Unit in IDI was established in early 2017, when it took over operational responsibilities for SAI PMF roll-out and support from the INTOSAI Donor Secretariat. The SAI PMF Unit is the operational lead on SAI PMF and is the global training body, support function and knowledge center for SAI PMF and provides following services:
A key pillar of the SAI PMF Implementation Strategy is to build a network of SAI PMF assessors on the SAI PMF in order to build capacity among the INTOSAI and Donor Communities, both to carry out SAI PMF assessments and to train others who use SAI PMF.
The SAI PMF Unit is currently providing the following training modules on SAI PMF:
Training modules are offered upon demand and in coordination with the INTOSAI Regional Bodies.
|Training Events 2018|
|23-25 May||Norway||SAI PMF Basic training course||GLOBAL|
|6-8 June||Suriname||SAI PMF Basic training course||CAROSAI|
|18-21 Sept||Peru||Basic training course and planning workshop||OLACEFS|
|October||Madrid||SAI PMF Basic training course||GLOBAL|
|7-9 Nov||Peru||SAI PMF Advanced training course||OLACEFS|
|December||TBD||SAI PMF Independent Review course||GLOBAL|
Each individual SAI PMF assessment should take measures to ensure a high-quality product. Regardless of approach, arrangements for quality control and independent review should be planned, performed and disclosed to ensure proper quality of the assessment. A suggested solution for quality control arrangements prior to independent review can be that the assessment team leader is responsible for the first level of quality control, while the second level is conducted by managers or staff in the SAI, and/or potentially a donor organization, who have not been part of the assessment team. The quality control should verify that the facts presented in the report are correct, and ensure that issues have not been misinterpreted. Further guidance for quality arrangements can be found in the SAI PMF guidance for assessors. Further guidance can be found in the library
The SAI PMF unit maintains a monitoring system to track progress in implementation of SAI PMF assessments around the world. The systems compiles information from an annual progress survey, as well as from updates from individual assessments.