Implementation Evaluation of the Framework for Strategic and Annual Performance Plans (FSAPPs)

1.1 Background to the Intervention The Framework for Strategic and Annual Performance Plans (FSAPP) was introduced in 2010 by National Treasury to align, standardise and inform departmental medium-term strategic planning and annual performance planning. The FSAPP was written to be read in conjunction with the Framework for Management of Programme Performance Information (FMPPI). It applies to national and provincial departments as well as public entities. 1.2 Background to the Evaluation PDG was appointed by the Department of Planning, Monitoring & Evaluation (DPME) to undertake an evaluation of the FSAPP as part of the National Evaluation Plan of 2014/2015. The purpose of the evaluation was to “determine how effective the Framework for Strategic and Annual Performance Plans has been at guiding departments in their service delivery, particularly responding to government’s priority outcomes, and in holding departments accountable for performance” (DPME, 2014a: 5). The following evaluation criteria were applied: relevance and appropriateness, effectiveness, and sustainability. 1.3 Approach and methodology This was an implementation evaluation, with a significant clarificatory design component. The evaluation adopted a participatory approach, including continuous consultation with and inputs from the Project Steering Committee. The methodology featured, firstly, a literature review, introductory interviews, and the development of logic models and data collection instruments. Next, interviews and focus groups were conducted with a purposive sample of 12 national and 19 provincial departments (across four provinces), as well as three parliamentary committee chairpersons. An electronic survey of departments was also conducted, and 105 out of South Africa’s 155 national and provincial departments submitted responses. The evaluation also included a structured analysis of the annual performance plans (APPs) and annual reports (ARs) of 2014/2015 of 32 sampled departments. Further secondary documents analysed included DPME’s review reports on departments’ draft Strategic Plans and APPs for 2016/2017; management performance assessment tool (MPAT) scores for 2012 to 2015 and Auditor-General reports. These data sources were then analysed and integrated to produce findings in relation to the evaluation questions and criteria.