The demand for National Evaluation Policies (NEPs) has gained traction in Africa as more countries acknowledge the value of evaluation in enhancing efficiency, effectiveness, and equity in public and development management. As these countries implement developmental programmes and projects they require appropriate and effective monitoring and evaluation systems to measure performance, assess impact and draw lessons for future programmes and projects. Similarly, the Sustainable Development Goals call for country-led systems to measure effectiveness, efficiency, relevance, sustainability, and the impact of development interventions.
Malgré un cadre juridique et institutionnel favorable à la promotion de l’égalité des sexes, l’intégration du genre dans le système de suivi évaluation du Bénin reste perfectible à bien des égards. La politique nationale d’évaluation adoptée en 2012 ne fait presque pas de provision en matière d’intégration des questions d’égalité des sexes dans les évaluations des politiques publiques nationales. Pourtant, des efforts sont faits par les acteurs du système national de suivi évaluation pour l’intégration des questions de genre dans les évaluations nationales, même si ceci n’est pas systématique et généralisé à tous les secteurs. Le défaut d’un cadre réglementaire et de lignes directrices contraignantes, le manque de capacités techniques et de ressources financières en matière d’intégration et d’analyse genre par les acteurs du SNSE et surtout la faiblesse institutionnelle des principaux organismes nationaux en charge de promotion du genre constituent les principaux facteurs qui limitent la sensibilité genre du système national de suivi évaluation du Bénin.
Teams of national experts were commissioned in Benin, Uganda and South Africa to carry out a country diagnostic of the gender responsiveness of National Monitoring and evaluation system which aims to:(i) Use the AGDEN gender diagnostic tool to review National Monitoring and Evaluation System (NMES) including : a) the National M&E policy, b) institutional arrangements and capacities, and c) processes and procedures;(ii)Identify potential barriers and enablers to having a well-functioning gender responsive M&E system at the country level;(iii)Identifying and developing concrete strategies (or recommendations) to strengthen the gender responsiveness of country’s Monitoring and Evaluation system.
A consultant was recruited to finalise the diagnostic study of the national monitoring and evaluation system (NMES) of Benin. The objective of the activity is to improve the quality of the diagnostic report of the responsiveness of Benin’s national monitoring and evaluation system in relation to gender and to propose a budgeted action plan project to improve it. Specifically, the study included the following tasks:(i) Examine the existing study report; (ii) Collect of additional data;(iii) Refine the existing report;(iv) Develop strong recommendations based on the results of the study;(v) Propose a draft budgeted action plan for the implementation of the recommendations. Based on the results and recommendations from the assessment of Benin’s national monitoring and evaluation system, a multi-year action plan was developed to improve NMES in relation to the different criteria for gender integration. This report is an English translation of the theory of change, results and recommendations. The full background and methodology can be found in French full report. Additional notes on the methodology are found in the three-country synthesis report.
This assessment aims to describe the level of gender-responsiveness in key policies and processes, as well as understand the extent to which there is gender disaggregation in the data that is collected to monitor and evaluate progress through the 14 Outcomes of the Medium Term Strategic Framework (MTSF), and, in a number of cases, these relate to the Annual Performance Planning (APP) processes. It is intended that this will also aid the identification of opportunities within existing processes within GWM&E to mainstream gender. The specific objectives were: (i) Review the extent to which the GWM&E system is being implemented in a manner that is gender responsive. (ii) Examine the data being collected against the indicators within the 14 outcomes of the Medium Term Strategic Framework and conduct an analysis of the extent to which these are gender responsive and disaggregated in terms of gender. (iii) Offer insights on gender in the National Evaluation System.(iv) Provide three case studies which present some of the ways in which these sectors include gender in planning, accountability and M&E, including relevant indicators and data sources outside of the MTSF. (v) Connect with Department of Women liaison, as well as other key role players, to establish gaps in gender in GWM&E and opportunities to enhance gender-responsiveness and disaggregation, with particular reference to engagement in the workshop.
(MDAEP), l’évaluation des politiques publiques relève désormais des attributions de la Primature. Le développement de la pratique évaluative au Bénin ayant été reconnu comme une nécessité par toutes les parties prenantes au processus de développement, le Gouvernement envisage de
développer en cohérence avec la poursuite de la réforme de la gestion axée sur les résultats, un véritable système national d’évaluation qui contribuera à améliorer l’action publique et à renforcer la culture évaluative au sein de l’Administration publique. La présente politique nationale d’évaluation constitue un outil fédérateur pour la concrétisation de cette ambition.
Advancing Evidence-Based Practice for Improved Public Sector Performance: Lessons from the Implementation of the Management Performance Assessment Tool in South Africa
Enhancing public sector performance is on the agenda of most governments. In South Africa, there is a dearth on studies that systematically assess the implementation of public sector performance improvement tools. This article is based on the study that explores the implementation of the Management Performance Assessment Tool (MPAT) within the South African public sector for the period 2011-2016. The critical implementation components are outlined and lessons from the implementation process are drawn to inform future practice.
Assessing Evaluation Education In African Tertiary Education Institutions: Opportunities And Reflections
This article investigates the status quo of evaluation education in selected tertiary institutions in Anglophone African countries. Findings indicate that evaluation education in Anglophone African tertiary institutions is mostly in the nascent stages and there are mixed feelings on the appropriate entry levels (undergraduate or postgraduate). The study highlights the need for developing a specialized evaluation curriculum as well as the potential for collaboration among various stakeholders in strengthening the design and implementation of evaluation education.
Diagnostic on the Supply and Demand of Evaluators: Benin
In April of 2018, Twende Mbele and the Office of the Evaluation of Public Policies and Analysis of Government Action (BEPPAAG), commissioned a diagnostic study on the demand and supply of evaluators. The study focused on the following:
- evaluation market (its strengths and weaknesses),
- the supply and demand capacities for evaluation services (to take stock of skills and identify needs for evaluation capacity building to balance demand and supply for evaluators)
- the size of the evaluation market (as a means of achieving a balance between supply and demand for evaluation), especially in a context of growing demand for valuations.
Diagnostic on the Supply and Demand of Evaluators: Uganda
In April of 2018, Twende Mbele and the Office of the Prime Minister commissioned a diagnostic study on the supply and demand of evaluators in Uganda. On the supply side, the study established that there is a substantial potential pool of M&E consultants in Uganda. The study also established that there are a number of organisations and networks for evaluation capacity building in Uganda. On the demand side, the Government has in place guidelines for the public sector and the Ugandan Evaluation Association has developed and approved standard guidelines that stipulate that evaluators and evaluation teams must be independent, trustworthy and transparently selected.
Diagnostic on the Supply and Demand of Evaluators: South Africa
This diagnostic study on the supply and demand of evaluators in South Africa revealed that on the supply side, the size of the potential supply market will vary depending on how an ‘evaluation consultant’ is defined. The diagnostic was able to produce quantitative estimates of current and projected government demand and some qualitative assessment of non-government demand. It was also able to identify qualitative issues and insights into the research questions related to capacity and skills, representivity, accessibility, pricing and costs.
Diagnostic on the supply and demand of evaluators in Uganda, Benin and South Africa
During 2017 and early 2018, Twende Mbele commissioned separate diagnostic studies on the supply and demand of evaluators in Uganda, Benin and South Africa. While the studies were separate, they had similar terms of reference. The purpose of the diagnostic studies was to provide a demand-and-supply profile of evaluators in these three countries. And the aim on the other hand, was to ascertain whether supply is, and will be in the future, sufficient to meet demand, and what should be done to grow local supply. In all three countries, one of the main barriers to entry was found to be weaknesses with government capacity to formulate, procure and manage evaluations. Nevertheless, in all three countries the diagnostic was able to produce a qualitative assessment of the ability of supply to meet demand, both currently and in the future.
At a Glance: 6 Countries’ NES
The policy- and decision-making environment is inherently political – both party political in terms of achieving an electoral mandate, and in terms of organisation politics and the political economy of the country. This leads to webs of power and influence, through which stakeholders must learn to navigate. In this context, evaluation evidence is one influence on outcomes. It requires translating complex evaluation findings into usable information and recommendations, building a portfolio of evidence, a coalition of stakeholders to support it, and ensuring its use requires planning and influencing strategies.
Scoping Visit to Kenya: 19-22 June 2017
A Twende Mbele Team, comprising of the Acting Commissioner of Monitoring and Evaluation- Uganda’s Office of the Prime Minister, the Uganda Programme Coordinator for Twende Mbele and The Deputy Director General for Research and Evaluation of South Africa’s Department of Planning, Monitoring and Evaluation (DPME), met with key officials from the Kenyan Government, members of Evaluation Society of Kenya and representatives of other key non state actors. In Kenya, the core work for monitoring and evaluation is delivered using the National Monitoring and Evaluation System (NIMES) coordinated by the Monitoring and Evaluation Directorate (MED) domiciled in the Ministry of Devolution and Planning. Key gaps were noted in the M&E policy and It is therefore important that M&E systems and practices in Kenya be strengthened through the Twende Mbele programme by peer learning across the continent.
Mission Expliotaire Au Niger: Août 2017
La mission exploratoire du programme Twende Mbele au Niger a été menée dans des conditions favorables et a fourni une vision synoptique du système de suivi et d’évaluation du pays. Il a donné des résultats satisfaisants en ce qui concerne le mandat et il offre des perspectives intéressantes pour l’avenir d’un système d’évaluation au Niger. Les autorités et les représentants des organismes gouvernementaux ont été utiles et coopératifs et ont été identifiés comme des acteurs de la chaîne de développement. L’équipe du programme Twende Mbele a observé une prise de conscience des problèmes de S & E et de la nécessité de créer un système efficace au Niger. Il a également été observé que, outre une prise de conscience générale, il existe un fort engagement politique au plus haut niveau du gouvernement. Deux grands domaines de coopération ont été notés par l’équipe et seront soumis au comité de gestion de Twende Mbele: renforcement des capacités des acteurs du S & E et soutien à la création d’un système de S & E efficace, mais surtout institutionnalisation de l’évaluation des politiques publiques au Niger.
Scoping Visit to Niger: August 2017
The Twende Mbele Program scoping mission in Niger was conducted under favourable conditions and provided a synoptic view of the country’s monitoring and evaluations system. It has yielded satisfactory results as relates to the term of reference, and it offers interesting prospects for the future of an evaluation system in Niger. Authorities and representatives of government agencies were helpful and cooperative, and are identified as actors in the development chain. The Twende Mbele Program Team observed an awareness of M&E issues and the need to create an effective system in Niger. It was also observed that, in addition to a general awareness, there is strong political commitment at the highest level of government. Two major areas of cooperation were noted by the team and will be submitted to the Twende Mbele management committee, these consist of: capacity building for M&E actors and support for the creation of an effective M&E system, but more importantly the institutionalization of public policy evaluation in Niger.
Scoping Visit to Ghana: 13-15 June 2017
A Twende Mbele delegation undertook a scoping visit to Ghana. The purpose of the visit was to determine how best Twende Mbele could partner with Ghana on M&E, based on their M&E capacity. Over two days, the delegation met with key M&E drivers in the public sector to gauge the level of priority given to M&E in Ghana. Two issues pose a great challenge to the strengthening of the M&E system in Ghana, firstly is the absence of a national evaluation policy and secondly is the lack of capacity around M&E. The changes in governments and realignment of priorities is to blame for the its absence. And, the lack of capacity is a pressing issue as it has a direct impact on the day to day work of M&E duties. And this is where Twende Mbele would like to partner with Ghana, in the strengthening of capacity around evaluations. Ghana has, however, taken it upon itself to strengthen its M&E capacity through the establishment of two new ministries: The Ministry of Planning, and the Ministry of Monitoring and Evaluation.