Search

Begin New Search Topic Monitoring

11. Review of the OECD DAC criteria for evaluating humanitarian action: A mapping of literature, guidance and practice

Author:
ALNAP
Publication Date:
08-2023
Content Type:
Special Report
Institution:
ALNAP: Active Learning Network for Accountability and Performance
Abstract:
In 2006, ALNAP published Evaluating humanitarian action using the OECD DAC criteria, an ALNAP guide for humanitarian agencies to strengthen the evaluation of humanitarian action. The primary purpose of this paper is to provide evidence, using existing literature for ALNAP to review and update its 2006 guide. It also serves as a review on the use of the evaluation criteria in humanitarian settings, contributing to the broader body of evaluative knowledge. This paper, a mapping of literature, guidance and practice, provides a high-level overview of each of the OECD DAC criteria for evaluating humanitarian action, how they have been interpreted in sector-wide and organisational guidance, key issues identified in the literature and application in contemporary evaluations. It does not identify contemporary, undocumented debates on the criteria; these will be addressed through forthcoming consultations.
Topic:
Humanitarian Aid, Literature Review, OECD, Planning, Monitoring, and and Evaluation (PME)
Political Geography:
Global Focus

12. Learning to be more 'locally-led'? Current practice and evidence gaps in the international humanitarian sector

Author:
Vijayalakshmi Viswanathan
Publication Date:
11-2023
Content Type:
Working Paper
Institution:
ALNAP: Active Learning Network for Accountability and Performance
Abstract:
This paper aims to provide a clear summary of the evidence and perspectives to date around the issues of localisation and locally led action. Based on the learning gaps that emerged through the literature review and interviews, it also sets out a broad learning agenda around this topic. Research around localisation/locally led humanitarian action proves particularly challenging since its interpretations change depending on where you are or with whom you are speaking. So, although significant attention and literature have been generated since the build-up to the 2016 World Humanitarian Summit, this has primarily focused on tracking progress against commitments towards localisation made by international actors. There is surprisingly little evidence on the relationship between locally led humanitarian action and performance on the ground.
Topic:
Humanitarian Aid, International Organization, Localization, Planning, Monitoring, and and Evaluation (PME)
Political Geography:
Global Focus

13. Working across the humanitarian-development-peace nexus: What can we learn from evaluations?

Author:
ALNAP
Publication Date:
12-2023
Content Type:
Working Paper
Institution:
ALNAP: Active Learning Network for Accountability and Performance
Abstract:
This humanitarian-development-peace nexus evaluation mapping and synthesis paper aims to share key findings from evaluations on how organisations have advanced their version of a nexus approach. The paper offers insights on how the policy concept of the triple nexus has been operationalised and implemented in practice, and it looks at what can be learned from recent efforts. The paper presents a mapping of evidence and analysis from 90 evaluations, syntheses and lessons learned papers that were undertaken between 2018 and April 2022, and it reflects on key findings and trends in those publications.
Topic:
Development, Humanitarian Aid, Organizations, Planning, Monitoring, and and Evaluation (PME)
Political Geography:
Global Focus

14. A Conceptual Framework for Monitoring and Evaluation for Learning and Adaptation (MELA) in NGOs

Author:
James Ward Khakshi
Publication Date:
11-2023
Content Type:
Working Paper
Institution:
BRAC Institute of Governance and Development (BIGD), Brac University
Abstract:
The significance of organizational learning in general and the learning roles of monitoring and evaluation (M&E) in non-government organizations (NGOs) in particular is widely recognized. However, in many instances, the normative frameworks or recommendations tend to be overly theoretical or only partial to their real entirety, which limits their practical applications. This paper aims to contribute with a conceptual framework for monitoring and evaluation for learning and adaptation (MELA) specifically in NGOs. The MELA framework is designed to drive organizational and programmatic improvements by outlining a learning process that encompasses planning, creation, and adaptation based on the learning from M&E activities. The paper introduced the continuum of learning types, the planning process for adaptive management, characteristics of MELA, methodological implications for learning, and programmatic adaptations at operational, tactical, and strategic levels.
Topic:
Development, NGOs, Performance Evaluation, Adaptation, and Monitoring
Political Geography:
Global Focus

15. National PAR Monitor Albania 2021/2022

Author:
Institute for Democracy and Mediation (IDM)
Publication Date:
07-2023
Content Type:
Special Report
Institution:
Institute for Democracy and Mediation (IDM)
Abstract:
In its third monitoring cycle in a row, National PAR Monitor Albania 2021/2022 presents the results of the monitoring of the Public Administration Reform (PAR). Monitoring work was performed during 2021 – 2022 by IDM Albania. The methodological framework designed by the WeBER research team during the previous monitoring cycles (2017/2018-2019/2020) combines quantitative and qualitative sources of evidence. With the SIGMA principles as the building blocks of our monitoring, this report seeks to highlight the civil society perspective and that of the general public on PAR implementation, by focussing in particular at transparency, accountability, and inclusiveness in policymaking. A total of 23 indicators are used to measure PAR developments in six areas: (1) strategic framework for PAR, (2) policy development and coordination, (3) public service and human resource management, (4) accountability, (5) service delivery, and (6) public finance management. For each of the areas, the report provides an assessment for each indicator, a summary of the findings, and recommendations for future action.
Topic:
Development, Services, Monitoring, and Public Administration
Political Geography:
Europe, Balkans, Albania, and Southeast Europe

16. Participatory methods in peacebuilding work

Author:
Evelyn Pauls
Publication Date:
03-2023
Content Type:
Policy Brief
Institution:
Berghof Foundation
Abstract:
This policy brief provides guidance to peacebuilders and conflict transformation practitioners on incorporating participatory methods at all stages of a project's life cycle. Participatory methods can be utilised from conflict analysis through implementation and monitoring and evaluation of project outcomes. The policy brief offers practical recommendations to practitioners on implementing participatory approaches and highlights the potential benefits and limitations of these methods. It also includes a collection of resources for different participatory methods and demonstrates how they can be effectively applied in peacebuilding contexts.
Topic:
Post-Conflict, Peacebuilding, Planning, Monitoring, and and Evaluation (PME)
Political Geography:
Global Focus

17. A Conceptual Framework for Monitoring and Evaluation for Learning and Adaptation (MELA) in NGOs

Author:
James Ward Khakshi
Publication Date:
11-2023
Content Type:
Working Paper
Institution:
BRAC Institute of Governance and Development (BIGD), Brac University
Abstract:
The significance of organizational learning in general and the learning roles of monitoring and evaluation (M&E) in non-government organizations (NGOs) in particular is widely recognized. However, in many instances, the normative frameworks or recommendations tend to be overly theoretical or only partial to their real entirety, which limits their practical applications. This paper aims to contribute with a conceptual framework for monitoring and evaluation for learning and adaptation (MELA) specifically in NGOs. The MELA framework is designed to drive organizational and programmatic improvements by outlining a learning process that encompasses planning, creation, and adaptation based on the learning from M&E activities. The paper introduced the continuum of learning types, the planning process for adaptive management, characteristics of MELA, methodological implications for learning, and programmatic adaptations at operational, tactical, and strategic levels.
Topic:
NGOs, Adaptation, Planning, Monitoring, and and Evaluation (PME)
Political Geography:
Global Focus

18. New Producer Contract Terms and Uncertainty: Lessons From the Recent Past

Author:
Patrick Heller, Perrine Toledano, David Mihalyi, and Tehtena Mebratu-Tsegaye
Publication Date:
03-2022
Content Type:
Special Report
Institution:
Natural Resource Governance Institute
Abstract:
The petroleum industry is volatile, and governments in “new producer” countries have operated at a significant information disadvantage when negotiating with international oil companies. This challenge is growing today; new producer countries face intensifying questions around whether to offer fiscal incentives to maintain investment in the face of 1) the pandemic-induced volatility in oil prices and 2) long-term questions about the future of the industry in the face of the climate crisis and the global energy transition. This confluence of short-term and long-term uncertainty is prompting a reexamination of the narrative that once took hold in many new producer countries. The traditional story was one of linear progression from being non-producers to small levels of production to ultimately having oil and gas become a major economic contributor over the long term. This notion of progression was associated with a commonly held theory: After a country’s first major discovery, the geological risk that wells will be dry was expected to decrease. Countries could therefore shift from a position of having to grant tax breaks (and other concessions) to international investors, to taking a tougher stance in laws and negotiations for new projects going forward. In this paper we examine whether this theory has been borne out in practice and make recommendations to support new producers in their navigation of the uncertainty associated with the energy transition. Among the eight “new producer” countries, for which we analyzed a total of 26 contracts signed before and 25 contracts signed after discovery events (all occurring between 2001 and 2014), the evidence is mixed.
Topic:
Gas, Transparency, Contracts, Monitoring, Energy, and Green Transition
Political Geography:
Global Focus

19. Taking Stock of Early Warning for Atrocity Prevention: Report from the 2021 Sudikoff Interdisciplinary Seminar on Genocide Prevention

Author:
Mollie Zapata
Publication Date:
02-2022
Content Type:
Special Report
Institution:
Simon-Skjodt Center for the Prevention of Genocide, United States Holocaust Memorial Museum
Abstract:
This report compiles essays from several leading experts who participated in the seminar series. We asked them to reflect on one or more key themes and offer recommendations for research and/or policy initiatives that could help current and future leaders address mass atrocities. The collection of essays comprises diverse perspectives and spans reflections on everything from technical approaches to forecasting to practical recommendations on communicating risk to the overall efficacy of forecasting projects. Quscondy-Mohamed Abdulshafi provides recommendations for how mass atrocity monitoring and preventive interventions can make use of social media-generated big data and artificial intelligence (AI), and suggests the need for a strategic collaboration between social media companies and mass atrocity research institutions. Chiara De Franco discusses warning as persuasion, including the importance of clarity and specificity in the content of the warnings, the relationship between the warners and those expected to act on the warning, and the importance of developing a warning strategy that fits into the “swirl of intelligence” continuously confronting policy makers. Håvard Hegre outlines and weighs the benefits of different prediction targets. He argues that the field should move towards “continuous multi-period incidence” (CMPI) targets to avoid arbitrary coding thresholds, enable models to better use available information, and allow for a more nuanced approach to uncertainty in evaluating and describing results. Victor Okorie addresses the role of researchers in situations where atrocity risk is present, and describes the ethical and logistical challenges of those seeking to conduct research where gatekeepers and conditions demand loyalty to the state. In such circumstances, Okorie argues that researchers are obligated to take on an activist role, portray both victims and perpetrators, and strive for objectivity and reflexivity. Clionadh Raleigh questions the assumption of many early warning and prediction models that more accurate, timely warnings will result in the prevention of conflict. She argues that global models attempt to create consistency across cases where none actually exists, and that projects' focus on catastrophic events misses the need for response to low-level threats. She recommends a revised approach to early warning focused on studying each unique environment. Paul Slovic provides an overview of three psychological mechanisms that impede the impact and effectiveness of early warnings: psychic numbing, pseudoinefficacy, and the prominence effect. He concludes with recommendations for those who have been (or may become) victims of atrocity crimes, government officials, non-governmental organizations (NGOs), and the public.
Topic:
Political Violence, Social Media, Risk, Atrocities, and Monitoring
Political Geography:
Global Focus

20. Lessons of lessons: A window into the evolution of the humanitarian sector

Author:
Jessica Alexander and Emmeline Kerkvliet
Publication Date:
09-2022
Content Type:
Special Report
Institution:
ALNAP: Active Learning Network for Accountability and Performance
Abstract:
Monitoring and evaluation is critical for assessing performance and maintaining accountability in the humanitarian sector. For 25 years, ALNAP Lessons Papers have brought together findings and recommendations from a range of different contexts and disaster types, laying out lessons from previous responses in concise and readable ways. This paper looks at a selection of ALNAP Lessons papers across 20 years, aiming to identify where and how the humanitarian system has evolved over time, as well as the areas where progress has been weaker and stronger attention is still needed. It identifies four interesting trends: Structural, system-wide themes appear more frequently in the Lessons Papers. Lessons related to technical learning showed the most change from ‘observational’ to ‘instructional’ over time. Lessons related to structural and system-wide issues don’t change has much over time, staying more ‘observational’. Lessons related to localisation and community engagement and accountability (CEA) show least progress over time.
Topic:
Humanitarian Aid, Community Engagement, Planning, Monitoring, and and Evaluation (PME)
Political Geography:
Global Focus