Did you know that monitoring and evaluation are classified into different types based on the purpose, focus, timing and audience of the assessment? In this article, we have attempted to explore the variety that is commonly used in the development sector to help you plan and execute your M&E more strategically.
Great news is, the variations of monitoring and evaluation are not mutually exclusive and can be used in different combinations in a project to leverage the full potential of M&E.
Before we get into the types of M&E, let’s explore how monitoring differs from evaluation.
Monitoring is an ongoing process. It begins and ends with the project cycle.
Evaluation is conducted at specific points within the project cycle and even after project completion.
Monitoring tracks the project interventions, and everything else that is happening in a project in terms of human resources, budget, materials, activities and outputs, and collects information pertaining to these elements.
Evaluation conducts an in-depth assessment of the activities tracked by monitoring and gauges how well they performed and what difference they made. In other words, it analyses success against the objective to determine the impact, sustainability, effectiveness and efficiency of the project.
Monitoring provides information about the current status of the project and helps to determine immediate remedial actions.
Evaluation provides information and recommendations for long term planning and lessons for organizational growth and success.
Okay, now let’s jump into the variety of M&E used across the development sector.
7 types of monitoring to get you started
This is often referred to as ‘activity monitoring.’ Process monitoring is implemented during the initial stages of a project as its sole purpose is to track the use of inputs and resources, along with examining how activities and outputs are delivered. It is often conducted in conjunction with compliance monitoring and feeds into the evaluation of impact.
Just as the name suggests, the purpose of compliance monitoring is to ensure compliance with donor regulations, grant, contract requirements, local governmental regulations and laws, ethical standards, and most importantly compliance with the expected results of the project. The need for compliance monitoring could arise at any stage of the project life cycle.
Context monitoring is often called ‘situation monitoring.’ It tracks the overall setting in which the project operates. Context monitoring helps us identify and measure risks, assumptions, or any unexpected situations that may arise within the institutional, political, financial, and policy context at any point during the project cycle. These assumptions and risks are external factors and are not within the control of the project, however, context monitoring helps us identify these on time to influence the success or failure of a project.
This type of monitoring is sometimes referred to as ‘Beneficiary Contact Monitoring (BCM)’ and the need for this may arise at any stage of the project cycle. Its primary purpose is to track the overall perceptions of direct and indirect beneficiaries in relation to a project. It includes beneficiary satisfaction or complaints with the project and its components, including their participation, treatment, access to resources, whether these are equitable, and their overall experience of change. Beneficiary monitoring also tracks stakeholder complaints and feedback mechanism.
The main purpose of financial monitoring is to measure financial efficiency within a project. It tracks the real expenditure involved in a project in comparison to the allocated budget and helps the project team to form strategies to maximize outputs with minimal inputs. This is often conducted in combination with ‘process’ and ‘compliance’ monitoring and is crucial for accountability and reporting purposes.
As the name suggests, organisational monitoring tracks institutional development, communication, collaboration, sustainability and capacity building within an organisation, its partners and stakeholders in relation to project implementation.
This is where monitoring entwines with evaluation. It gathers data to demonstrate a project’s overall effects and impacts on the target population. It helps the project team to determine if the project is on the right track towards its intended results and whether there may be any unintended impacts.
10 types of evaluation to put you on the right track
This is generally conducted before the project implementation phase. But depending on the nature of the project, it may also continue through the implementation stage. Its main purpose is to generate baseline data to investigate the need for the project, raise awareness of the initial project status, identify areas of concern and provide recommendations for project implementation and compliance.
It is conducted as soon as the project implementation stage begins. It assesses whether the project activities have been executed as intended and resulted in certain outputs. Process evaluation is useful in identifying the shortcomings of a project while the project is still ongoing to make the necessary improvements. This also helps to assess the long-term sustainability of the project.
This type of evaluation is conducted once the project activities have been implemented. It measures the immediate effects or outcomes of the activities in the target population and helps to make improvements to increase the effectiveness of the project.
This occurs immediately after project conclusion to assess project efficacy and the instant changes manifested by its interventions. Summative evaluation compares the actual outcome data with baseline data to determine whether the project was successful in producing the intended outcomes or bringing about the intended benefits to the target population. It provides evidence of project success or failure to the stakeholders and donors to help them determine whether it makes sense to invest more time and money for project extension.
Impact evaluation assesses the long term impact or behavioral changes as a result of a project and its interventions on the target community or population. It assesses the degree to which the project meets the ultimate goal, rather than focusing on its management and delivery. These typically occur after project completion or during the final stage of the project cycle. However, in some longer projects, this can be conducted in certain intervals during the project implementation phase, or whenever there is a need for impact measurement.
Real-time evaluation is undertaken during the project implementation phase. It is often conducted during emergency scenarios, where immediate feedback for modifications is required to improve ongoing implementation. The emphasis is on immediate lesson learning over impact evaluation or accountability.
This type of evaluation is conducted collaboratively with the beneficiaries, key stakeholders and partners to improve the project implementation. Participatory evaluation can be empowering for everyone involved as it builds capacity, consensus, ownership, credibility and joint support.
Such type of evaluation focuses on one theme across a number of projects, programs or the whole organisation. The theme could be anything, ranging from gender, migration, environment etc.
Cluster or sector evaluation
Just as the name suggests, this evaluation is implemented by larger development and humanitarian sectors, including a group of different organisations, programs or projects that are working on similar thematic areas. It assesses a set of interconnected activities across different projects and entities. As a result, it strengthens partnerships within these key sectors, while improving their coordination, accountability, predictability, and response capacity.
This is used to assess the evaluation process itself. Meta-evaluations could be useful to make a selection of future evaluation types, check compliance with evaluation policy and good practices, assess how well evaluations are utilized for organizational learning and change, etc.
Note: Monitoring is conducted by an internal staff member, whereas, evaluations, depending on its type, could be conducted by internal team members or external consultants/experts. Internal evaluation could help build staff capacity and ownership but they may be subjective at times. On the other hand, external evaluation brings in a degree of objectivity and technical expertise and tends to be more transparent and accountable.
Some content in this article is based on the International Federation of Red Cross and Red Crescent’s Project/Program Monitoring and Evaluation Guide.
Before we sign off, just a quick reminder that this list is not all-inclusive and there are many more types of monitoring and evaluation practiced in the development and humanitarian sectors. If you know of any additional types that you would like to see on this list then do reach out to us and we’d be happy to add them here.