Indicator Prioritization Tool
Objective: Prioritize indicators at goal and DOC levels, particularly once a brainstorming session has generated too many indicators.
Participants: Program design team
Step and Example
CARE Burundi selected a set of 10 program-level indicators for measuring changes at the impact and domain levels of the TOC for the WEP by scoring all potential indicators against a set of agreed criteria. This process was considered by program staff to have been very useful as a way of reaching agreement on a manageable/ limited number of higher level indicators. “Options” have been added for this guidance.
It is a form of a “values clarification exercise” that helps the team rank the indicators.
- Develop criterium for each 'column': Weight the criteria if you consider one to be of greater importance than another. In this case, assign a weight to each criterion of 1 to 5 (low to high importance).
- For each indicator, mark a score in each of the columns using the criteria at the top of the column – allowable scores are 0-3, where 3 is the very highest/strongest possible.
- For every place where you rate an indicator at “3” (highest level), include some comments about why you rate it that high in that column.
- When done, total across the rows, and identify the highest indicators at goal, and domain (use the pathway level ratings to check if any of the pathway indicators might be better than the existing domain indicators).
*Other criterion to consider: existing source of data, i.e., does not have to be gathered by CARE.
Explanation of the column headings in the worksheet
Column 1
|
Column 2
|
Column 3
|
Column 4
|
Column 5
|
Column 6
|
Column 7
|
The indicator already in the MDI list? Or could it be extracted from one of the MDI indicators |
Linkage to indicators in the national poverty reduction strategy | Has anyone in the office, or any project, used this indicator so that they know something about any special issues in collecting data for it or in analyzing it | Cost effectiveness- can it realistically be done in the local circumstances? | How well does it demonstrate what is happening in this goal or domain? | Can it be done by different persons over the life of the program and get comparable results? | Is it simple enough to be used by/ with communities; and can the results be explained in a meaningful way and used by various stakeholders? |
The example below is from Burundi’s Children Empowerment Program – group 1 (indicators 1-15). This is a partial list; the full set was 7 pages of indicators.
Logical hierarchy / chain |
Objectively Verifiable Indicators |
1. Link with MDIs / MDGs |
2. Link with CSLP / PRSP |
3. Experience within CO |
4. Feasibility |
5. Relevant |
6. Reliable |
7. Understandable |
Total Score |
Impact Vision: By 2015, orphans & children vulnerable to abuse, to denial of rights, aged from 6 to 18, living in economically vulnerable households, particularly girls, effectively enjoy their rights, live in an enabling environment, & see their future with hope & confidence | Level of fulfillment of OVC rights | 1 | 1 | 2 | 1 | 2 | 1 | 1 | 9 |
% of OVC who claim considering their futures with hope and confidence | 0 | 0 | 1 | 0 | 2 | 0 | 0 | 3 | |
% of households hosting OVC & living under $1/day16 | 3 (written in the MDGs) | 2 | 1 | 2 | 3 | 3 (calculate according to the revenue of the HH) | 2 | 16 | |
% of children (disaggregated per sex) who have easy access to quality services | 2 | 2 | 2 | 3 (appreciation of facilities provided) | 2 | 1 | 1 | 13 |