Filter Questions for Measurement
- Objective: To check the thinking around breakthroughs, indicators and hypotheses across program development and action.
- Participants: Program design team
Questions
Are you designing your measurement systems with the capacity to disaggregate all data by sex (comparing males to females), as mandated by the CARE International Gender Policy?
Here it would be best to consult the CI Gender Policy and review it before initiating your measurement system. Gender disaggregation should apply to all units of analysis. Be sure to disaggregate within the household and not merely at the level of the household head.
Do the measurement elements altogether capture changes in agency, structure and relations (CARE’s empowerment framework)? It is especially important to measure change in structure and relations (i.e., not to privilege agency above the other two).
This information will help you understand the Empowerment Framework and its relation to measurement. Information has been adapted from Christina Wegs and Christine Galavotti’s powerpoint presentation on “Measuring Women’s Empowerment & Gender Equity for Health Outcomes (SRMH & Nutrition).”
Components of the framework:
- Agency: A woman’s own aspirations and capabilities
- Structure: The environment that surrounds and conditions her choices
- Relations: The power relations through which she must negotiate her path
Women often internalize their subordinate status; may have diminished sense of their own value, rights and entitlements, so, at the agency level, empowerment involves a fundamental shift in women’s own perceptions or “inner transformation.”
Empowerment involves critical examination and deconstruction of unequal gender relations that are often seen as natural, but individual “transformation” and agency is not enough. It is not meaningful without the ability and power to implement and realize alternatives.
- A woman needs access to resources (social, political, financial) to enable her to exercise choice, power and control over her life.
- A woman’s exercise of individual capabilities/assets is mediated by social norms that define rights, roles, responsibilities and entitlements of women and men. So we must work to shift social norms that govern social relations.
- Familial and household relations play a key role in perpetuating women’s disempowerment. Over her lifetime, there may be a relative shift in power relations (i.e. from young woman to mother) but this is not enough. What is needed is a fundamental shift in unequal power relations among men and women in society.
Here are examples from CARE’s SII work on how outcomes are classified:
Agency |
Structures |
Relations |
1. Self-Image; self-esteem | 11. Marriage and kinship rules, norms and processes | 19. Consciousness of self and others as interdependent |
2. Legal and rights awareness | 12. Laws and practices of citizenship | 20. Negotiation, accommodation habits |
3. Information and skills | 13. Information and access to services | 21. Alliance and coalition habits |
4. Education | 14. Access to justice, enforceability of rights | 22. Pursuit, acceptance of accountability |
5. Employment/control of own labor | 15. Market accessibility | 23. New social forms: altered relationships and behaviors |
6. Mobility in public space | 16. Political representation | |
7. Decision influence in household | 17. State budgeting practices | |
8. Group membership and activism | 118. Civil society representation | |
9. Material assets owned | ||
10. Body health and bodily integrity |
Are changes in different units of analysis being measured - the individual, household, community, group level, and the aggregate (population level)?
Women’s empowerment is a social change process that is manifest at many different levels. It is not sufficient, for example, to merely refer to change at individual level (often, agency indicators). Change is almost invariably embedded in relations which a woman has with household members, community, with other women in a collectivity, and as part of society. These must all be taken into consideration.
Research on measuring women’s empowerment tells us that in fact few standard indicators measure the interaction between individuals/households and larger community, district or state. Also most of the case studies on women’s collective action for social change are descriptive with few standard measures.
Population level measurement often uses proxy indicators for WE, such as participation in education, labor force, age at first marriage, political representation.
Are you measuring both process and outcome of women’s and girls’ empowerment? How are you disaggregating this and measuring equivalent measures in men and boys?
Both process and outcome are equally important to understanding achievements in and threats to women’s and girls’ empowerment. And often the “process” to achieving specific outcomes will differ for the population or sub-population group. The risks (e.g., of increasing women’s economic empowerment) may be higher for some groups than for others. At the same time, this is what makes measuring women’s empowerment and the reason it is important to apply a mix of qualitative and quantitative data gathering methods.
Women and girls’ empowerment, however, cannot be measured exclusively; it needs comparison with men and boys’ empowerment for gender equity to be achieved.
Are you capturing both breadth (scale) and depth of impact?
Even with reporting on indicators, evidence can sometimes be anecdotal with reference to a specific success case or possibility of change, for example. It is important that programs demonstrate systematic measurement and that means being able to show breadth or scale of the social changes – for how many women is this true? AND depth – how much improvement? What is a significant level of change?
This data is essential to demonstrate that a specific model of change works or to convince policymakers that the impact achieved is truly significant. Efforts at policy change must proceed from credible evidence.
Are you capturing the essential changes among key stakeholders in government, civil society and the private sector reflected in our theory of change?
Where reference is made in your theory of change to any of these actors, check to see that you are actually measuring changes in their behaviors and decisions. And do not neglect the private sector, as CARE is more accustomed to working directly with civil society and government.
It may help to construct a matrix showing what the essential anticipated changes are for each category of actor.
Are you including men and boys in measurement of behavioral change at target group level?
Inclusion of men and boys is pivotal to success in achieving gender parity. As such, they become very important target groups in any program. Try to identify within your particular country context which men and which boys are important to target and the behaviors for your behavior change strategy.
Are there any expected changes in the overall theory of change that are not being captured and may actually be slipping through the measurement cracks?
This is a final check on your theory of change, after you have selected breakthroughs, indicators, hypotheses, and macro trends. Go back to the theory of change and ask yourselves what you have neglected.