Peru Evaluations

Publications

The Evaluations Activity publications include a range of documents and tools produced to support the use of evidence for decision making and the strengthening of local organizational and professional capacity for monitoring, evaluation and learning. These publications are organized here into two categories: Evaluations and Assessments; and, Learning and Capacity Building.

‘Evaluations and Assessments’ provides access to full reports (as available in the USAID Development Experience Clearinghouse) as well as derivative publications designed to provide users with the key findings and recommendations from each report.

‘Learning and Capacity Building’ provides access to tools and documents that Evaluations has produced as part of its M&E capacity building activities, which have benefited dozens of local private and public organizations as well as M&E professionals from across the development sector in Peru.

All products are provided in English and Spanish whenever available; with each product indicating its corresponding language.

Evaluations/Assessments

FILTER DOCUMENTS

Análisis de Género: Perú 2016 (2017)

Assessment | Economic Growth, Governance

The purpose of this assessment is to analyze the gaps between men and women in access to and control over economic, political and social resources; to examine gender-based restrictions in the sectors and region where USAID operates; to analyze how gender-based violence affects women’s participation; and to review the equal opportunity policies implemented by the Peruvian government. This assessment is intended to provide USAID with key information that will allow it to make strategic and programmatic decisions in preparing its new 2017-2021 strategy for Peru.

The assessment revealed that the primary gender-based restriction on equitable participation and access to equal opportunities is the assignment of work roles. Women’s contributions are through uncompensated domestic work, which represents 20% of Peru’s gross domestic product. These contributions are not recognized, while at the same time they limit women’s involvement in paid, social and political activities. Furthermore, gender-based violence affects 71% of Peruvian women, and physical violence affects 32%. The costs of this violence on small businesswomen is 1% of the gross domestic product. Although the policy and statutory framework for equal opportunity is quite advance, there have only been small administrative changes to address gender mainstreaming, and no functions or budget programs have been created to allocate specific resources to this goal. This study’s recommendations focus on providing visibility on the effects of continuing the gaps and restrictions on equal opportunity, the need to incorporate a focus on gender in project planning, and including indicators for monitoring and allocating a budget.

The low performance of the manufacturing sector in Ucayali, which employs a large number of qualified workers, could highlight that the shortage of skilled human capital is limiting the growth of Ucayali's economy. This may also become an important restriction to the discovery of new productive activities. With regards to health, Ucayali performs worse than the national average. Regarding electricity, the percentage of households that have access to electricity in Ucayali is relatively low, while the energy costs are close to the national average.

Regarding macroeconomic risks, the slow growth of Peru's GDP as a consequence of a less positive international context, indicates that Ucayali will operate in the coming years in a less benign context. Regarding the institutional development, Ucayali is relatively well positioned. There seems to be a problem in the forestry sector, where the lack of an adequate system of concessions would be one of the factors that limit the development. Regarding the financial development, there is a significant presence of commercial banks.

According to this evaluation, there are three main barriers to economic growth in Ucayali. First, these is a problem of low returns associated with poor development of complementary factors. Second, Ucayali faces a major problem associated with the limited technical quality of government bureaucracies. Third, the problem of low returns in the forestry sector is also associated with the presence of coordination failures, which are absent in the new agricultural sector.I17

This evaluation assesses the transferability and sustainability of the Healthy Communities and Municipalities II model and the viability of applying this model in non-health sectors. Evaluation questions explore the model in design and practice; what behavioral changes are observed; the degree to which governments and stakeholders adopted the model; the feasibility of other sectors adopting the model; and, how the model can contribute to achieving USAID Development Objectives.

The evaluation uses a qualitative analysis that applies transfer and sustainability criteria to key informant interview data. Interviewees include representatives from communities, governments, health facilities, decentralized sectors, NGOs, and firms.
The results indicate the MCS model is versatile and can be applied in full or in part, according to context. Empowered community management councils work with local government and health officials to achieve health and other objectives. Five actors led the model in different contexts: multiple levels of government, a national institution, local governments, NGOs and private firms.

The model is apt for adoption by different sectors and by USAID. The education, agricultural and housing sectors are particularly well suited to adopt the model. USAID already employs the model to strengthen community governance under alternative development activities, and the model can similarly serve as a vehicle for public service management and community forest management under DO2 and DO3.

Future results and sustainability can be strengthened through the increased participation of regional governments, strengthening government and community council capacities, and replicating the project’s success in identifying priority community demands as model entry points.

The objectives of this final evaluation were to: (1) identify the contribution of the USAID supported Amazon Malaria Initiative (AMI) to the ability of eleven partner countries’ National Malaria Control Programs to control malaria from 2001 - 2015; (2) evaluate the capabilities of partner countries to address the changing scenarios of malaria transmission; and, (3) identify the main challenges that countries may face while confronting new scenarios of malaria transmission as well as the challenges that should be addressed by international cooperation agencies. The evaluation used a mixed analytical approach incorporating qualitative and quantitative methods. The qualitative component included in-depth interviews with key informants, content analysis of selected documents, and case studies from four partner countries. The quantitative component included the analysis of data obtained from epidemiological databases on malaria and the review of selected documents.

AMI partner countries have shown a substantial but heterogeneous reduction of malaria cases since the year 2001, including some setbacks and slower progress in later years, especially the last four. Partner countries have achieved substantial progress and developed important capabilities in all six of the AMI Program technical focus areas. AMI supported capacity development that addressed country-specific malaria control needs and scenarios. The program served as a platform for inter-country collaboration, introducing innovations and strengthening information systems through national communication strategies and alliances. Key capacities for malaria control have been built and enhanced, and these continue to respond to changing epidemiological scenarios. However, there is a need to make improvements, such as better planning and monitoring of activities including alignment to PAHO´s strategy, in order to consolidate progress and prevent the reintroduction of malaria.

The principal recommendation of this evaluation is to maintain the progress to date. Malaria elimination is still in the distant future, and it is more important to continue building strong programs, overcome current and upcoming crises and prevent re-emergence in settings where malaria is under control. The control of malaria is not exclusive to the national level, but instead requires a regional agenda meriting support from the international cooperation, as PAHO, in coordination with partner countries.

Evaluación Final de Desempeño del Proyecto Peru Bosques (2017)

Evaluation | Environment / Natural Resource Management, Governance

This evaluation analyzes the contribution of the Peru Bosques Project (PPB) to the progress made in fulfilling the Environmental Chapter and the Forest Sector Governance Annex of the United States-Peru Trade Promotion Agreement (PTPA). The evaluation focuses specifically on contributions to the institutional strengthening of the forestry sector; capacity building in forest management; monitoring, control, and supervision of illegal logging; and to the sustainable use of the forest by the private sector and indigenous communities.

The evaluation employs a mixed-methods approach that includes primary qualitative data gathered in Lima, Madre de Dios, Loreto and Ucayali. Main findings suggest that the PPB contributed substantially to the consolidation of the institutional reforms in the forestry sector through three important results: support for the creation and implementation of the National Forestry and Wildlife Service (SERFOR), improvement to the viability of the prior consultation process for the new regulations for the Forestry and Wildlife Law, and in the customized design of the Regional Environmental Authorities (ARAs) for the regional governments of Loreto, Madre de Dios, and Ucayali.

The PPB intervened successfully with the private sector, which is a key ally in the fight against illegal logging and for the sustainable use of forests. The intervention involved the participation of indigenous organizations in the first regulatory consultation process and the training of community stakeholders to protect the forest. However, there is a lack of capacity building at the community level. Capacity building efforts among civil servants were hampered by a lack of political will and the slow implementation of the civil service law.

The evaluation recommends: strengthening the coordination and transparency functions of the governing body of the National Forestry and Wildlife System; institutionalizing capacity building on environmental and forest management issues with regional governments; promoting community forest management with indigenous organizations; and, promoting incentives within a value chain approach for the legalization and formalization of timber and non-timber forest activities.

The main purpose of this study has been to evaluate the project "Support and expansion of the methodology of Active Schools", implemented by the Centro de Estudios y Promoción Comunal del Oriente (CEPCO), with USAID support, on the effects of the application of the entrepreneurship methodology in the academic area of Education For Work (Educación para el Trabajo - EPT in Spanish) in high schools in the Monzón district, located in Huanuco, Peru. The research questions address the results of the implementation; the conditions, both in the context and in schools, which affect its progress; and the motivating factors and ideal student profiles that maximize the possibility of generating licit ventures. Likewise, this study also investigates the conditions that would allow this initiative to be sustainable and replicable. The methodology combined the application of qualitative data collection tools and surveys to members of the educational community and local authorities in the communities of Cachicoto, Palo de Acero, Maravillas and Chipaco. The findings reveal the significant contribution of the intervention to the improvement of educational services, the development of technical skills, and changes in attitudes and values of students. However, according to the findings, the local context limits the sustainability of the initiative, especially because of the short duration of the intervention. Finally, the role and leadership of school principals is crucial to obtain the expected results and any possible replication.

La economía del VRAEM. Diagnóstico y opciones de política (2016)

Assessment | Alternative development, Economic Growth, Governance

The Peruvian Valley of the Apurimac, Ene and Mantaro Rivers (VRAEM) has an undiversified agricultural economy dominated by the cultivation of coca. The production of coffee, cacao and coca occupy almost all of the valley economy’s fixed factor, land, and share available labor. In this economy, where licit and illicit activities coexist, options for promoting economic growth must be understood in the context of the factors that determine the profitability of cacao and coffee relative to the profitability of coca.

This study uses an inclusive growth diagnostic (IGD) to answer several questions: What are the main barriers to economic growth in the VRAEM? What is the role of the counter-narcotics in overcoming these barriers? And, what policies will stimulate the area’s economic growth?

The study identifies four barriers to economic growth: 1) lack of a clear and effective application of the law to combat illitic drug trafficking; 2) inadequate transportation infrastructure; 3) market restrictions and the absence of an adequate labor force; and, 4) weak property rights, particularly with regard to the communal property rights of indigenous communities. The study presents recommendations to address these barriers, taking into account the distinct factors that affect illicit and licit economic activities in northern and southern VRAEM. Foremost among the recommendations is reducing the profitability of illicit coca cultivation through the state’s adoption of an effective counter-drug strategy for the VRAEM implemented by the institutions responsible for Peru’s counter-drug program. Several of the recommended strategies, including the strengthening of producer associativity and integrating value chains, have been prioritized by the government and other actors, which highlights the need to adopt an integrated set of interventions that simultaneously address the different barriers to economic growth.

Mid-term Evaluation of the Technical Assistance Program for the Ministry of Environment Peru (2015)

Evaluation | Environment / Natural Resource Management, Governance

This mid-term evaluation makes strategic and operative recommendations based on a performance analysis of the Technical Assistance Program (TAP) for the Ministry of the Environment (MINAM). These recommendations are intended to support the project to accomplish its objectives by its completion in 2016. The study seeks to identify obstacles that may be hampering the effectiveness of the TAP by identifying the reasons that the objectives embodied in the project’s results framework have been achieved or not.

The TAP constitutes a modality for Government-to-Government (G2G) cooperation that is oriented towards increasing counterpart capacity and the sustainability of results beyond the period of USAID funding.

The TAP has made an important achievement by incorporating a number of resources originating from international cooperation into the Peruvian public sector budget. These can be used to strengthen the capacity of MINAM as the lead agency of the National Environmental Management System (SNGA). However, delays in the initial implementation process and in establishing an understanding of how a program of this nature should function now require rethinking MINAM needs and adapting to the process of consolidation at MINAM. The TAP will need to define a set of specific objectives and performance results that reflect this process and the accompanying changes to optimize results over the remainder of the project.

Mid-term performance evaluation of Amazon Malaria Initiative (2014)

Evaluation | Health

The Amazon Malaria Initiative (AMI) was launched in 2001 by USAID to improve control and treatment of malaria by the Ministries of Health in the countries located in the Amazon basin through the National Malaria Control Programs (NMCP). Currently there are eleven members of the Amazon Network for the Surveillance of Antimalarial Drug Resistance (RAVREDA): Brazil, Colombia, Ecuador, Guyana, Peru, Suriname, Belize, Guatemala, Honduras, Nicaragua and Panama. These countries collaborate by exchanging information, experiences and expertise. Furthermore, AMI intends to improve malaria control at the sub regional level and help decrease national morbidity and mortality.

The evaluation of AMI used multiple data sources and method analysis. Some of the findings include an association between AMI and the decline of the malaria-related deaths in the region. According to respondents, the contribution of AMI was key to implement the cooperation needed to evaluate performance of microscopists and vector control and management of drugs. Further findings show that the reduction of malaria cases generated a scenario that affects marginalized populations.

Some of the recommendations include an alignment of AMI with PAHO's plan against malaria. AMI also needs to define which activities still require the support of USAID and what actions are required to make the program sustainable, considering the expansion to other countries of the region. It is also important to strengthen the AMI technical cooperation activities and develop a performance monitoring plan (PMP).

This midterm evaluation looks at the first two years of the Peru Decentralization and Local Governance Project (ProDescentralization). This project began on October 2012 and is scheduled to finish on October 2017. It is based in five departments of the Amazon Basin and its focus is on strengthening the decentralized management of selected services. It aims to intervene in order to consolidate the policy framework (IR 1) and broadening transparency and citizen participation (IR 3) to contribute to the success of interventions, strengthening capacity for effective democratic governance at the subnational level (IR 2). To achieve this, it sets up clusters, the Decentralized Management Groups (GGD), each comprised of one regional government, one provincial government, and at least three district governments to set objectives and implement the project.

The evaluation was carried out through interviews with the stakeholders at all levels: USAID officials, ProDecentralization team, public officials, service users and beneficiaries, and focus groups. The evaluation team found that the project is relevant to USAID and the Peruvian government’s priorities. Confronted with the particularities of the decentralization process in Peru, ProDecentralization adopted a flexible strategy that prioritized the consolidation of capability at the subnational level.

Among more specific recommendations, ProDecentralization should emphasize the importance and benefits of decentralization as demonstrated through project results. It should also continue to develop training materials, coordination guidelines, and supervision processes. The project should also consider providing assistance to enhance training and service supervision to the Peruvian government for well-trained managers at the subnational level.

The evaluation of the Promoting Long-Term Sustainability of Parque Nacional Cordillera Azul project concludes that it has indeed contributed. This project was held in Parque Nacional Cordillera Azul (PNCAZ) in the tropical Andes. It contains hectares of pristine, continuous mountain forest in Peru and invaluable biodiversity. PNCAZ remains a threatened region. However, because of the project, a Park Business Plan has been approved, a fiscal agency that will administer the endowment has been selected, a PNCAZ REDD project has been validated and verified, and over 5.7 million carbon credits on the REDD+ carbon market have been offered, among other accomplishments.

All this has helped to generate sufficient revenue to achieve financial sustainability for the Park. This diversification was achieved successfully after finding that the donor funding strategy was not producing the required results. This is particularly important, since by showing that the park can generate resources through its protection, there may be an incentive to support the park's preservation. This creates a need to manage the stakeholder's expectations.

Rapid Evaluation of the Peru Cocoa Alliance (2016)

Evaluation | Alternative development, Economic Growth

The Peru Cocoa Alliance (PCA) started as the Global Development Alliance (GDA). Now, because of changes in the private partners, the PCA is a traditional USAID project that answers only to USAID management. Its objectives are to promote alternative economic development in former coca-growing areas. Households in Huanuco, Ucayali and San Martin get sufficiently attractive licit income to prevent a return to coca growing. This means help to grow 28,000 hectares of cocoa in areas where coca was previously grown. Since the project started, it has changed in some major ways, which triggered this evaluation.

One of the findings was that the private sector has made important contributions to the PCA. It has positioned Peru on the World map as a future source of fine flavored cocoa. Buyers are willing to pay a premium for this product. Moreover, there has been a positive impact that the PCA has had on small producers. However, the structure that is currently in place for the project is not conducive to sustainability after the USAID funds end.

Recommendations for the PCA include a three-year extension with more emphasis on post-harvest assistance and identifying multiple markets and helping match producers with buyers. Also thought needs to go into establishing a fee for service mechanism for the project.

Retrospective Impact Evaluation of Alternative Development Program in Huanuco, San Martin and Ucayali (2007-2012) (2014)

Evaluation | Alternative development, Economic Growth, Governance

Between 2002 and 2011 the US government (USG) and the Peruvian government (GOP) implemented the Alternative Development Program (ADP) in areas inside San Martin, Huanuco and Ucayali. The lack of infrastructure and government were causes for illicit coca production. The program's goal was to reduce this activity by promoting licit economic alternatives and increasing social capital. The ADP includes a collection of projects funded by USAID, implemented by different partners. Until 2006 the interventions focused on communities that voluntarily agreed to eradicate illicit coca (R-376). After that, the focus was on communities that agreed not to replant coca after eradication by the GOP (Plan 20XX). Furthermore, between 2006 and 2008 forced eradication was implemented in some communities. Assistance was provided to these communities afterwards.

To measure the impact of the ADP, a household survey was used. This data goes from 2007 to 2011 and was carried out by Peru's National Commission for Development and Life without Drug (DEVIDA). This process was not perfect, since there were factors such as lack of information and no baseline survey. However, there was evidence of interesting potential effects attributable to the ADP in these regions.

Some of the findings include an important improvement in income for the ASP families between 2007 and 2011 in all regions in the case of cacao and in Huanuco also in the case of coffee.

The main purpose of this ethnographic study was to understand in a comprehensive manner the decision-making process with respect to the cultivation of coca in families residing in the community of Agua Blanca, Valley of Monzon, Huanuco. The main research question has been: what are the main factors that enter into the decision-making process to cultivate coca on a farmer from an alternative development area? Methodologically, the team has worked with six families selected according to two criteria: their participation in the integrated and sustainable alternative development strategy of the Peruvian government and their level of income. We have followed the ethnographic method, which, through basic interviews and participant observation techniques, allows a micro level approach to the reality of the families studied.

The main findings show factors that contribute and attenuate the decision of families regarding the cultivation of coca. Some of the first are the poor quality of the soil, the absence and poor quality of public services and infrastructure and the uncertainty of the viability of alternative crops as income generators. Among the latter we mention the tranquility of a life with less social conflict and the counsel of children educated in urban areas. The influence of the spouses can attenuate the option for coca if the family has his financial needs solved. Another finding is that the alternative development strategy does not consider the heterogeneity of families, since families who do not comply with the cultivation targets, which often happens for lack of resources, are removed from the program.

Toma de Decisiones en Hogares y Cultivo de Coca en Shanantia (2017)

Assessment | Alternative development

This is an ethnographic study aimed to investigate household decision making behavior with regards to grow or not grow coca in the community of Shanantia, in the area of Huipoca, district and province of Padre Abad, Ucayali region. The ethnographic work was carried out during five weeks, from March to April 2016. The key findings lead to conclude that: (a) families who grow cacao can exit the cycle sowing-selling of coca leaf, but also can return to it through their employment in coca harvesting; (b) the process of economic autonomy, which begins in children and adolescents since age 13/14, enables them to grow coca, cultivate it, invest and get benefits from it; (c) labor migration informs the adolescent males of other economic activities within and outside the region, be they legal or illegal, which facilitates the cultivation of coca outside the community; (d) the coca functions as a rescuer/useful crop to meet specific and expensive needs, especially if there are no stable revenue sources during the growing of cacao plants, which lasts three years, and only this year will yield their first harvest; and (e) the installation of State control, the perception that this exists, and appreciation for State actions discourages the replanting of coca. For the remaining 2016, decisions will depend on a positive opinion about the alternative development program be installed among these citizens.

Application for performance measurement based on best practices of evaluation networks
ABP_Eval

The ABP-Eval application is a tool to assess an M&E Network’s level of progress in adopting best practices. It allows the user to identify gaps in an organization’s expected and actual performance. With this information, a team can proceed with the analysis of the root causes for these performance gaps and, subsequently, elaborate and implement a performance improvement plan for the Network.

Application for the self-assessment of development needs of competencies in monitoring, evaluation and evidence-based knowledge management
Application ACME
Version 2.0 - 2015

The Application for the self-assessment of development needs of competencies in monitoring, evaluation and evidence-based knowledge management (ACME) has been developed based on this competency profile and aims to identify the needs for capacity building in monitoring, evaluation and evidence-based knowledge management of the professionals that perform M&E. This self-assessment is achieved through critical self-analysis and is expressed in the level of studies required to achieve the competences