Evaluation Studies

Sampark conducts evaluation studies on a wide universe of development issues across India and South East Asia. Prominent studies on the issues of livelihood security, study of an NGO and freedom from bondage have been listed below.

2011

The evaluation has been done for Care-India with an objective of documenting the processes, outcomes and impacts of the SART Project, a post Tsunami intervention by CARE, to strengthen the nascent MFIs in order to build up their institutional capacities to deliver effective MF services to the affected and needy communities in the Tsunami affected and disaster prone locations in India and its neighborhoods. The study results showed that the financial management inputs have helped the partner organizations to seriously consider the factors of operational costs and financial sustainability and as a consequence, measures are in place to gradually reduce the cost of operations and to increase the financial and operational self-sufficiency of the respective MFIs. The loans have helped the clients to invest in small businesses, traditional livelihoods like agriculture and allied activities, children’s education and in assets, both productive and household. The introduction of insurance services combined with disaster orientation/training has reduced the disaster related vulnerability of the affected communities. The study recommended that there is need to have provision of technical inputs at least for five years, need to establish a legal structure to provide long term revolving loan capital for partner MFIs or to make appropriate linkages/steps to provide venture capital like tapping social investors, lobbying and sensitizing lead banks about the current status of SART initiatives and the funding needs of emerging MFIs, adequate attention to the creation of baseline relating to poverty, gender and women’s’ empowerment parameters in order to get a comprehensive data base to measure the corresponding impacts during the course and at the end of the project, of poverty targeting, women’s empowerment and gender aspects.

The Karnataka state government has planned to construct Tadadi Sea Port near Gokarna in Uttara Kannada district. It will be the second biggest Port in Karnataka after Mangalore. As part of the feasibility study Sampark has been invited to conduct a Social Impact Assessment for the project to understand the livelihood arrangements for the affected people in the Port region. The objectives of the assessment are: understand the socio-economic impacts of the persons connected to the proposed Tadadi Port project and provide an action plan for improved livelihood of people in the proposed Port region. The planning, preliminary visit to the field and design of sampling has been completed and collection analysis of data and writing the report in under progress.

<span>The Government of Gujarat, which focuses on human development and aims to achieve the MDGs in India in collaboration with UNDP, recognized the importance of looking at the empowerment aspect of SHG programme that has been implemented in Gujarat. With this need it had commissioned a study to Sampark to assess one of the women’s empowerment programme called Sakhi Mandals (SHG programme) in two districts of Gujarat to see how far this programme has been successful in building the capacities of women for improving the livelihoods of the poor families, and identify where the programme needs to focus on human development aspects to be strengthened. The study covered the assessment of Sakhi Mandals (SMs) in terms of strengths, weaknesses, opportunities and threats (SWOT) and the impact of the programme on the economic and empowerment aspects of livelihoods of the poor families. To read more about this study click <em>here</em>.</span>

<em><span>The study used both quantitative and qualitative data from both primary as well secondary sources. The actual primary data using questionnaire survey has covered 225 groups out of which 223 have been used for quantitative analysis. The study used qualitative methods such Focus Group Discussions (FGDs), interviews and case studies, and obtained information from members of 44 groups (which were part of total sample of 225 groups) covering 237 women and 28 people from various stakeholder institutions. The conclusion of the study was that the SM programme has an entry point to initiate an empowering process with a strong human development focus. It has enabled women to inculcate savings habit, access cheaper credit which has reduced dependency, increase confidence level of women and expose them to mainstream institutions like banks and government offices. However, these groups need to travel a long way in terms of building their capacities to manage their organization, taking shared responsibilities, utilizing their resources well, engaging in livelihood based activities and participating in decision making at group, household and community level. They need to be organized into strong people’s institution, with access to mainstream resources and overall improved livelihoods. Government and the other various players have a significant role to play in improving the capacities of these women groups for the success of the SHG approach and achievement of poverty alleviation and </span></em><span>empowerment<em> of women.</em></span>

A study on Socio Economic Status of Unorganized Labourers in Construction Sector in Gujarat was conducted for the Directorate of Human Development, Government of Gujarat. The study was conducted in Ahmedabad, a big urban metropolis in Gujarat having plenty of employment opportunities in the construction sector. The study documented the livelihood status of unorganized migrant construction workers employed in Gujarat, identified the gaps between the legal provisions and ground realities and suggested essential elements of a model contract that would protect the rights of construction workers in Gujarat. The study results showed that the Gujarat state government has taken some steps towards registration of construction workers and some welfare schemes, but the structures and processes in place do not display serious intention, and discriminate against migrants from outside Gujarat. The Acts need to be enforced with the same vigour and commitment with which they were formed; they will else become worthless. Gujarat has the wherewithal to put the recommendations made here into practice as well as to initiate a dialogue with the central government.

2006

Sampark’s team worked with an evaluation team and conducted an evaluation of a project on “Prevention and Elimination of Bonded Labour “(PEBLISA) which was supported by the International Labour Office (ILO) in AP and Tamil Nadu, India. The main objective was to study and understand the models used to prevent and eliminate bonded labour in AP and TN and see to what extent these models could be replicable within and outside states. Group discussions and individual interviews were used to collect information from all the stakeholders of the project. Analysis showed that microfinance, in combination with skill training programmes, played an important role in preventing the vulnerable group from falling in the trap of bonded labour. The village level structures created as a part of the project need further support in order to become sustainable. The main recommendations of the study were to further develop the design in order to scale up; the model in the next phase could be located in source districts as well as destination districts of interstate migrant labour; to focus on specific sectors would additionally enable more depth on the development of lessons; to link with technical expertise from other sectors within ILO from other large poverty alleviation programmes in India, and with different ministries would help to achieve greater effectiveness and sustainability.

Based on Sampark’s performance in understanding and presenting the results of evaluation of PEBLISA in India, ILO awarded the organization an assignment to compile the impact and evaluation reports of PEBLISA implemented in India, Pakistan, Nepal and Bangladesh. As an overall statement, the interventions of PEBLISA have demonstrated the effectiveness of various measures for prevention and elimination of bonded labour at the micro, meso and macro levels. Many lessons of the project are highly replicable, while others are still at a nascent stage. The study recommended that there is a need for ILO to continue the project and to be a catalyst in bringing together the power and resources of other partners to achieve the common goal of prevention and eradication of bonded labour, and other forms of forced labour. The report can be accessed on www.bondedlabour.org.

2004

Sampark conducted a participatory review with eight partners of Care’s CASHE (Credit and Savings for Household Enterprise) project. The study involved both local stakeholders and CARE staff in designing and conducting the study. The impacts from the CASHE project have been studied and documented at various levels: individual, household, group and community. The different aspects studied are economic, social, gender governance and sustainability. The methodology adopted for the study includes questionnaires and surveys, as well as group discussions and PRAs. The study recommended aspects that “prove impact and also those that “improve impact”. It outlines lessons learnt from the project that by enable a deeper understanding on the basis of which to reshape CASHE project’ s Tier 1 inputs ad processes. Suggestions towards improvement include review and refining of log frame of the project, streamlining microfinance system and enabling a consultative process with women to decide legal form of financial institution and augmenting their capacity to manage it. Finally the study recommended tracking and enabling economic as well as social and political empowerment of poor women.

The livelihood security project, called Jeevika, was designed by the International Fund for Agricultural Development (IFAD) in partnership with the United Nations Office for Project Services (UNOPS) and the World Food Project (WFP) for the victims of the earthquake in Gujarat on January 26th. SEWA implemented the project with the aim of providing long-term livelihood security to economically vulnerable households in three districts of Gujarat. Under this project 1258 savings groups were formed with a total of savings of Rs.1,31,30,682. Sampark identified the gaps and provided recommendations related to monitoring and evaluating systems of self-help groups and their credit projects. Some of the recommendations are:

Strengthen the SHGs on book writing and management of SHGs

Provide training on enterprise development

Use of innovative strategies to include poorest of the poor in the SGHs, which is the main objective of the programme

This study was conducted for the KFPE, Berne, to understand and analyze the impact of the collaborative research project on the farmers. The project between the National Chemical Laboratory (NCL) Pune, India, the Swiss Federal Institute of Technology (ETH), the Department of Microbiology, Atlas Agro and the Swiss Federal Research Station for Agro-ecology and Agriculture was taken as a case study to analyze and understand the dynamics of such a partnership. The main objective of the study was to understand the dynamics of the partnership and to draw from this understanding valuable lessons and recommendations with which we identified the contributing and inhibiting factors of collaborative North- South research partnership. The research project was on “The microbial Control of Pests: Entomopathology Fungi as Mycoinsecticides” in India.

Sampark conducted a review of the community business support project for the Traidcraft, UK, an organization dedicated to fighting poverty through fair trade. This project was implemented by the International Resources for Fairer Trade (IRFT), a charitable trust and working partner of Traidcraft, in order to expand its work in India. The objectives of the study are to review IRFT’s experiences as a business development service provider and to assess the reasons for successes and failures of the partnership process. Based on this analysis, lessons were drawn that will be incorporated in the planning of future IRFT community business support program operations. Based on our discussions with the stakeholders, a set of impact indicators were outlined which will be used for monitoring and assessment at the end of the project. During the review process researchers learned several lessons from the IRFT, because like Sampark, IRFT does both consulting and development work. For example, while delivering business support the organisation alternates between playing a facilitating role and an implementing role. Because of their desire to help the poor, NGOs tend to work with the business aspects rather than as facilitators. Sampark has faced the same types of conflict while providing microcredit and enterprise support for the poor, and was therefore in a position to suggest several ways in which IRFT could systematise their services to NGOs and make its business development services more effective.

2001

The role of Sampark is to assist in the process of transformation of NBJK’s CREDIT project into a financially sustainable credit operation. The scope of work covered advising on appropriate institutional form for the micro credit operations, appropriate MIS systems as well as usage of CARE’s corpus fund after the project period. Sampark studied the process of NBJK’s credit system through conducting longitudinal study with their senior and filed level staff. Based on these observations, a Strategic Business Plan (SBP) was developed for CARE’s CREDIT project. The process has been participatory and has involved exposure visits to major micro credit organisations in the country, as well as workshops for visioning and business planning. A detailed loan estimation exercise was done by and validated again through key staff in CARE and NBJK, as inputs for the business plan. Based on this process which was spread over ten months, the strategic business plan has been formulated. Sampark also developed SEEP framework, which assesses needs as a micro enterprise organisation passes from the development stage to sustainability stage and finally to expansion stage. Reviewing an organisation through this framework brought out clearly the strengths and weaknesses of an organisation that seeks to become an enterprise development organisation. It was identified that there is need to install the suitable MIS and supported in identifying Under the conclusions it was mentioned that reiterate the importance of attending to organisational changes in terms of ensuring adequate capacity of staff and systems, and ensuring viability of the credit portfolio. Institutional form is another important decision, on which groundwork remains to be done. It is also important to continue and deepen work on the longitudinal impact study to ensure that the end of project impact evaluation has some good base line information available. This assignment has helped Sampark internally develop skills to plan credit project as an individual project and also find out business plan for the viability of credit project. These inputs would be later transferred to Koppal field credit project, which we have started with the relationship of TBF.

2000

Sampark has completed midterm evaluation of Credit Project, CARE, Bihar. The objective of this midterm evaluation was to ascertain the progress of the CREDIT project, Ranchi, against its objectives. Participatory evaluation methods were used to analyse the progress of repayment rates, loan size, and distribution of PRADAN and NBJK, NGOs involved in implementing the Credit project. An assessment was made of progress on track, and recommendations provided to enable mid-course correction. This evaluation document has been accepted by Virtual Library on Micro Credit (VLM) for publication on the Internet.

Sampark has completed midterm evaluation of Credit Project, CARE, Bihar. The objective of this midterm evaluation was to ascertain the progress of the CREDIT project, Ranchi, against its objectives. Participatory evaluation methods were used to analyse the progress of repayment rates, loan size, and distribution of PRADAN and NBJK, NGOs involved in implementing the Credit project. An assessment was made of progress on track, and recommendations provided to enable mid-course correction. This evaluation document has been accepted by Virtual Library on Micro Credit (VLM) for publication on the Internet.

1999

Sampark has completed an assessment of Dairy Cooperative Leadership Programme (WDCLP) in Malabar and Valsad Milk Unions. The participatory evaluation methods analysed degree of awareness, perception and attitudes/opinions towards the objectives of the pilot project. The National Dairy Development, Anand had sought for Sampark’s services in evaluating the Dairy Cooperatives. Annual Report of Sarnpark for the year 1998 – 99 10 C. An Evaluation of an NGO (Parivarthana) implementing project in Hunsur Sampark has also completed an evaluation ofNGO named Parivarthana on request from Christian Aid who is funding Parivarthana to implement the project on Environment Education and Action, and Women’s Development in Hunsur Taluk. The participatory evaluation methods were able to identify the extent to which the original objectives have been achieved and measures to sustain the impact of intervention. The staff of Parivarthana have benefited in getting a feedback in order to implement the project more effectively.

1998

Sampark has completed a participatory review of the 13 year old integrated rural development project at Madakasira, a project initiated by MYRADA. The participatory evaluation methods analysed the outcome of the projects programs under the dimensions of productivity, equity and sustainability.

1994

An evaluation of an NGO, Deeds, Tamil Nadu, was taken up at the instance of HIVOS. The activities of the NGO were examined with a view to recommending the utilization of assistance provided for income generating activities, and recommendations for future assistance.