CANARI’s Monitoring and Evaluation Strategy is being applied to CANARI’s work at various levels:

  • Strategic: Overall targeted results in the Strategic Plan 2011-2016 were set. CANARI is also in the process of developing a database to track key indicators across CANARI’s programmes (e.g. number of persons trained, number of communities engaged, livelihood changes). The Strategy will be used to guide the process for a mid-term evaluation exercise planned for 2015.
  • Programme: Programme Plans which include priority areas for work and targeted projects for development. Programme Plans to implement the Strategic Plan 2011-2016 are being developed by teams of Staff, Partners and CANARI Associates. For example, see the Rural Livelihoods Programme Plan which was developed. This was developed with input from community stakeholders and the main donor involved in the programme.
  • Project: Monitoring and evaluation in all of CANARI’s projects is guided by the Strategy. For example, CANARI used participatory video (PV) to evaluate changes in behaviour of communities building capacity in watershed management (see video) and of mentors trained under this project (see video).

The Strategy was applied in a mid-term evaluation of the 5 year, USD 6.9 million CEPF Caribbean Islands Programme. Based on the Strategy, a framework was developed to guide the evaluation of relevance, results, efficiency and effectiveness of the process and sustainability. The evaluation included: a desk review of reports prepared by the RIT and CEPF Secretariat; three national focus group sessions held with grantees, key partners, and RACC members in HaitiJamaica and the Dominican Republic; an online survey; interviews with grantees and members of the Regional Advisory Committee for CEPF (RACC); a regional workshop with grantees, RACC members, donors, government partners, the CEPF Secretariat and the RIT; and a focus group session with RIT staff based in Trinidad. Stakeholders who engaged in the participatory evaluation found the process extremely useful for them to be able to collectively share and analyse ideas and were particularly interested in some of the innovative methodologies used, for example outcome mapping. A summary report of the evaluation is available on the Institute’s website.

The Strategy was also used in an evaluation of CANARI’s Rural Livelihoods programme. The Rural Livelihoods Programme Plan was developed to outline desired results as guided by CANARI’s Strategic Plan 2011-2016. A workshop was held with members of target groups identified in the plan who were currently involved in projects under the programme. Participants gave rich ideas on what changes in behaviour and relationships were needed in order to achieve sustainable rural livelihoods based on the use of natural resources. These were reflected in refined outcome maps for each target group. A second workshop was held to facilitate a participatory evaluation of progress made on achieving these results through projects supported by the J.B. Fernandes Trust. The evaluation was able to identify what results had already been achieved and where more work was needed.

Outcomes:

  • CANARI’s Monitoring and Evaluation Strategy is being effectively used at strategic, programme and project levels to guide the Institute’s planning as well as assessment of what results are being achieved and what lessons are being learnt. It has resulted in a refocusing of CANARI’s work recognising that change occurs as a result of change in the behaviour of people.
  • CSOs who were exposed to the methodology in the CEPF regional workshop, combining logical framework and outcome mapping approaches, have been fascinated and indicated their interest in using these approaches in evaluating their own work.
  • CANARI has analysed and documented lessons learnt from its experimentation with using innovative participatory methodologies for monitoring and evaluation in the Caribbean islands.

CANARI has built its capacity in participatory monitoring and evaluation using innovative methods and can better support CSOs and other stakeholders with this in training and technical assistance it provides.