This report by the independent Monitoring, Evaluation and Learning (MEL) component of the Rural Access Programme 3 (RAP3) presents a review of the current maintenance planning approaches used in the Local Roads Network (LRN) sector in Nepal. The review aims to shed light on differences and commonalities across stakeholders, with a particular focus on shedding light on how these systems could be adapted within the changed political and governance context in Nepal where there has been major governance restructuring and devolution of power towards a federal system. This review does not aim to provide direct solutions on how maintenance planning should be configured in the new federal setup. Instead it provides a timely and strategic input in order to inform future thinking by providing an overview of the problem and challenges and opportunities arising from this.

 

View more      Download this document

This report presents findings from the second of two rounds of verification in 2017 of RAP3 reported results. The verification exercise was undertaken by RAP3’s independent MEL component. It was conducted between July-August 2017. The objective of the Verification Round 2 assignment was to independently verify RAP3’s reported results against one significant Disbursement Linked Indicator (DLI) - employment days. Resulted were verified over the period of one year: July 2016 to June 2017 in the four construction districts (Bajura, Humla, Kalikot and Mugu) which collectively generate the most employment days outputs across RAP3.

View more      Download this document

This report presents the findings of the 2017 Beneficiary Feedback process conducted by the independent Monitoring, Evaluation and Learning (MEL) component of RAP3. This process set out to capture feedback from the direct and indirect beneficiaries of RAP. The majority of the feedback comes from the direct beneficiaries of RAP – the members of the Road Building Groups (RBGs) and Road Maintenance Groups (RMGs) who receive cash for working and participating in the roads work implemented by the project. This feedback comes from a mixture of surveys and shorter case studies. Feedback also comes from the indirect beneficiaries of RAP – these are the users of the roads in the maintenance districts (as roads are not yet complete in the build districts).

 

View more      Download this document

This briefing note presents some of the main lessons emerging from the independent midline impact assessment of RAP as it relates to the direct beneficiaries – members of RBGs and RMGs. This was conducted by the independent Monitoring, Evaluation and Learning (MEL) component of RAP, responsible for evaluating the project over its lifecycle.

View more      Download this document

This report presents findings from the first of two rounds of verification in 2017 of RAP reported results. The verification exercise was undertaken by RAP’s independent MEL component. It was conducted between February and March of 2017.

View more      Download this document

This Midline report presents the findings from a panel survey of 3,600 households in eight districts in the Mid and Far West of Nepal and incorporates qualitative findings from a complementary Reality Check Approach (RCA) study.

View more      Download this document

This report presents the main findings of the Midline Reality Check Approach (RCA) study conducted in April 2016, two years after the baseline study was conducted in 2014. The RCA is the main qualitative element of the mixed methods approach to impact assessment, which also includes a quantitative household survey. The findings are presented in terms of how people living in communities in the project areas see change and how they generally perceive the relevance of the RAP interventions. This report is a companion piece to the main Midline Impact Assessment Report of RAP and should be read in conjunction with that report to illustrate findings for deeper learning.

View more      Download this document

This report presents the findings of a beneficiary feedback process conducted by the MEL. This process set out to capture feedback directly from RAP beneficiaries employed in the Road Building Groups (RBGs) and Road Maintenance Groups (RMGs) only. The process enabled beneficiaries to provide their thoughts on the experience of working on RAP, the benefits accrued, and satisfaction with RAP processes. As such it is not an assessment of impact, but a forum to enable voices of beneficiaries to be heard about RAP processes.

View more      Download this document

The 2016 review is a critical examination of the RAP3 theory of change conducted in consultation with stakeholders to reflect and review the programme from a holistic perspective. The review looked at a number of studies and learning from the programme and MEL over the last three years. In light of the significant learnings and the three-year extension of the RAP-3 programme to 2019, the review comes at a key time. This document brings together critical insights and thoughts from each of the core RAP3 components and DFID to provide a revised theory of change.

View more      Download this document

The MEL-led independent verification of RAP3 has been initiated following recommendations from the 2015 DFID Annual Review. Funding of the contract between DFID and the implementing organisation for RAP3 is almost fully based on payment by results (PbR). Payments are based on disbursement linked indicators (DLIs), which relate to RAP3 results. The role of MEL in verification is to verify the DLIs reported on by RAP3 to DFID. This report presents findings from the verification conducted in June-July, looking at the last trimester of results.

View more      Download this document

The Value for Money (VFM) analysis of RAP is one-off review assessing what is driving costs and to ensure that the programme is providing the desired quality at the lowest price. The analysis aims to enable a variety of stakeholders, including DoLIDAR and DFID, to better understand the VfM of approaches to rural road development and thereby facilitate dialogue and learning to develop a VFM framework that can better capture the cost drivers across the 3 E’s of economy, efficiency and effectiveness.

View more      Download this document

The PMV Review Report is a MEL-led independent review of the existing Performance Management and Verification (PMV) system of RAP. The PMV system is RAP’s internal M&E system used to collect, aggregate and report data related to completed activities from the district to the central level. It is used to report results to DFID as well as drive performance management within RAP. The main objective of the report is to assess if RAP’s PMV is fit for purpose. The review examined existing RAP polices, systems and processes, identified strengths and areas for improvement and provided recommendations for addressing the more significant areas of improvement.

View more      Download this document

This learning note is a summary note of DFID-Nepal’s Rural Access Programme 3 (RAP3). It re-examines the original theory of change of the project. It asks if RAP is doing what it does well and re-contextualises the project within the wider development policy landscape in Nepal. This asks further questions that underpin broader Value for Money (VfM) considerations of the design of the programme with important policy implications.

View more      Download this document

This report reviews the implementation of the Local Roads Network (LRN) component of RAP. The objectives of the LRN review were to: a) develop a quantitative analysis of RAP3 LRN; b) assess the effectiveness of current RAP3 LRN approaches in a sample of RAP 3 districts in delivering results and value for money; c) develop recommendations on the future effective delivery of the RAP LRN component.

View more      Download this document

This Reality Check Approach (RCA) Study complements a ‘baseline’ RCA that was undertaken for RAP in May 2014 and constitutes a ‘one-off’ thematic study. The RCA study focused on RAP beneficiaries and their communities. RCA is an internationally recognised form of qualitative research that requires the study team to live with people living in poverty in their own homes for periods of time.

View more      Download this document

This report summarises the findings arising from an institutional review of the Department of Local Infrastructure Development and Agricultural Roads (DoLIDAR)'s Monitoring and Evaluation Unit.

View more      Download this document

This document presents a proposal for the second phase of RAP MEL’s implementation phase covering the period August 2015 to August 2016. During recent months, discussions with DFID, DoLIDAR and RAP have highlighted the need to adjust MEL’s activities, deliverables, and working model to respond to the lessons learned from the first phase of implementation (June 2014 to July 2015) and to ensure that MEL’s work remains relevant to the emerging needs of MEL’s stakeholders.

View more      Download this document

This note summarises Process Monitoring Reports conducted by the Monitoring, Evaluation and Learning (MEL) component of DFID-Nepal’s Rural Access Programme 3 (RAP3). The summary looks at beneficiaries of RAP’s socioeconomic development (SED) activities in the core districts of Kalikot, Accham, Bajura, Humla, Dailkeh and Jumla. A particular area of focus was analysing how poor and disadvantaged group (DAG) members were impacted by the SED activities and the associated constraints. This exercise was conducted during the implementation of the original SED model implemented by RAP. Since late 2015, the SED model has been revised significantly, hence the learnings from this briefing note only reflects issues arising from the original SED model implemented between 1st November 2013 and 31st January 2016.

View more      Download this document

This note summarises Process Monitoring Reports conducted by the Monitoring, Evaluation and Learning (MEL) component of DFID-Nepal’s Rural Access Programme 3 (RAP3). The summary looks at migration and its linkages with the household economy among RAP beneficiaries in Dailkeh, Doti, Kalikot and Jumla. Migration is hugely significant throughout Nepal and the mid and far western districts are no exception. Migration from western areas to the Terai or India (and indeed within these Districts with mountain dwellers moving to the mid hills in winter) has been a regular seasonal choice for thousands of households for generations. The government and other development actors have implemented a number of public wage and social protection programmes to provide seasonal employment opportunities to help people in the mid and far west to cope with livelihood shocks and to address some of the consequences of distress migration. This exercise was conducted during the implementation of the original SED model implemented by RAP. Since late 2015, the SED model has been revised significantly, hence the learnings from this briefing note only reflects issues arising from the original SED model implemented between 1st Novemeber 2013 and 31st January 2016.

View more      Download this document

This note summarises Process Monitoring Reports conducted by the Monitoring, Evaluation and Learning (MEL) component of DFID-Nepal’s Rural Access Programme 3 (RAP3). The summary looks at the Karnali Employment Programme Technical Assistance (KEPTA) project in Kalikot and Jumla. This exercise was conducted during the implementation of the original SED model implemented by RAP. Since late 2015, the SED model has been revised significantly, hence the learnings from this briefing note only reflects issues arising from the original SED model implemented between 1st November 2013 and 31st January 2016.

View more      Download this document