Planning, Monitoring, Evaluation and Impact Assessment of R&D Investments in Agriculture

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.1

Introduction to the Workshop & PAPA

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.2

Purpose of the Workshop

To build the organizational capacity to plan monitor, evaluate and assess the impact of R&D investments.

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.3

Major Objectives
To build skills and knowledge in the following areas so that you are in a position to apply them in your day-to-day work:
Planning Research evaluation Adoption studies Cost-benefit analysis Impact assessment methods Institutionalization of impact assessment

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.4

Overview of Workshop Framework the vision

Holistic, dynamic, interactive, effective and efficient System
I n n o v a t i o n

Education Research Producer Organizations Local National

Regional

Global

Extension

All working towards innovation.

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.5

Overview of Workshop (contd)

System Level Organizational Level
Strategic Planning

Program Level
Program Planning

Project Level
Project Planning

Goal

Purpose

Goal

Output

Purpose

Goal Purpose Goal Purpose Output

Activity

Resource

Activity
Resource

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.6

Overview of Workshop (contd)

Agricultural Research within Broader Development Goals

GLOBAL GOALS & STRATEGIC MDG, GFAC REGIONAL GOALS & STRATEGIC CAADP, SROs

NATIONAL DEVELOPMENTAL GOALS AND STRATEGY6 SECTORIAL GOALS & STRATEGY

NIS

AIS

AR4D

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.7

Overview of Workshop (contd)

Planning, Monitoring and Evaluation Cycle

Impact Assessment Re-diagnosis & Planning

Monitoring
Diffusion Recommendation Diagnosis Evaluation (Impact) Ex-ante

Planning Evaluation Ex-post Implementation

Monitoring + Ongoing Evaluation

Log frame (Indicators)

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.8

Overview of Workshop
Participatory M&E Utilization-Focused Evaluation Participatory Impact Monitoring Project Cycle Project Approach: B/C Framework Evaluation Research Non-Market Benefits & Cost valuation techniques Methods for Obtaining Estimates Logical Framework & M&E Designing on M&E System Organizational Performance Assessment Institutionalization of IA process & IA Training

APPROACH Lectures Exercises Assigned Reading Group work Plenary Sessions Case Studies

Definition Evaluation Process Content Characteristics Evaluation Types & Activities Overview of Methods

Definition Types Comprehensive Framework Strategies Adoption studies and ROR Estimation Methods & Techniques Case studies & estimating ROR Surplus Approach Econometric Approach Spill-over & IA Environmental & Social Impacts

Expected Outputs
Improved understanding of planning Improved knowledge of impact assessment Increased awareness of the importance of monitoring, evaluation, and impact assessment in R&D programs Ability to participate in evaluation of projects and programs Ability to conduct field-level impact studies
Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.10

Objectives of Day One

1. 2. 3. 4. 5. 6. To discuss background and rationale of the workshop: goals, general objectives, and expected outputs. To explain the use of the participant action plan approach (PAPA). To identify trainees and learning facilitators understand the challenges of R&D Systems; Familiarize with the changing paradigms of the R&D system Identify and understand the key terminologies used in analyzing innovation systems

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.11

Objectives of Day One (cont.)

7. Define planning & Strategic Planning

8.
9.

Describe steps in strategic planning

Explain the various steps and activities involved in program planning

10. Explain the aspects considered in project planning

11. Show that project planning is an integral part of the overall planning process

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.12

Schedule of Day One

08:30 09:00 09:00 10:30 Welcome Session 1. Introduction to the Workshop and PAPA
Tea/Coffee Break

10:45 13:00

Session 2. Changing R&D Paradigm

Lunch

14:00 15:30

Session 3. Types of Planning and M&E

Tea/Coffee Break

15:45 17:15 17:15 17:30

Session 4. Evaluation Research vs Research Evaluation Feedback on the Days Activities

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.13

Participant Action Plan Approach (PAPA) and its relationship with

Experiential Learning Cycle

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.14

Experiential learning cycle

Experience
Application

Process

Generalization
Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.15

Why PAPA?
Systematic and continuous planning of future activities by participants as workshop evolves Formal link between participants and resource persons for follow-up activities Further involvement of participants in improving the learning workshop content after training event

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.16

Uses of PAPA
Assess transfer of skills to workplace
Determine impact of change introduced

Identify problems of implementation

Provide information to improve the workshop content and approach Evaluate the most useful parts/quality of the workshop
Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.17

Steps of PAPA

PAPA

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.18

In-course Activities
Stage 1
Objective:
To understand the use of PAPA To identify possible action ideas to be tried on the job

Procedure:
Jot down action ideas during or at the end of the learning event as they come to your mind Use the handout provided Do it at end of the last session each day Confer with other participants/facilitators periodically
Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.19

In-course Activities
Stage 2
Objective:
to develop an action plan

Procedure:
prepare a preliminary list of action items confer with partner finalize and prioritize list of action item report individual action plans make copies for trainees and facilitators
Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.20

Follow-up Activities
Facilitators
Formulate and send questionnaire Analyze and interpret data Prepare report Improve workshop content and approach if necessary On the basis of information, assess the impact

Participants
Implement the planned
action items

Fill out and return

questionnaire

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.21

PAPA Questionnaire, First Stage

Ideas for action items

Planning, Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture - 1.1.22