Development Research Methods: Surveys and Experiments

Module description

This module will explore the latest tools for designing, running and analysing randomised field experiments or survey-based projects and impact evaluations that are now a central part of the development economics toolkit.

The content of this module will be suitable for research-oriented students, and for those who are interested in work with development organizations or other fields where evaluating social programs is important. This content is recommended for interdisciplinary pathways and will be of use to all students with the necessary econometric tools who are interested in running field experiments and designing or analysing survey-based projects. The examples in this course will be drawn from Development Economics, but the content will be applicable to other fields of empirical microeconomics.

This module will require one module of econometrics (one of: BEEM011, BEEM102, BEEM113, BEEM139) in order to understand the empirical methods used in this module, and to understand the challenges our tools are designed to overcome.

Full module specification

Module title:	Development Research Methods: Surveys and Experiments
Module code:	BEEM160
Module level:	M
Academic year:	2022/3
Module lecturers:	Mr Julian Dyer - Convenor
Module credit:	15
ECTS value:	7.5
Pre-requisites:	One of: BEEM011, BEEM102, BEEM113, BEEM139
Co-requisites:	None
Duration of module:	Duration (weeks) - term 2: 11

Module aims

The intention of this module is to provide students with the fundamental tools used in field experiments and survey design, as well as econometric tools for analysis of survey data and experimental results. You will learn the theory behind these tools as well as how to apply these tools in practice.

We will then cover examples of recent papers and use these to learn about ways of measuring different types of outcomes, as well how surveys and field projects can be combined with economic theory to answer questions rigorously and in a generalizable way. This will be enriched by looking at the cutting-edge tools being used in recent economics papers. Students may have covered these papers in other modules on development economics, but here we will be focusing not on what the researchers found, but on how they found it. We will focus on the design of these research project and the way key outcomes were measured to build your research toolkit. This will include experimental and non-experimental papers.

This module will provide students with an opportunity to explore their own interests by designing a potential research project as their major piece of coursework. This will be an opportunity for students to enrich their learning by engaging with their own creative research ideas. A written exam will be used to assess mastery of the fundamentals. Students will also prepare a brief presentation for tutorial where they will critically evaluate the methodology used in an academic journal article.

ILO: Module-specific skills

1. Explain how key outcomes were measured in seminal and cutting-edge papers in different fields
2. Evaluate the design of experimental interventions to answer a research question.

ILO: Discipline-specific skills

3. Apply the key methods and core concepts of sampling design and survey design
4. Apply econometric methods to analyse survey data and experimental results
5. Evaluate threats to validity of a randomised experiment.
6. Propose and design an experiment to answer a research question

ILO: Personal and key skills

7. Evaluate the effectiveness of a given research design.
8. Present of academic material and critical evaluation of methods.

Learning activities and teaching methods (given in hours of study time)

Scheduled Learning and Teaching Activities	Guided independent study	Placement / study abroad
27	123	0

Details of learning activities and teaching methods

Category	Hours of study time	Description
Scheduled learning and teaching activities	22 (11 x 2 hours)	Lectures: In these lectures I will present the main concepts and methods we use, as well derivations of the results to ensure students understand them in depth. These concepts and methods will be linked to their applications in the design and implementation of surveys & field experiments.
Scheduled learning and teaching activities	5 (5 x 1 hour)	Tutorials: In these tutorials we will review problem sets related to the core concepts. Students will also provide brief presentations of journal articles to highlight the particular methods used and link these to lecture material.
Guided Independent Study	123 hours	This independent study time will be split between background reading and reviewing lecture material (approx 50 hrs.) working on their proposed research design (approx. 30hrs) as well as their tutorial presentation (approx. 5hrs) and as reviewing for the exam (approx. 38hrs).

Formative assessment

Form of assessment	Size of the assessment (eg length / duration)	ILOs assessed	Feedback method
Problem sets to be covered in tutorial, as well as presentation of academic journal articles.	1 hour	1,3,4,5,7,8	Verbal
Proposal for research design	1 page	2,6,7,8	Written

Summative assessment (% of credit)

Coursework	Written exams	Practical exams
70	30	0

Details of summative assessment

Form of assessment	% of credit	Size of the assessment (eg length / duration)	ILOs assessed	Feedback method
Design of research project	70	2000 words	2,5,6,7,8	Wriiten
Final exam	30	1.5 hours	1,3,4	Wriiten
	0
	0
	0
	0

Details of re-assessment (where required by referral or deferral)

Original form of assessment	Form of re-assessment	ILOs re-assessed	Timescale for re-assessment
Design of research project	Design of research project (same as original)	2,5,6,7,8	August re-assessment period
Final exam	Final exam (same as original)	1,3,4	August re-assessment period

Syllabus plan

Part 1: Methods

Data Collection: e.g. Sampling Strategies and Power Calculations
Tools for Survey Analysis: e.g. Using sampling weights, quantile regression, etc.
Econometrics of why and how to randomize an experiment: e.g: Identifying causal effects, randomization strategies, clustered randomization, adaptive randomization, etc.
Threats to validity: e.g Noncompliance, etc.
Analysis of Experiments: e.g Multiple Hypothesis Testing, Randomization inference, etc.

Part 2: Measurement & Survey Design

Core Tools and Concepts for Survey Design
Outcomes for Political Economy & Culture: e.g voting behaviour, corruption, ethnic bias, etc.
Outcomes for Agriculture: e.g output, productivity, etc.
Outcomes for Health: Biometric & behavioural measures
Outcomes for Entrepreneurs & Small Enterprises:
Outcomes in Education: Test scores & intermediate measures
Outcomes in Gender and Economics of the Family:

Part 3: Management

Research Ethics and Transparency

Indicative learning resources - Basic reading

The following textbooks are good background, and specific chapters/sections of interest will be assigned during the module.

Deaton, Angus. (1997). The analysis of household surveys: a microeconometric approach to development policy. Baltimore, MD: Published for the World Bank [by] Johns Hopkins University Press
Banerjee, Abhijit & Duflo, Esther. (Eds). (2017). Handbook of Field Experiments, Volume 1. Amsterdam, Netherlands: North Holland
Iarossi, Giuseppe. (2006). The Power of Survey Design A User's Guide for Managing Surveys, Interpreting Results, and Influencing Respondents (First Edition). Washington, D.C.: The World Bank.
Glennerster, R., & Takavarasha, K. (2013). Running randomized evaluations: A practical guide. Princeton University Press.

We will also refer to academic journal articles in lectures, which will be accessible to students online.

Module has an active ELE page?

Yes

Origin date

25/04/2022

Last revision date

28/01/2022