Skip to main content

14 March 2022, 14:00 - 15:15 Indochina Time / Bangkok | Open meeting

Stats Cafe_3/2022

Asia-Pacific Stats Café Series on "Survey design: Are we asking what we think we're asking?" was held on Monday, 14 March 2022, 14.00-15.15 hrs., Bangkok time (GMT+7).

Concept note

Despite increased interest in alternative data sources, household surveys remain a vital component of national statistical systems and a key source for producing official statistics. In measuring the progress towards Sustainable Development Goals (SDGs), household surveys are the primary source for one-third of indicators, cutting across 13 out of 17 SDGs. This underpins the importance of implementing strategies to improve the quality of data acquired through surveys. In addition to other design elements, questionnaires play a critical role in communicating statistical ideas to respondents and capturing high-quality data.

Testing statistical concepts and questions used in labour force surveys is one way of ensuring data producers can operationalize statistical standards and produce reliable and accurate data. The ILO uses qualitative testing - cognitive interviews, focus groups, and rapid ethnographic assessments – to enhance the generic labour force survey questionnaire and in development of a light module to measure time use.

This Stats Café shared recent experiences from two projects that had been conducting qualitative tests in India, Peru and Uganda. The session explored:

  • Objectives - which testing methods are useful for survey development and why?
  • Benefits - what comes from these tests and how can the findings be used?>
  • Costs - what kind of skills, time and resources are needed for such testing?

The session should be beneficial for official statisticians who are involved in designing household surveys. Participants engaged in questionnaire adaptation and development with or without recent experience in qualitative testing should find the session informative. Those who have conducted similar testing are encouraged to share their own experiences and lessons learned. Those with no or limited experience will get an insight into what is involved and how testing might support better data production in their country or area of work.

Related publications and links:p

Publications on earlier rounds of qualitative and quantitative testing:

Further information on the methodological work of the ILO:


Welcome by

Rachael Beaven
Rachael Beaven
Director, Statistics Division, ESCAP
Know More

Ms. Beaven has over thirty years of experience in government statistics, in particular data preparation and analysis.  She has also worked extensively with governments, multilateral agencies and the statistical community, most notably through the United Nations Statistics Division, ECA, ESCAP, World Bank and Paris21.

Prior to joining SD, Ms. Beaven led the Data for Development Team at the Foreign, Commonwealth and Development Office of the United Kingdom, where she managed a global portfolio of statistical programmes to build core statistics as well as helped countries modernize their statistical systems.  She was also a leading advocate for financing for data and statistics.

Ms. Beaven has provided a wide range of technical support, from improving economic and financial statistics to estimating local population using geospatial data.  She is one of the founders of the Inclusive Data Charter, launched at the 2018 High-Level Political Forum, to mobilize political commitments and to advance inclusive and disaggregated data.  Ms. Beaven also led a programme on monitoring the Sustainable Development Goals with United Nations Statistics Division and established a data science hub with the Office for National Statistics of the United Kingdom to explore use of data science, in particular geospatial as well as big data, to monitor progress.

Ms. Beaven holds Master’s degrees in Statistical Applications in Business and Government as well as Business Administration, and a Bachelor’s degree in Geography and Geology.

Moderator

Afsaneh Yazdani
Afsaneh Yazdani
Statistician, Statistics Division, ESCAP
Know More

Afsaneh Yazdani is a Statistician at ESCAP Statistics Division, Population and Social Statistics Section. She is currently leading a regional initiative on data integration. Before joining ESCAP in 2018, Afsaneh worked in various capacities at the Statistical Centre of Iran for more than 20 years. Afsaneh has extensive experience in official statistics with a focus on survey methodology, censuses, and register-based statistics.

Speakers

Richard Ssewakiryanga
Richard Ssewakiryanga
Senior Research Fellow and Adviser for Policy Research and Strategic Partnership, Centre for Basic Research (CBR), Uganda
Know More

Richard Ssewakiryanga is a Senior Research Fellow and Adviser for Policy Research and Strategic Partnership at the Center for Basic Research - a leading academic, basic and policy research center in Kampala. Prior to joining the center, he was the Executive Director of the Uganda National NGO Forum - a national platform organization for NGOs in Uganda for 11 years and Executive Director of MS Training Center for Development Cooperation in Arusha, Tanzania.  During 2021, Richard led a local team that worked with the ILO to test labour force survey questions and concepts through 80 cognitive interviews and several focus groups.

Neetha N.
Neetha N.
Professor, Centre for Women’s Development Studies (CWDS), India
Know More

Neetha N is Professor at the Centre for Women’s Development Studies (CWDS), New Delhi. Her work focuses on the analysis of women’s employment, issues of women workers in the informal sector, domestic workers, unpaid care work and labour migration. She was part of the Indian team for the UNIRISD study, Political and Social Economy of Care. She is one of the Lead Authors of the chapter on Pluralising Family of the International Panel on Social Progress Report, 2018.

Jessica Gardner
Jessica Gardner
ILO Labour Statistician
Know More

Jessica joined the ILO in April 2021 to support the review of informality statistics standards through the Engendering Informality Statistics Project – a joint ILO and Bill and Melinda Gates Foundation initiative. She specialises in gender statistics and has worked with many national statistical systems to increase capacity for better data production and its use for action.

Samantha Watson
Samantha Watson
ILO Labour Statistician
Know More
Peter Buwembo
Peter Buwembo
Specialist Labour Statistician, ILO Decent Work Team for South Asia
Know More

A key member of the ILO Global Technical Team in Statistics, Peter provides support to the countries of South Asia to adopt international statistical standards and develop capacity for measuring the world of work. He joined the ILO in 2019 after a long and successful career with Statistics South Africa and is based in the ILO Regional Office in New Delhi.

Conclusion and wrap-up by

Peter Buwembo
Peter Buwembo
Specialist Labour Statistician, ILO Decent Work Team for South Asia
Know More

A key member of the ILO Global Technical Team in Statistics, Peter provides support to the countries of South Asia to adopt international statistical standards and develop capacity for measuring the world of work. He joined the ILO in 2019 after a long and successful career with Statistics South Africa and is based in the ILO Regional Office in New Delhi.

Title Speaker/Presenter PPT
Using qualitative testing for better gender data (part I) Jessica Gardner, Labour Statistician, ILO Department of Statistics PPT
What were they thinking? Using cognitive interviews to test if questions work Richard Ssewakiryanga, Senior Research Fellow and Adviser for Policy Research and Strategic Partnership, Centre for Basic Research (CBR), Uganda PPT
Using qualitative testing for better gender data (part II) Samantha Watson, Labour Statistician, ILO Department of Statistics PPT
What people do, what people say they do”: Bridging the divide with REA Neetha N., Professor, Centre for Women’s Development Studies (CWDS), India PPT

for more information, please contact

Statistics Division +66 2288 1234 [email protected]
Print this page