Slide
1 Data collection
methods, user needs and developing survey instruments
Ken Black
Slide
2 Data collection
methods
- Three main sources of
information on disability:
- Administrative
data
- Population Censuses
- Sample surveys
- including disability modules or
- full disability survey
- Each method has relative
strengths and weaknesses and suit some purposes
better than others
Slide
3 Population
Censuses
- Most countries have 10
yearly censuses of population and housing
to collect basic demographic statistics of
their population
- The UN provides guidelines
for the conduct of population censuses, including
suggested content and methods
- Disability is suggested
as one of the topics to be included in population
censuses
- UN has published a set
of guidelines on the collection of disability
information - Guidelines and Principles for
the Development of Disability Statistics,
2001
Slide
4 Population Censuses
- Collection of disability
information in population censuses has advantages
and disadvantages compared with other methods
| Advantages |
Disadvantages |
| * Provides data for small, local areas |
* Limited space on census forms limits
detail of questions possible |
| * Provides data for rare populations |
* Usually infrequent |
| * Detailed cross-tabulations of data usually
possible |
* High non-response and under enumeration
because of census methods |
| * Can provide the population for follow-up
surveys |
* Costly |
| * Uses existing statistical program to
collect disability data |
|
Slide
5 Sample Surveys
- Can be either dedicated
disability collections or disability modules
in other population surveys
- Are used to produce population
estimates from information collected from
a sample of the population
- Can collect much more
extensive information on disability compared
with censuse
Slide
6 Sample surveys
| Advantages |
Disadvantages |
| * Disability information can be very detailed |
* Large sample errors on small estimates
and prevalence rates |
| * Can produce higher quality data than
censuses through detailed questions and
use of interviewers |
* Small area statistics limited |
| * Can provide useful time use data |
* Surveys often exclude parts of the population,
such as institutionalised persons |
| * Can include a wide range of other statistics
to help in understanding the nature and
context of disability |
|
Slide
7 Combination
of methods
- A combination of survey,
census collections and administrative data
can provide the most extensive set of information
about disability
- Best when information
from different sources is relatable though
use of the same or relatable concepts and
definitions
Slide
8 Discussion
point
Are countries in the region planning to:
- include disability items
in their next census
- include disability modules
in other social surveys, or
- conduct specific disability
surveys?
Or a combination of these?
Slide
9 Needs for disability
information
Slide
10 Consultation
on information needs
- It is important to develop
surveys in conjunction with key users of the
statistics and people with disabilities
- ABS does this by convening
Advisory Groups
- The most important role
of the Advisory Group is to advise the ABS
on information need
- Identify and document
broad issues, as well as fine level details
- Identify and document
the key policy issues that will be informed
by the survey data
- Where there are
competing needs for information, sometimes
need to compromise to ensure achievement
of the highest priority information needs
Slide
11 Issues to
be considered by the Advisory Group
- In order to define the
survey objectives and output, the Advisory
Group should consider:
- What is the population
of interest?
- What data items
are important?
- Why is the information
needed?
- Who is going to
use the information?
- What will it be
used for?
- What are the key
policy questions the information is required
to inform?
- What is the desired
accuracy? Of what data items?
- How often is the
information needed?
- Is the need for
a once off, or regular collection?
Slide
11 Membership
of Advisory Group
- The group has a broad
representation of key clients including:
- Government (at
all levels)
- Peak bodies and
advocacy groups
- People with disabilities
- Academics and researchers
- Each of these types of
key clients are likely to have different needs
and understanding of people with disabilities
Slide
13 Role and meetings
- The role of the advisory
group is not limited to advising on the most
important data needs. The group can also advise
on:
- the testing of
survey instruments, including suggesting
people to be involved in the testing process
- the content of
survey outputs
- data analysis priorities
- The group should meet
regularly over the survey cycle to:
- provide input as
required
- understand the survey
data and
- promote the survey
results
Slide
14 Discussion
point
How does the Australian Survey of Disability,
Ageing and Carers Advisory Group operate?
Relationship with other groups such as the
Census Advisory Group on Disability and the
Advisory Committee on Australian and International
Disability Data?
Slide
15 Developing
disability surveys
Slide
16 Survey Cycle
Slide
17 Overview
of survey stages and costs
| Component |
Proportion of total costs |
| Survey content development and infrastructure
establishment |
30% |
| Collection and field management |
41% |
| Collection and data capture of establishments
component |
4% |
| Output processing and weighting |
7% |
| Output validation, weighting , publication
and Confidentialised Unit Record File production |
18% |
| Total |
100% |
Slide
17 Overview of
survey development process - Key steps
Client liaison
- Identify user needs
- Prioritise competing
needs
Planning
- Identify the key population
and sub-populations of interest, including
conceptualisation and definition of disability
- Decide survey content,
including domains of ICF to attempt to include
in collection
- Consider scope and coverage
issues
- Budget issues
- Timetable issues
- Detailed planning of
staffing, including interviewers
- Determine mode of data
collection, eg, face to face or telephone
interview
Slide
19 Overview of
survey development process
Key steps (continued):
Survey development
- Individual question design
including response categories
- Sequencing and flow of
the survey instrument
- Testing and validation
Sample design
- Determine sample size
to achieve estimates of desired accuracy (sampling
error) or sample that can be achieved with
fixed budget
- Sample frame
- area
- list
- combination of
both
Slide
20 Scope and
coverage
- Who is to be included
in the collection?
- adults
- children?
- older people?
- carers?
Issues
- Does the information
required for each of the population groups
differ?
- Consider separate
questionnaire or components within the questionnaire?
Slide
21 Scope and
coverage (continued)
- What types of dwellings/accommodation
to include?
- private dwellings
- special dwellings,
such as hotels, motels, camping grounds
and hospitals
- institutionalised
accommodation, such as hostels, group
homes, institutions
Issues
- cost of including/excluding
types of accommodation
- bias of excluding
types of accommodation
- Geographic areas
- Any limitations
on the geographic areas to include in
the collection?
|
