When designing a questionnaire, it
is important to remember that the information collected will
need to be processed and analysed
when it is completed and returned. The following need to be
taken into consideration:
- In most cases,
the information contained in the questionnaire will need to
be entered into a computer package which allows it to be
analysed.
- Commonly used
packages include Excel, Access, SPSS, SAS, and SNAP.
- Some of these
packages are simple to use, but have limitations in terms of
statistical analysis unless you can use more complicated
programming.
- Many
statisticians use SPSS or SAS.
- Before the
questionnaire is entered into the package, it will need a
data template designing so that each questionnaire is
entered in the same way. Also, a coding frame will need to
be developed which gives the rules for data entry.
- During the
design of the questionnaire, the processing and analysis
need to be considered, to help them run more smoothly.
- There
are different ways of assisting this process, depending on
the data collection method
(telephone/face-to-face/web-based/postal).
How to Avoid Common Problems
There are many issues in the
design and administration of questionnaires which can be
avoided. Some of the common problems and their solutions are
given below.
Use ID Numbers
Each questionnaire is given an ID
number so that it can be easily identified and filed. It is
helpful to leave a place on the questionnaire so that this can
be added in the same place for each questionnaire.
Format of the Data and Data
Validation
Some packages require the format
to be pre-set e.g. Access, SPSS, although others allow us to
enter data without setting the format - e.g. Excel. For example
the data may be:
- Date
- Numeric
- Alphabetic
- Alphanumeric
- Large amounts of text
It is also possible to set
‘validation’ on some packages – this means that the package only
allows data is within the correct range (for example, that an
answer to a question is either 1, 2, or 3, and not allowing any
other answer to be input). Setting the format can therefore
assist us in reducing data entry error and keeping data
consistent. However,iIf validation is set on certain variables,
it must allow for missing or data, or incorrect responses. Care
should also be taken with some packages - for example if numeric
data is entered as text and sorted in SPSS, it will sort as
1,100,2,200 - giving us real problems with analysis. Show Codes on the
Questionnaire
Each question on the
questionnaire will need a code for each possible response, and
where possible this should be shown on the questionnaire
particularly for telephone/face-to-face/internet questionnaires.
However, for postal questionnaires it can be distracting for the
respondent and so codes should be shown in a small font if used.
An example is given below.
|
|
Example of telephone or
face-to-face question with coding
Q1:
Which of these age bands do you fall
into?
Interviewer - Please circle:
| 18 - 24 |
1 |
| 25 - 34 |
2 |
| 35 - 44 |
3 |
| 45 - 54 |
4 |
| 55 - 64 |
5 |
| 65 + |
6 |
Example of postal
questionnaire with coding
Q1:
Which of these age bands do you fall
into?
Interviewer - Please circle:
| 18 - 24 |
|
1 |
| 25 - 34 |
|
2 |
| 35 - 44 |
|
3 |
| 45 - 54 |
|
4 |
| 55 - 64 |
|
5 |
| 65 + |
|
6 |
|
Be consistent with the use of codes
Codes should be consistent in all questions for example Yes=1,
No=2, Dont know=3. This is particularly important when using
scales for example if 1= very satisfied & 5 = very
dissatisfied for one question it should be the same for all
questions about satisfaction where this is appropriate.
Leave space for coding open questions on the questionnaire
Space for coding should be left on the questionnaire for open
questions in case these questions need to be post-coded (see
survey dictionary).
Take care with administration
When administering a questionnaire, for example when posting out
questionnaires, care must be taken so that:
- In large questionnaires all pages are included and are
in the right order some printing processes make this
possible so it is useful to check a percentage of
questionnaires to ensure that they are correct.
- All documents are included in any mailouts for
example, ensuring that both the letter, any accompanying
documentation, the questionnaire and a reply paid envelope
are included in the pack
Check returned questionnaires
particularly on self completion questionnaires - include
questions being completed incorrectly, being missed (either
accidentally or deliberately), or not following routing
properly. Where possible, either the interviewer can check the
missing or incorrect information, or the respondent can be asked
directly if this is possible. If it is not possible to correct
the missing information, the coding frame should include
instructions of how to handle these types of problems. |