Do the test persons have problems understanding or answering the question?
Among the ten test persons, one test person (TP 04) selected the correct answer option "Space heating". Of the remaining nine, eight chose other answer options ("electrical appliances," "water heating") and one indicated that she did not know the answer (TP 02). This test person asked what kind of household she should think of: "This is talking about a general private household, isn't it? [...] I just don't know, I don't know. I can only speak for myself and our family household due to this."
Apart from test person 02, two other test persons expressed uncertainty about the question or an answer when asked. None of them selected the correct answer option (TP 03, 10):
In the absence of concrete knowledge, four test persons thought of their own households when answering the question and inferred the general public:
None of the ten test persons had difficulty understanding the question.
How sure are the test persons that their answer is correct?
As Table N2_F8 shows, more than half of the test persons (n = 6) were "rather" or "very uncertain" about the correctness of their answer (TP 01, 03, 04, 05, 06, 08). In contrast, three test persons rated their answer as "very" or "rather certain" (TP 07, 09, 10), although none of these test persons selected the correct answer. Test person 02, who had not selected a substantial answer ("Don't know"), was not asked for her assessment.
Probing question | Test persons (n) |
---|---|
very certain | 1 |
rather certain | 2 |
rather uncertainr | 5 |
very uncertain | 1 |
not specified | 1 |
How difficult (for the general public) do the test persons think the question is?
The Confidence Rating was again followed by Specific Probing, which asked for an estimate of the difficulty of the question in a "real" survey (see Table N3_F8). The majority of test persons (n = 6) estimated that at least half of the respondents would know the correct answer in the later survey (>= 50%). In contrast to questions 7 and 9, no consistent pattern emerged here, with which the test persons inferred from their personal certainty estimation to the general public.
Test person no. | Percentages | Safety assessment |
---|---|---|
TP 01 | 65% | Rather uncertain |
TP 02 | 60% | - |
TP 03 | 40% | Very uncertain |
TP 04 | 60% | Rather uncertain |
TP 05 | 30% | Rather uncertainr |
TP 06 | 50% | Rather uncertain |
TP 07 | 20% | Rather certain |
TP 08 | 50% | Rather uncertain |
TP 09 | 50% | Very certain |
TP 10 | 40% | Rather certain |