Testing objectives:
Question 8 was asked for each of the six individuals previously selected in Question 2. The goal of the pretest was, first, to determine whether the participants were willing to answer the question or whether they found it inappropriate. In addition, the study aimed to examine what they were referring to in their answers and how they chose a response option. Finally, the interviews were intended to reveal whether the test persons had difficulty answering the question regarding certain people in their social circle due to a lack of knowledge.
Findings:
As Table 7 shows, there was no item nonresponse, and the participants used the full range of the scale, even though they reported that the majority of people in their social circles had never or only rarely failed to follow the COVID-19 safety measures.
Do the test persons find the question inappropriate in the context of a survey?
All ten participants reported that at least one person in their social circle had disregarded the protective measures at least “rarely.” Furthermore, only one of the ten participants felt it was inappropriate to be asked such a question in a survey. When asked, Test Person 01 stated that they found the question too personal, although they also answered it without hesitation: “Well, it does encroach a bit on privacy. And you can easily discredit someone that way. That’s why I find the question a bit difficult.” (TP01)
How do the test persons explain their answers?
When asked why they had chosen the “never” response option for certain individuals, the test persons mostly replied that, in their opinion, those individuals were particularly health-conscious or that adhering to the rules was important to them:
Regarding individuals who, according to the test persons, had “rarely” failed to follow COVID-19 safety measures, the test persons explained that these individuals had occasionally weighed whether a measure made sense or not:
People who, according to the survey participants, had “sometimes,” “often,” or “very often” failed to follow the protective measures tended to be skeptical of or strongly opposed to the measures:
Do the test persons have difficulty answering the question because they lack knowledge about the behavior of people in their social circle?
Four participants explained that, in the case of certain individuals, they did not know exactly whether or how often those individuals had failed to follow the COVID-19 safety measures, and that they could therefore only provide an estimate. However, all participants did provide such an estimate:
One of the four test persons (TP04) requested an additional response category, such as “I can’t answer that” or “I can’t judge that.”
Do the test persons have difficulty answering the question because of the negative phrasing (“did not follow”)?
Half of the test persons (n = 5) either had difficulty answering the question because of the negative phrasing (“did not follow”) or pointed out that the negative phrasing was confusing and that the question should be rephrased: