Information on the introduction and purpose of the test:
The questionnaire began with an introduction that defined what was meant by “sports” in the following text. The purpose of the test was to determine whether the respondents found this introductory text understandable.
Findings:
Nearly all participants (97%) rated the introductory text as “somewhat” or “very” understandable. The few respondents who rated it as less understandable criticized its length or complexity in particular.
One test participant also noted critically that cycling to work was not considered a sport in the survey.
“Why isn’t cycling to work considered a sporting activity? Of course, the aspects of competition and fun/enjoyment are relatively minor, but it’s still a sporting activity and a meaningful one in terms of health and fitness. I’ve cycled roughly 20,000 kilometers over the course of my working life. Figures like these shouldn’t be excluded from a survey on the topic of sports.” (TP455)
Information on the question and purpose of the test:
Question 1 asks how many hours per week respondents engage in sports. Respondents are asked to report the average duration over the past three months, as this question is to be repeated several times a year in the RKI “Health in Germany” panel survey.
The aim of the pilot test was to examine whether respondents took into account the definition of physical activity provided in the introduction when answering the question and how they calculated the weekly time spent on physical activity. In addition, the test examined whether respondents referred to the past three months as intended and whether they encountered any difficulties in answering the question.
Findings:
All participants answered Question 1. In accordance with the predefined quotas (see Chapter 2, “Sample”), just under half of the respondents (49.5%) reported engaging in physical activity for no more than one hour per week, while the remaining respondents reported being physically active for at least one hour or more per week (see Table 3).
Do the respondents take into account the definition of sports provided in the introduction when answering the question?
Participants who reported exercising regularly (Question 1 ≠ “not at all,” n = 402) were asked a follow-up question (N1_F1, see Appendix) about which sports they had in mind when answering the question. In total, the participants provided 601 responses. Table 4 shows the proportion of these responses attributed to various sports categories and also includes examples of the sports mentioned.
In 98% of the responses, participants reported sports that fit the definition of “sport” provided in the introduction. In the remaining 2% of responses, however, activities were mentioned that do not clearly fall under this definition, including going for a walk (n = 11), walking the dog (n = 2), and chopping wood (n = 1).
The participants were also asked one or more follow-up questions (N5_F1 through N7_F1) about whether they ride a bicycle to work and, if so, whether they had included those times in their response to Question 1. Since this form of physical activity is explicitly not defined in the introduction as “sports” as used in the questionnaire, respondents were instructed not to include it in their responses.
A total of eleven participants (3%) reported cycling to work and having included this time in their response to Question 1. Five of these participants stated that they cycled intensely enough to break a sweat and become out of breath, while the rest said they did not. The one-way distance that respondents cycled to work ranged from 1 km to 20 km, with a mean of M = 6.3 km (SD = 5.8).
Overall, the results suggest that the definition of “sport” provided in the introduction was generally understood correctly, but in some cases was interpreted differently, or some respondents found it difficult to adhere to the specified definition. This is particularly true when they are regularly physically active on their commute and perceive this activity as “sport.”
How do the participants determine the weekly duration of their physical activity? Do they take the 3-month reference period into account?
The participants who reported exercising regularly (Question 1 ≠ “not at all,” n = 402) were also asked how they went about answering the question (N2_F1). Just under half of the respondents (45%) stated that they had reported the duration of their exercise for a normal or typical week. One-third (33%) reported that they had estimated the average over the past three months.
Only 11% of the participants stated that they had tried to calculate the average for the past three months precisely. Another 11% reported that they had assumed a typical week and adjusted this value up or down because they had engaged in more or less physical activity than usual over the past three months.
These results show that only slightly more than half of the respondents took the three-month reference period into account, whereas a significant proportion reported their typical behavior.
Do the respondents have difficulty answering the question?
A total of 38 of the 565 participants (7%) reported that they found answering Question 1 “somewhat difficult” (n = 34) or “very difficult” (n = 4). The difficulties cited were primarily attributed to the fact that the duration of physical activity varied from week to week or that the past three months were not representative of their usual exercise habits (39%). Other respondents cited emotional reasons, such as shame or a guilty conscience due to low levels of physical activity (29%), or explained that they had found it difficult to calculate the duration of their physical activity precisely (25%).
In a few cases, respondents also pointed out that it was difficult to draw a line between sports and everyday physical activity, and that there was uncertainty about whether physical activity during the commute to work should be included.