Information on the aim and purpose of the test:
Question 6 determines whether an experimental design was used in the study and, if so, whether all experimental groups in the study were reported in the research papers. Respondents who answer “no” to Question 6 are then presented with Question 7, which asks why not all experimental groups were included.
The pretest was designed to determine whether the list of response options in Question 7 is complete or whether additional reasons should be included.
Findings:
During the cognitive interview, three participants stated that they had previously analyzed experimental data as part of a research project but had not taken all experimental groups into account. The reasons for this are listed in Table 6 (frequency distribution for Question 7).
All of these participants stated that the list of response options in Question 7 was complete, which was due, among other things, to the inclusion of an open-ended “Other” category (“I think it’s complete, especially since it’s a semi-open-ended question. And it makes perfect sense to ask it as a ‘check all that apply’ question,” TP03).