Question Text:
Which step of the research process would you say there was the biggest change in objectives/the conceptual framework?
Answer Categories:
Analyzing the data
Presenting the results at conferences
Writing up the results
Publishing the paper (i.e., through peer review)
Other
Recommendations:
We recommend adding another response option, such as “Discussing the results with coauthors or peers,” to capture this context.
Category-Selection Probing, Specific Probing, Sensitivity Probing, General Probing
Findings for Question:
Information on the aim and purpose of the test:
Question 11 is also asked only of those respondents who indicated in Question 8 that they had deviated in any way from their original research objectives or research questions. The question is intended to determine at what point in the research process the most significant changes to the research objectives occurred.
The objectives of the pilot test were to determine whether the list of response options was complete and whether the participants found the question to be sensitive.
Findings:
Question 11 was asked of seven test persons, all of whom were able to answer it. Their reasons for choosing a particular answer option were consistent with the option they selected.
- “For me, the option ‘Analyzing the data’ makes sense. Of the options provided, that would be the only correct answer.” (TP08)
- “I wavered between ‘Analyzing the data’ and ‘Writing up the results,’ but then I remembered that I had started analyzing and writing at virtually the same time, and quickly realized that it was going to be complicated and time-consuming. And then I ended up not analyzing some of the data at all. So it wasn’t during the ‘analyzing the data’ phase, but rather while writing, because I limited myself and thought, ‘Maybe I can do the detailed analyses later.’” (TP09)
When asked whether the list of response options was complete, two test persons stated that one or more options could be added.
- “I think an additional option titled ‘In discussion with the co-authors’ would be a good idea.” (TP05)
- “‘Analyzing the data’ is a broad category. It could be broken down into ‘preparing data,’ ‘model specification,’ ‘results,’ ‘creating plots,’ or something like that. Perhaps it could be broken down even further.” (TP08)
When asked whether the list of response options was complete, two test persons stated that one or more options could be added.
- “No, personally, I don’t find that very intimate or sensitive.” (TP04)
- “Actually, I don’t see why one shouldn’t answer that honestly.” (TP05)
Question Topic:
Job and career/ Job situation & professional activity
Construct:
Phase of the major change in research objectives
