Question Text:
What were the reasons for this decision?
Instruction:
Answer Categories:
I think the results would not be published in a peer-reviewed journal or edited book.
The results missed statistical significance.
There were mainly null results.
The effect sizes were too small.
The results were not interesting.
The results were in the opposite direction as expected.
The expectations were not supported.
The results were inconclusive.
The replication failed.
The measurement instrument(s)/survey questions/experiment did not behave as expected.
Other
Recommendations:
The results of the pretest indicate that there are no issues with Question 21, so it can be left in its current form. Question 22 was not answered by any test taker, so no assessment can be made due to a lack of information regarding the test takers’ understanding of the question.
Process Probing, Specific Probing, General Probing
Findings for Question:
Information on the purpose and objective of the test:
Questions 21 and 22 are directed at respondents who indicated in Question 3 that they had not yet produced a final version of a manuscript. Question 21 asks about the reasons for this. Respondents who select the response option “I analyzed the data and planned to report the results but decided not to due to the nature of the results” in Question 21 are then presented with Question 22, which asks about the nature of the results of the data analysis.
The purpose of the test was to determine whether the lists of response options are complete or whether additional reasons should be included.
Findings:
All ten participants indicated during the cognitive interview that there was a study or project for which they had not yet produced a final version of a manuscript. Consequently, all participants were presented with Question 21. However, no participant selected the response option “I analyzed the data…,” so Question 22 was skipped by all participants.
When asked, all test persons stated that the list of response options in Question 21 was complete. Four test persons used the “Other” category to indicate that work on finalizing the manuscript was still in progress.
Question Topic:
Job and career/ Job situation & professional activity
Construct:
Reasons for the absence of a final manuscript
