GESIS Pretest Database: Documentation Questions Details - Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version)

Question Text:

What are the reasons why you do not plan to submit the paper(s)?

Instruction:

Check all that apply.

Answer Categories:

I think the paper(s) would not be accepted.
The results missed statistical significance.
There were many null results.
There were no interesting results.
The effect sizes were too small.
The results were in the opposite direction as expected.
The results were only correlational.
The results were inconclusive.
The replication failed.
The measurement instrument(s)/survey questions/experiment did not behave as expected.
There was not enough theoretical motivation.
Other
Not applicable (I plan to submit the paper.)

Recommendations:

The results of the pretest indicate that there are no issues with the question, so it can be left as is.

Cognitive Techniques:

Process Probing, Difficulty Probing, Specific Probing, General Probing

Findings for Question:

Information on the aim and purpose of the test:
Question 20 is asked only of those respondents who previously indicated that they have already written a final version of a manuscript (Question 3) but have not yet submitted it for peer review (Question 15). The question seeks to identify the reasons why respondents do not plan to submit the research paper(s) for peer review.
The purpose of the test was to determine whether the list of response options is complete or whether additional reasons should be included.

Findings:
During the cognitive interview, three participants stated that they had written a (more or less) final version of a manuscript in the past but had not yet submitted it for peer review. One of these participants (TP06) selected a total of five reasons for this in Question 20 (see Table 18), while the other two participants (TP02, 09) chose the response option “Not applicable (I plan to submit the paper)” and explained that they intended to submit the paper for review shortly.
When asked, all three test persons stated that the list of response options was complete.

Question Topic:

Job and career/ Job situation & professional activity

Construct:

Reasons for not submitting an entry