Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version) - Cognitive Pretest

Abstract:

The DFG-funded “PubBias” project examines the prevalence and extent of publication bias in the social, economic, and behavioral sciences in Germany using GESIS Panel and SOEP-IS study submissions.
The subject of this pretest are questions on the publication process of scientific papers.
The questions were tested via cognitive interviews.

Citation:

Lenzner, T. & Hadler, P. (2024): Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version). Cognitive Pretest. GESIS - Leibniz Institute for the Social Sciences

DOI:

10.17173/pretest159

Question No.	Pretesting Results	Type	Construct
1	What academic position did you hold when planning/conceptualizing this study?	Single Question	Academic position
2	What was the status of the measurement instrument/survey questions that you used in the study at the time you collected the data? If you have used more than one measurement instrument/survey question, please think of the main instrument/survey questions.	Single Question	Status of the survey instrument
3	Have you written up a draft or final version of the results derived from this study (i.e., one or more manuscripts, articles, or book chapters- henceforth referred to as papers)?	Single Question	Documentation of the study results
4	If the design of your study was longitudinal, did you include all waves in the paper(s)?	Single Question	Completeness of reporting in longitudinal study designs
5	Why did you not include all waves in the paper(s)?	Single Question	Completeness of reporting in longitudinal study designs
6	If the design of your study was experimental, did you include all experimental groups in the paper(s)?	Single Question	Completeness of reporting in experimental designs
7	Why did you not include all experimental groups in the paper(s)?	Single Question	Completeness of reporting in experimental designs
8	Thinking back to the planning of your study, would you say that you pursued the initial objectives and research questions?	Single Question	Pursuit of the original research objectives
9	What were the reasons for this change in objectives?	Single Question	Reasons for the change in research objectives
10	What was the nature of results of the initially planned analyses?	Single Question	Reasons for the change in research objectives
11	Which step of the research process would you say there was the biggest change in objectives/the conceptual framework?	Single Question	Phase of the major change in research objectives
12	Did you find statistically significant results when it comes to your main analyses (by whatever standard you use to interpret statistical significance)?	Single Question	Statistical significance of the key findings
13	Did you find support for your main expectations?	Single Question	Confirmation of key expectations
14	What was the nature of deviation bewtween your expectations and the results obtained?	Single Question	Nature of the discrepancy between expectations and results
15	Still thinking about this study: Have you submitted one or more papers based on this study to a peer-reviewed journal or as a chapter of an edited book?	Single Question	Submission of research papers for review
16	Have one or more of these papers been rejected once or several times?	Single Question	Submission of research papers for review
17	What were the reasons for the rejection(s)?	Single Question	Reasons for rejecting research papers
18	Are there any consequences for you as a result of the rejection(s) of the paper(s)?	Single Question	Consequences of rejection
19	Version 1: What is the probability you will resubmit the paper(s) to a peer-reviewed journal or edited book? Version 2: How likely is it that you will resubmit the paper(s) to a peer-reviewed journal or edited book?	Single Question	Probability of resubmission
20	What are the reasons why you do not plan to submit the paper(s)?	Single Question	Reasons for not submitting an entry
21	What are the reasons why you have not yet (fully) written up the results?	Single Question	Reasons for the absence of a final manuscript
22	What were the reasons for this decision?	Single Question	Reasons for the absence of a final manuscript
23	Why have you not yet analyzed the data in this project?	Single Question	Reasons why data analysis has not yet been conducted
24	What were the reasons for the co-author(s) leaving?	Single Question	Reasons for the withdrawal of co-authors
25	What were the reasons for the new author(s) joining?	Single Question	Reasons for bringing in co-authors

Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version) - Cognitive Pretest

Abstract:

Citation:

DOI:

Number of Participants:

Selection of Target Population/Quotas:

Test Date:

Number of cognitive interviewers:

Survey mode:

Pretest mode:

Procedure:

Incentive for respondents:

Project Description:

Client:

Pretest Report (German):

Pretest Report (English):

Interview protocol (German):

Interview protocol (English):

Citation: