Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version) - Cognitive Pretest

Zusammenfassung:

The DFG-funded “PubBias” project examines the prevalence and extent of publication bias in the social, economic, and behavioral sciences in Germany using GESIS Panel and SOEP-IS study submissions.
The subject of this pretest are questions on the publication process of scientific papers.
The questions were tested via cognitive interviews.

Zitation:

Lenzner, T. & Hadler, P. (2024): Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version). Cognitive Pretest. GESIS - Leibniz Institute for the Social Sciences

DOI:

10.17173/pretest159

Frage-Nr.	Pretestergebnisse	Typ	Konstrukt
1	What academic position did you hold when planning/conceptualizing this study?	Einzelfrage	Academic position
2	What was the status of the measurement instrument/survey questions that you used in the study at the time you collected the data? If you have used more than one measurement instrument/survey question, please think of the main instrument/survey questions.	Einzelfrage	Status of the survey instrument
3	Have you written up a draft or final version of the results derived from this study (i.e., one or more manuscripts, articles, or book chapters- henceforth referred to as papers)?	Einzelfrage	Documentation of the study results
4	If the design of your study was longitudinal, did you include all waves in the paper(s)?	Einzelfrage	Completeness of reporting in longitudinal study designs
5	Why did you not include all waves in the paper(s)?	Einzelfrage	Completeness of reporting in longitudinal study designs
6	If the design of your study was experimental, did you include all experimental groups in the paper(s)?	Einzelfrage	Completeness of reporting in experimental designs
7	Why did you not include all experimental groups in the paper(s)?	Einzelfrage	Completeness of reporting in experimental designs
8	Thinking back to the planning of your study, would you say that you pursued the initial objectives and research questions?	Einzelfrage	Pursuit of the original research objectives
9	What were the reasons for this change in objectives?	Einzelfrage	Reasons for the change in research objectives
10	What was the nature of results of the initially planned analyses?	Einzelfrage	Reasons for the change in research objectives
11	Which step of the research process would you say there was the biggest change in objectives/the conceptual framework?	Einzelfrage	Phase of the major change in research objectives
12	Did you find statistically significant results when it comes to your main analyses (by whatever standard you use to interpret statistical significance)?	Einzelfrage	Statistical significance of the key findings
13	Did you find support for your main expectations?	Einzelfrage	Confirmation of key expectations
14	What was the nature of deviation bewtween your expectations and the results obtained?	Einzelfrage	Nature of the discrepancy between expectations and results
15	Still thinking about this study: Have you submitted one or more papers based on this study to a peer-reviewed journal or as a chapter of an edited book?	Einzelfrage	Submission of research papers for review
16	Have one or more of these papers been rejected once or several times?	Einzelfrage	Submission of research papers for review
17	What were the reasons for the rejection(s)?	Einzelfrage	Reasons for rejecting research papers
18	Are there any consequences for you as a result of the rejection(s) of the paper(s)?	Einzelfrage	Consequences of rejection
19	Version 1: What is the probability you will resubmit the paper(s) to a peer-reviewed journal or edited book? Version 2: How likely is it that you will resubmit the paper(s) to a peer-reviewed journal or edited book?	Einzelfrage	Probability of resubmission
20	What are the reasons why you do not plan to submit the paper(s)?	Einzelfrage	Reasons for not submitting an entry
21	What are the reasons why you have not yet (fully) written up the results?	Einzelfrage	Reasons for the absence of a final manuscript
22	What were the reasons for this decision?	Einzelfrage	Reasons for the absence of a final manuscript
23	Why have you not yet analyzed the data in this project?	Einzelfrage	Reasons why data analysis has not yet been conducted
24	What were the reasons for the co-author(s) leaving?	Einzelfrage	Reasons for the withdrawal of co-authors
25	What were the reasons for the new author(s) joining?	Einzelfrage	Reasons for bringing in co-authors

Project „PubBias“ – Questions on assessing the prevalence and extent of publication bias (English Version) - Cognitive Pretest

Zusammenfassung:

Zitation:

DOI:

Anzahl Testpersonen:

Auswahl und Merkmale der Testpersonen:

Feldzeit des Pretests:

Anzahl der Testleiter:

Befragungsmodus:

Pretestmodus:

Vorgehensweise:

Testpersonenhonorar:

Projektbeschreibung:

Auftraggeber:

Pretestbericht (Deutsch):

Pretestbericht (Englisch):

Kognitiver Leitfaden (Deutsch):

Kognitiver Leitfaden (Englisch):

Zitation: