Projekt „PubBias“ – Fragen zur Erfassung der Prävalenz und des Ausmaßes von Publikationsverzerrungen - Kognitiver Pretest

Abstract:

Das von der DFG finanzierte Projekt „PubBias“ untersucht die Prävalenz und das Ausmaß von Publikationsverzerrungen in den Sozial-, Wirtschafts- und Verhaltenswissenschaften in Deutschland anhand von GESIS-Panel- und SOEP-IS-Studieneinreichungen.
Gegenstand dieses Pretests sind Fragen zum Publikationsprozess von wissenschaftlichen Arbeiten.
Getestet wurden die Fragen mittels persönlich-mündlicher oder videobasierter kognitiver Interviews.

Citation:

Lenzner, T. & Hadler, P. (2024): Projekt „PubBias“ – Fragen zur Erfassung der Prävalenz und des Ausmaßes von Publikationsverzerrungen. Kognitiver Pretest. GESIS – Leibniz-Institut für Sozialwissenschaften

DOI:

10.17173/pretest141

Question No.	Pretesting Results	Type	Construct
1	What academic position did you hold when planning/conceptualizing this study?	Single Question	Akademische Position
2	What was the status of the measurement instrument/survey questions that you used in the study at the time you collected the data? If you have used more than one measurement instrument/survey question, please think of the main instrument/survey questions.	Single Question	Status des Erhebungsinstruments
3	Have you written up a draft or final version of the results derived from this study (i.e., one or more manuscripts, articles, or book chapters- henceforth referred to as papers)?	Single Question	Verschriftlichung der Studienergebnisse
4	If the design of your study was longitudinal, did you include all waves in the paper(s)?	Single Question	Vollständigkeit der Berichterstattung bei Längsschnittdesigns
5	Why did you not include all waves in the paper(s)?	Single Question	Vollständigkeit der Berichterstattung bei Längsschnittdesigns
6	If the design of your study was experimental, did you include all experimental groups in the paper(s)?	Single Question	Vollständigkeit der Berichterstattung bei Experimentaldesigns
7	Why did you not include all experimental groups in the paper(s)?	Single Question	Vollständigkeit der Berichterstattung bei Experimentaldesigns
8	Thinking back to the planning of your study, would you say that you pursued the initial objectives and research questions?	Single Question	Verfolgung der ursprünglichen Forschungsziele
9	What were the reasons for this change in objectives?	Single Question	Gründe für die Änderung der Forschungsziele
10	What was the nature of results of the initially planned analyses?	Single Question	Gründe für die Änderung der Forschungsziele
11	In which step of the research process would you say there was the biggest change in objectives/the conceptual framework?	Single Question	Phase der Hauptänderung der Forschungsziele
12	Did you find statistically significant results when it comes to your main analyses (by whatever standard you use to interpret statistical significance)?	Single Question	Statistische Signifikanz der zentralen Ergebnisse
13	Did you find support for your main expectations?	Single Question	Bestätigung der zentralen Erwartungen
14	What was the nature of deviation between your expectations and the results obtained?	Single Question	Art der Abweichung zwischen Erwartungen und Ergebnissen
15	Still thinking about this study: Have you submitted one or more papers based on this study to a peer-reviewed journal or as a chapter of an edited book?	Single Question	Einreichung von Forschungspapieren zur Begutachtung
16	Have one or more of these papers been rejected once or several times?	Single Question	Einreichung von Forschungspapieren zur Begutachtung
17	What were the reasons for the rejection(s)?	Single Question	Gründe für Ablehnung von Forschungspapieren
18	Are there any consequences for you as a result of the rejection(s) of the paper(s)?	Single Question	Konsequenzen der Ablehnung
19	Version 1: What is the probability you will resubmit the paper(s) to a peer-reviewed journal or edited book? Version 2: How likely is it that you will resubmit the paper(s) to a peer-reviewed journal or edited book?	Single Question	Wahrscheinlichkeit der Wiedereinreichung
20	What are the reasons why you do not plan to submit the paper(s)?	Single Question	Gründe für den Verzicht auf eine Einreichung
21	What are the reasons why you have not yet (fully) written up the results?	Single Question	Gründe für das Fehlen eines finalen Manuskripts
22	What were the reasons for that decision?	Single Question	Gründe für das Fehlen eines finalen Manuskripts
23	Why have you not yet analyzed the data in this project?	Single Question	Gründe für noch nicht erfolgte Datenanalyse
24	What were the reasons for the co-author(s) leaving?	Single Question	Gründe für das Ausscheiden von Koautoren
25	What were the reasons for the new author(s) joining?	Single Question	Gründe für das Dazustoßen von Koautoren

Projekt „PubBias“ – Fragen zur Erfassung der Prävalenz und des Ausmaßes von Publikationsverzerrungen - Kognitiver Pretest

Abstract:

Citation:

DOI:

Number of Participants:

Selection of Target Population/Quotas:

Test Date:

Number of cognitive interviewers:

Survey mode:

Pretest mode:

Procedure:

Incentive for respondents:

Project Description:

Client:

Pretest Report (German):

Interview protocol (German):

Citation: