Topic summary

Tracking a preprint to publication: a worked example

Evidence › Preprints preprint risk of bias needs a source

This is a generated summary. It shows the 9 most-liked posts from a topic of 148, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.

f.chowdhuryTL24 Dec 2025#47

Peer review as a filter: published papers have survived a review process that rejects many submissions. Preprints have not. Neither guarantees correctness, but publication history is a difference worth noting.

One more caveat and then I will stop qualifying: the sample selected itself.

30 likes 8mo

l.piresTL25 Dec 2025#50

The question underneath tracking a preprint is usually "how would I tell?" rather than "what is true?", and that one has a method attached to it.

Write down what you would expect to see under each hypothesis before you collect anything. If they predict the same observation, collecting it will not help.

32 likes 8mo

g.ekstromTL25 Dec 2025#57

Second-hand on tracking a preprint, so weight it accordingly — someone whose method I trust told me this and I have not verified it myself.

32 likes 8mo

k.otieno_statsTL3Statistician7 Dec 2025#74

MJayawardena, post #37: Do not build anything on a preprint that you would mind rebuilding: if the preprint later changes substantially in revision or shows different results when published, your reasoning based on the preprint needs to be revised. Go to post

This is the first time the answer has come with its own limits attached. Appreciated.

30 likes in reply to #37 8mo

KLindqvistTL4 Moderator8 Dec 2025#83

I changed my mind about tracking a preprint after someone here asked me for the source and I could not produce one. That is worth saying out loud because it is the ordinary way it happens.

28 likes 8mo

mi.amankwahTL210 Dec 2025#97

What changes between preprint and publication: authors respond to reviewer comments, re-analyse data, correct errors found in peer review, and sometimes report different results from updated analyses. The published version is not the same as the preprint.

Worth one more sentence than it usually gets.

29 likes 8mo

p.onwukaTL212 Dec 2025#120

This follows post #117 rather than contradicting it.

I have been on both sides of the tracking a preprint argument in this category within eighteen months, which should tell you how strong the evidence for either side is.

30 likes 8mo

n.nakamuraTL212 Dec 2025#122

m.ndiaye, post #67: Post #65 put the caveat in the right place and I want to underline it. Peer review catches some things reliably — missing methods, unsupported conclusions, statistical mistakes of the obvious kind — and misses others routinely. Knowing which is which makes preprint reading easier. The confident version of this sentence would be wrong,… Go to post

Post #120 put the caveat in the right place and I want to underline it.

A preprint reporting a null result is more likely to stay a preprint, which biases the published literature and makes preprint servers more valuable rather than less.

28 likes in reply to #67 8mo

BDraganovTL2Member14 Dec 2025#147

r.zielinski, post #106: Helpful, and short, which on this subject is harder than long. Go to post

Post #144 is right about the mechanism and I think understates the practical bit.

Always label it as a preprint in any discussion. A preprint is not a published trial and it is not settled knowledge. Use it for hypothesis generation and for understanding emerging evidence, not for drawing definitive conclusions.

I have written this out at length because the short version keeps being misread.

32 likes in reply to #106 7mo

Read the full topic (148 posts)

This topic was referenced in

About the Preprints categoryEvidence › Preprints · 7 replies

Suggested topics

Topic	Participants	Replies	Views	Activity
Citing a preprint in a maintained document: our rule and its reasoning — does this still hold? Evidence › Preprints preprint needs a source effect size Solved Under review The question in the title: Citing a preprint in a maintained document: our rule and its reasoning — does this still hold? I will give what I have already checked below so nobody repeats it. A question about…	+103	115	24k	10mo
Conference abstracts as evidence: the weakest common citation Evidence › Preprints risk of bias effect size needs a source On the subject in the title: Conference abstracts as evidence: the weakest common citation Working notes rather than a conclusion. Reading an unrefereed manuscript properly, and asking whether I am doing it…	+1	5	2k	9mo
About the Preprints category Evidence › Preprints preprint risk of bias needs a source Pinned Wiki Unrefereed work, clearly labelled as such, with the usual caveats stated once and taken seriously. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded…	+3	7	14k	3mo
When a preprint is the best available evidence and we say so Evidence › Preprints risk of bias effect size preprint Solved When a preprint is the best available evidence and we say so — that is the question, and I have not found it answered plainly anywhere I have looked. A preprint question rather than a question about the…	+148	160	31k	11mo
Citing a preprint in a maintained document: our rule and its reasoning Evidence › Preprints risk of bias effect size needs a source preprint Pinned On the subject in the title: Citing a preprint in a maintained document: our rule and its reasoning Working notes rather than a conclusion. A preprint question rather than a question about the finding in it.…		2	467	4mo

Related topics — sharing the tags preprint, risk of bias, needs a source

Topic	Participants	Replies	Views	Activity
Journal club: STEP 1 and the treatment-policy estimand Evidence › Journal club journal club randomised trial number needed to treat risk of bias Journal club: STEP 1 and the treatment-policy estimand Writing it up because I had to work it out twice and would rather nobody else did. Session topic: STEP 1 ( N Engl J Med , 2021). Please read it before…		3	11k	9h
Selection into a registry and what it does to the estimate — a second dataset Evidence › Study critique confounding risk of bias effect size disputed Solved Posting this under the heading it deserves: Selection into a registry and what it does to the estimate — a second dataset Everything below is what sits behind that. Posting a small dataset on Selection. It is…	+28	32	1.3k	1d
TB-500 and thymosin beta-4: the fragment versus the protein Compounds › Repair & healing peptides observational data TB-500 BPC-157 preprint TB-500 and thymosin beta-4: the fragment versus the protein Writing it up because I had to work it out twice and would rather nobody else did. TB-500 and thymosin beta-4: what I expected, what I found, and…	+107	118	22k	11mo
Citing a preprint in a maintained document: our rule and its reasoning — does this still hold? Evidence › Preprints preprint needs a source effect size Solved Under review The question in the title: Citing a preprint in a maintained document: our rule and its reasoning — does this still hold? I will give what I have already checked below so nobody repeats it. A question about…	+103	115	24k	10mo
How this community labels and discusses unrefereed work — the long version Evidence › Preprints needs a source effect size risk of bias Asking directly, because I could not find a straight answer: How this community labels and discusses unrefereed work — the long version Reading an unrefereed manuscript properly, and asking whether I am doing…	+18	23	21k	2mo