The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Preprints · continued

When a preprint is the best available evidence and we say so posts 61–90

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1 · go to the accepted answer.

LE
logbook_erinTL3Regular16 Aug 2025 · edited#61
ne.laurent, post #59: Adding a reference point for preprint. Mine is a single case, collected without controls, and I am posting the method alongside it so it can be discounted appropriately. Go to post

I would keep preprint and the decision it usually gets used for separate in this thread. They are related and they are not the same question, and merging them is why the last one went badly.

10 likes in reply to #59 11mo
AP
au.pereiraTL216 Aug 2025#62
CL
coldchain_liuTL3Regular16 Aug 2025#63

Version numbers on a preprint server matter. Citing version one of something now on version four is citing a document that has been superseded by its own authors.

Happy to expand any of that if it is the useful part.

0 likes 11mo
AI
a.ilungaTL216 Aug 2025#64

On post #60 — agreed on the reasoning, with one qualification.

Screening on a preprint server is minimal and is not review. It filters obvious problems and nothing more, which is what it is designed to do.

Scoping that to what I have actually seen rather than what I have read.

3 likes 11mo
PM
physio_marchettiTL2Physiotherapist17 Aug 2025 · edited#65
j.nascimento, post #56: Narrowing post #54, because the general version has more than one answer. Say it is a preprint in the first line rather than the last. Everything downstream depends on that status and readers arriving from search will not scroll for it. Go to post

Post #63 is right about the mechanism and I think understates the practical bit.

Where a preprint's numbers are the basis of a claim being repeated here, someone should check whether the published version exists yet. That check is nearly always overdue.

That is my reading. Someone else read the same page differently and was reasonable.

6 likes in reply to #56 11mo
JI
j.iyerTL217 Aug 2025#66

Do not build anything on a preprint that you would mind rebuilding: if the preprint later changes substantially in revision or shows different results when published, your reasoning based on the preprint needs to be revised.

16 likes 11mo
VS
v.szaboTL3Analytical chemist17 Aug 2025#67

Peer review catches some things reliably — missing methods, unsupported conclusions, statistical mistakes of the obvious kind — and misses others routinely. Knowing which is which makes preprint reading easier.

0 likes 11mo
NO
n.oseiTL218 Aug 2025#68

The most useful reply I ever got about preprint was a request to state my units. It sounds like pedantry and it has saved me twice.

1 like 11mo
DO
d.oyelaranTL3Pharmacist18 Aug 2025#69

Building on post #66 rather than restating it.

Always label it as a preprint in any discussion. A preprint is not a published trial and it is not settled knowledge. Use it for hypothesis generation and for understanding emerging evidence, not for drawing definitive conclusions.

If the premise is wrong, everything after it is decoration.

22 likes 11mo
HV
h.vargaTL218 Aug 2025#70
d.oyelaran, post #69: Building on post #66 rather than restating it. Always label it as a preprint in any discussion. A preprint is not a published trial and it is not settled knowledge. Use it for hypothesis generation and for understanding emerging evidence, not for drawing definitive conclusions. If the premise is wrong, everything after it is decoration. Go to post

Post #68 put the caveat in the right place and I want to underline it.

How to cite a preprint: author last name, first initial, et al. Title. Server name [preprint]. Posted date. Doi. Include the server name and note that it is a preprint.

The claim is narrower than it sounds, and deliberately so.

0 likes in reply to #69 11mo
I
IbrahimoviTL2Member18 Aug 2025#71
LJankowiak, post #60: The arithmetic in post #57 is right; the assumption feeding it is the part to check. A preprint that has been up for two years without appearing in a journal is telling you something, and it is not necessarily that the work is bad. The honest answer is that it depends, and here is what it depends on. Go to post

Saving this. It is the version I will quote when the question comes round again.

5 likes in reply to #60 11mo
ZN
z.nakamuraTL219 Aug 2025#72

Check whether it was later published: searching for the preprint's first author and keywords in PubMed might find a published version. The published version is the stronger citation if it exists.

0 likes 11mo
CN
cannula_notesTL2Member19 Aug 2025#73

Worth separating two things that post #72 runs together.

If you cite a preprint in a maintained document here, the convention is to label it in the sentence and to note the check date. The document review will catch the update.

I am reporting what happened, not recommending it.

30 likes 11mo
AW
am.wikstromTL219 Aug 2025#74
np_gilmore, post #6: Post #2 put the caveat in the right place and I want to underline it. Adding a null result on preprint. I looked, carefully, and found nothing, and null results deserve posting precisely because they never are. Go to post

This follows post #72 rather than contradicting it.

A preprint with the data and code attached is frequently more checkable than a published paper without them. Reviewed and reproducible are different properties.

I would be interested in a counterexample if anyone has one.

15 likes in reply to #6 11mo
M
MSaarinenTL3Regular19 Aug 2025#75
Ibrahimovi, post #71: Saving this. It is the version I will quote when the question comes round again. Go to post

Say it is a preprint in the first line rather than the last. Everything downstream depends on that status and readers arriving from search will not scroll for it.

9 likes in reply to #71 11mo
BB
b.brandtTL220 Aug 2025 · edited#76

Narrowing post #75, because the general version has more than one answer.

What changes between preprint and publication: authors respond to reviewer comments, re-analyse data, correct errors found in peer review, and sometimes report different results from updated analyses. The published version is not the same as the preprint.

That is the version I use. It may not be the version that is correct.

2 likes 11mo
JD
j.delacroixTL3Regular20 Aug 2025#77

Post #75 and I disagree about the size of the effect, not about the direction.

Adding the boring version of preprint, because the interesting version keeps getting posted and the boring one is usually right.

Check the ordinary explanations, in order, and stop when one of them accounts for what you are seeing. Most of the time the second one does.

0 likes 11mo
TL
t.lindqvistTL220 Aug 2025#78

Before the thread moves on from preprint — what is the sample size behind the claim? I am not being difficult; I have seen the same figure quoted from an n of four and from an n of four hundred.

21 likes 11mo
AW
a.westergaardTL3Regular20 Aug 2025#79

I had written a reply contradicting post #75 and deleted it. Here is what survived.

Where numbers change between preprint and published version, the changes are not random. They tend toward a smaller effect and a more carefully hedged claim.

Worth reading the earlier posts in this thread before acting on mine.

14 likes 11mo
SO
sa.okonkwoTL221 Aug 2025#80

Confirming post #79 from a second method, which matters more than confirming it from a second person.

Retractions and corrections do not propagate well from preprint servers. A citation that was fine when made can quietly become wrong.

That is one dataset and I would not build a rule on it.

5 likes 11mo
SM
s.mbekiTL221 Aug 2025#81

Author track record is a weak signal and it is a signal. A group that has published carefully for years is a different prior from an unknown one.

The confident version of this sentence would be wrong, so here is the hedged one.

25 likes 11mo
NA
n.abernathyTL3Analytical chemist21 Aug 2025 · edited#82

Building anything durable on a preprint means committing to rebuild it. That is a reasonable trade for a fast-moving question and it should be an explicit one.

0 likes 11mo
HA
h.agyemanTL222 Aug 2025#83
ni.stanescu, post #21: Post #18 is the version of this I will quote in future. One addition. A preprint that has been up for two years without appearing in a journal is telling you something, and it is not necessarily that the work is bad. That is the shape of it. The detail is where I would expect to be corrected. Go to post

This follows post #80 rather than contradicting it.

Where a preprint contradicts a published trial, the prior should favour the trial. Where it extends one, the preprint can be genuinely useful.

I have left out the parts I could not verify.

1 like in reply to #21 11mo
DH
dietitian_hollisTL3Dietitian22 Aug 2025#84
d.bakker, post #39: Version numbers on a preprint server matter. Citing version one of something now on version four is citing a document that has been superseded by its own authors. Posting it because the silence on this was starting to look like agreement. Go to post

A preprint reporting a null result is more likely to stay a preprint, which biases the published literature and makes preprint servers more valuable rather than less.

Reading it again, the caveat matters more than the finding.

7 likes in reply to #39 11mo
VB
v.baptistaTL222 Aug 2025#85

Reading a preprint properly means doing some of the reviewer's job: methods first, then whether the analysis matches the plan, then the conclusion.

33 likes 11mo
BN
bench_notesTL4 Moderator22 Aug 2025#86

Everything in post #82 holds. The case it does not cover is the one I have.

I read the earlier replies on preprint twice before writing this, because I had assumed the opposite and wanted to be sure I was disagreeing with what was said rather than what I expected.

0 likes 11mo
SC
s.cabreraTL223 Aug 2025#87
s.diallo, post #31: Coming back to post #27, because the follow-up matters more than the original answer. Where numbers change between preprint and published version, the changes are not random. They tend toward a smaller effect and a more carefully hedged claim. That is all the detail I have. Someone else will have more. Go to post

Marking my place. If it changes for me I will come back and say so.

4 likes in reply to #31 11mo
PW
PharmNotes_WhitfieldTL4Pharmacist23 Aug 2025#88
Nicolaides, post #50: Sample size and pre-registration are checkable in a preprint exactly as in a paper, and they carry the same weight. Go to post

Sample size and pre-registration are checkable in a preprint exactly as in a paper, and they carry the same weight.

12 likes in reply to #50 11mo
EL
e.lehtinenTL223 Aug 2025#89
chromatogram, post #1: When a preprint is the best available evidence and we say so — that is the question, and I have not found it answered plainly anywhere I have looked. A preprint question rather than a question about the finding in it. The manuscript is on a preprint server, dated, with a version number I have written down. It has not been through review… Go to post

The arithmetic in post #88 is right; the assumption feeding it is the part to check.

Server repositories: medRxiv for medicine, bioRxiv for biology. Preprints on these servers are time-stamped and have DOIs even if they are later published elsewhere. Citing the preprint with its DOI is appropriate while noting it is unpublished.

It is worth stating the boring hypothesis before the interesting one.

12 likes in reply to #1 11mo
BA
b.aaltoTL223 Aug 2025#90

Nothing to add, except that this is the answer I would give if asked.

26 likes 11mo