Preprint servers and what screening they do

Preprint servers and what screening they do — setting out what I have, and where I think it stops being reliable.

A preprint question rather than a question about the finding in it.

The manuscript is on a preprint server, dated, with a version number I have written down. It has not been through review and the authors say so in the header. What I cannot work out is how much weight that leaves it carrying.

I would like the reasoning rather than a rule. "Wait for publication" is not usable when the publication may be two years away and the question is now.

Confirming the opening post from a second method, which matters more than confirming it from a second person.

Trying to state the preprint servers position in a way that someone who disagrees would recognise as fair, because I do not think the version in this thread passes that test.

On the opening post — agreed on the reasoning, with one qualification.

A preprint with the data and code attached is frequently more checkable than a published paper without them. Reviewed and reproducible are different properties.

I would rather post the uncertainty than round it away.

Fine by me. I had wanted a stronger conclusion and there is not one available.

Always label it as a preprint in any discussion. A preprint is not a published trial and it is not settled knowledge. Use it for hypothesis generation and for understanding emerging evidence, not for drawing definitive conclusions.

The claim is narrower than it sounds, and deliberately so.

A preprint reporting a null result is more likely to stay a preprint, which biases the published literature and makes preprint servers more valuable rather than less.

Worth separating two things that post #3 runs together.

Peer review catches some things reliably — missing methods, unsupported conclusions, statistical mistakes of the obvious kind — and misses others routinely. Knowing which is which makes preprint reading easier.

This follows post #7 rather than contradicting it.

How to cite a preprint: author last name, first initial, et al. Title. Server name [preprint]. Posted date. Doi. Include the server name and note that it is a preprint.

Server repositories: medRxiv for medicine, bioRxiv for biology. Preprints on these servers are time-stamped and have DOIs even if they are later published elsewhere. Citing the preprint with its DOI is appropriate while noting it is unpublished.

I have written this out at length because the short version keeps being misread.

Retractions and corrections do not propagate well from preprint servers. A citation that was fine when made can quietly become wrong.

Written quickly, so the reasoning may be tighter than the wording.

Taking post #8 at face value and following it one step further.

Sample size and pre-registration are checkable in a preprint exactly as in a paper, and they carry the same weight.

If it helps: the failure mode here is usually boring rather than dramatic.

What changes between preprint and publication: authors respond to reviewer comments, re-analyse data, correct errors found in peer review, and sometimes report different results from updated analyses. The published version is not the same as the preprint.

I looked this up rather than remembered it, which is the right order.

Adding thanks rather than a view. I do not have a view worth the space.

Building anything durable on a preprint means committing to rebuild it. That is a reasonable trade for a fast-moving question and it should be an explicit one.