When a preprint is the best available evidence and we say so — a second dataset

When a preprint is the best available evidence and we say so — a second dataset I have a specific reason for asking rather than idle curiosity, and the context is below.

A preprint question rather than a question about the finding in it.

The manuscript is on a preprint server, dated, with a version number I have written down. It has not been through review and the authors say so in the header. What I cannot work out is how much weight that leaves it carrying.

I would like the reasoning rather than a rule. "Wait for publication" is not usable when the publication may be two years away and the question is now.

Picking up the opening post: that is the part I would want checked first.

Preprint is a good example of a question where the honest answer is boring and the interesting answers are unsupported. I would go with boring.

Agreed on all of that, and I have nothing to add to it.

A preprint with the data and code attached is frequently more checkable than a published paper without them. Reviewed and reproducible are different properties.

Adding the measurement that post #5 says would settle it.

Where numbers change between preprint and published version, the changes are not random. They tend toward a smaller effect and a more carefully hedged claim.

Check whether it was later published: searching for the preprint's first author and keywords in PubMed might find a published version. The published version is the stronger citation if it exists.

Adding the caveat now so it does not have to be extracted later.

Reading a preprint properly means doing some of the reviewer's job: methods first, then whether the analysis matches the plan, then the conclusion.

Happy to be the one who is wrong here if it settles the question.

Same experience here, different supplier, so it is at least not unique to one of them.

How to cite a preprint: author last name, first initial, et al. Title. Server name [preprint]. Posted date. Doi. Include the server name and note that it is a preprint.

Someone should write this up properly, and it should probably not be me.

Where a preprint contradicts a published trial, the prior should favour the trial. Where it extends one, the preprint can be genuinely useful.

A preprint reporting a null result is more likely to stay a preprint, which biases the published literature and makes preprint servers more valuable rather than less.

Confirming post #10 from a second method, which matters more than confirming it from a second person.

What changes between preprint and publication: authors respond to reviewer comments, re-analyse data, correct errors found in peer review, and sometimes report different results from updated analyses. The published version is not the same as the preprint.

Genuinely open to being wrong about this one.

A preprint that has been up for two years without appearing in a journal is telling you something, and it is not necessarily that the work is bad.

The part I am sure of is shorter than the part I have written.