Where the preprint reasoning breaks down for me is the step from the group result to the individual case. That step is almost never argued for.
When a preprint is the best available evidence and we say so
Do not build anything on a preprint that you would mind rebuilding: if the preprint later changes substantially in revision or shows different results when published, your reasoning based on the preprint needs to be revised.
The arithmetic in post #17 is right; the assumption feeding it is the part to check.
Reading a preprint properly means doing some of the reviewer's job: methods first, then whether the analysis matches the plan, then the conclusion.
This is the version I would want a new member to read first.
If you cite a preprint in a maintained document here, the convention is to label it in the sentence and to note the check date. The document review will catch the update.
I would not lead a decision with this, but I would not ignore it either.
Worth separating two things that post #72 runs together.
If you cite a preprint in a maintained document here, the convention is to label it in the sentence and to note the check date. The document review will catch the update.
I am reporting what happened, not recommending it.
Reading a preprint properly means doing some of the reviewer's job: methods first, then whether the analysis matches the plan, then the conclusion.
Coming back to post #137, because the follow-up matters more than the original answer.
Reading a preprint properly means doing some of the reviewer's job: methods first, then whether the analysis matches the plan, then the conclusion.
I would call that likely rather than established.
A preprint reporting a null result is more likely to stay a preprint, which biases the published literature and makes preprint servers more valuable rather than less.
Two people can read the same figure differently here and both be reasonable.
Read the full topic (161 posts)
This topic was referenced in
- [2026 update] Conference abstracts as evidence: the weakest common citationEvidence › Preprints · 2 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
A preprint whose numbers changed substantially at publication
A preprint whose numbers changed substantially at publication — setting out what I have, and where I think it stops being reliable. A preprint question rather than a question about the finding in it. The…
|
+90 | 95 | 21k | 9mo |
|
How this community labels and discusses unrefereed work — the long version
Asking directly, because I could not find a straight answer: How this community labels and discusses unrefereed work — the long version Reading an unrefereed manuscript properly, and asking whether I am doing…
|
+18 | 23 | 21k | 2mo |
|
The "under review" status pill and when a moderator applies it — a second dataset
The "under review" status pill and when a moderator applies it — a second dataset Writing it up because I had to work it out twice and would rather nobody else did. A question about how this site should cite…
|
+50 | 54 | 1.4k | 11mo |
|
Why a preprint's supplementary material is often the best part
Why a preprint's supplementary material is often the best part I have a specific reason for asking rather than idle curiosity, and the context is below. A question about how this site should cite something…
|
+38 | 42 | 863 | 22mo |
|
Conference abstracts as evidence: the weakest common citation
On the subject in the title: Conference abstracts as evidence: the weakest common citation Working notes rather than a conclusion. Reading an unrefereed manuscript properly, and asking whether I am doing it…
|
+1 | 5 | 2k | 9mo |
Related topics — sharing the tags risk of bias, effect size, preprint
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Posting a small dataset on Random versus fixed effects. It…
|
+95 | 106 | 20k | 17mo |
|
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. The question about STEP 4 that I actually want…
|
+81 | 90 | 54k | 9mo |
|
An 18-month record including the parts that went badly
An 18-month record including the parts that went badly — setting out what I have, and where I think it stops being reliable. Asking about 18-month record on behalf of the question I keep seeing asked badly,…
|
+77 | 81 | 17k | 12h |
|
A preprint whose numbers changed substantially at publication
A preprint whose numbers changed substantially at publication — setting out what I have, and where I think it stops being reliable. A preprint question rather than a question about the finding in it. The…
|
+90 | 95 | 21k | 9mo |
|
BPC-157: what the rodent literature actually shows, and what it does not
BPC-157: what the rodent literature actually shows, and what it does not — setting out what I have, and where I think it stops being reliable. I would like to know what people here actually do about BPC-157,…
|
+44 | 48 | 3k | 10mo |