The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique

Reverse causation in a cohort study of weight and outcome

LV
l.vukovicTL223 Dec 2025#1

On the subject in the title: Reverse causation in a cohort study of weight and outcome Working notes rather than a conclusion.

Posting a small dataset on reverse causation. It is mine, it is uncontrolled, and the method is stated so it can be discounted appropriately.

What I would like is not agreement but a second dataset collected by someone with no stake in mine. If one exists I would rather read it than argue for this one.

12 likes 7mo
D
DOdendaalTL3Regular25 Dec 2025#2

Reverse causation is worth one more sentence than it usually gets, and the sentence is the one about how the number was arrived at.

16 likes 7mo
RI
r.ilungaTL226 Dec 2025#3

Adding the measurement that post #2 says would settle it.

Trying to state the reverse causation position in a way that someone who disagrees would recognise as fair, because I do not think the version in this thread passes that test.

32 likes 7mo
ED
e.dalgleishTL3Regular26 Dec 2025 · edited#4

Multiple comparisons: if a paper reports many outcomes, the chance of a spurious association by random chance is real. Pre-specification of primary outcomes matters and secondary analyses are weaker evidence.

That holds under the stated conditions and I have stated them.

0 likes 7mo
DN
d.nilsenTL227 Dec 2025#5

Reverse causation looks different depending on whether you are reading the primary literature or the summaries of it, and the difference is not in our favour.

10 likes 7mo
O
OTeixeiraTL3Regular28 Dec 2025#6

Small methodological point on reverse causation: repeating a measurement is cheap and resolves most of what is being argued about here at no cost to anyone.

23 likes 7mo
NZ
n.zielinskiTL229 Dec 2025#7

The arithmetic in post #6 is right; the assumption feeding it is the part to check.

Statistical significance and clinical importance are different and both are needed. A significant difference below the minimal important difference is a real finding of no practical consequence.

I have changed my mind on this once already, so take it as current rather than settled.

0 likes 7mo
M
MJayawardenaTL3Regular30 Dec 2025#8
OTeixeira, post #6: Small methodological point on reverse causation: repeating a measurement is cheap and resolves most of what is being argued about here at no cost to anyone. Go to post

Answering the question post #4 raises rather than the one it answers.

What makes a methodological criticism substantive: it identifies a specific feature of the design that materially affects what the paper can conclude. "Small sample size" alone is weak. "Small sample size for a rare outcome, so the confidence interval is wide" is stronger.

If it helps: the failure mode here is usually boring rather than dramatic.

1 like in reply to #6 7mo
ID
il.dumitruTL230 Dec 2025#9
e.dalgleish, post #4: Multiple comparisons: if a paper reports many outcomes, the chance of a spurious association by random chance is real. Pre-specification of primary outcomes matters and secondary analyses are weaker evidence. That holds under the stated conditions and I have stated them. Go to post

Post #6 is right about the mechanism and I think understates the practical bit.

Reverse causation would be much easier to settle if anyone reported the denominator. Almost nobody reports the denominator.

1 like in reply to #4 7mo
GH
g.haalandTL3Regular31 Dec 2025#10
n.zielinski, post #7: The arithmetic in post #6 is right; the assumption feeding it is the part to check. Statistical significance and clinical importance are different and both are needed. A significant difference below the minimal important difference is a real finding of no practical consequence. I have changed my mind on this once already, so take it as… Go to post

Following, with nothing to contribute beyond having asked the same thing elsewhere.

7 likes in reply to #7 7mo
PO
p.onwukaTL21 Jan 2026#11
d.nilsen, post #5: Reverse causation looks different depending on whether you are reading the primary literature or the summaries of it, and the difference is not in our favour. Go to post

What I would tell a new member reading about reverse causation for the first time: the confident posts are not the reliable ones, and the reliable ones are longer.

0 likes in reply to #5 7mo
HN
h.nicolaidesTL3Regular1 Jan 2026#12
r.ilunga, post #3: Adding the measurement that post #2 says would settle it. Trying to state the reverse causation position in a way that someone who disagrees would recognise as fair, because I do not think the version in this thread passes that test. Go to post

A criticism that would apply equally to every trial in the field is worth stating once and is not a reason to discount a particular paper.

32 likes in reply to #3 7mo
DN
d.ndiayeTL22 Jan 2026#13

Worth separating two things that post #11 runs together.

Distinguishing three things in the reverse causation discussion that keep getting used interchangeably: the observation, the proposed mechanism, and the recommendation that gets attached to both.

11 likes 7mo
LA
l.aaltonenTL3Regular3 Jan 2026#14

This follows post #11 rather than contradicting it.

An update on my earlier reverse causation post: the pattern held for another six weeks and then stopped, which I did not predict and cannot explain.

3 likes 7mo
MD
m.dumitruTL23 Jan 2026#15

The pre-specified endpoint being a weaker proxy than you would like is a real criticism. It is a smaller one than saying the result was chosen after the fact.

0 likes 7mo

Suggested topics

TopicParticipantsRepliesViewsActivity
Measurement error in a self-reported exposure
Posting this under the heading it deserves: Measurement error in a self-reported exposure Everything below is what sits behind that. The question about measurement error that I actually want answered is the…
LHCKSVCW+117 129 45k 5mo
Coming back to: A structured critique template this community uses
Posting this under the heading it deserves: A structured critique template this community uses Everything below is what sits behind that. Reading back through what has been written here about structured…
SOFAKHASMY+63 69 17k 18h
A structured critique template this community uses
A structured critique template this community uses — setting out what I have, and where I think it stops being reliable. Structured critique template — I have the observation and I do not trust my…
ZOCEK 2 18k 1d
Criticising the method without criticising the authors
Criticising the method without criticising the authors Writing it up because I had to work it out twice and would rather nobody else did. I was wrong about criticising the method without criticising in a…
KBZOKOJMTV+55 61 60k 15mo
A claim built entirely on a subgroup analysis
A claim built entirely on a subgroup analysis Writing it up because I had to work it out twice and would rather nobody else did. I would like to disagree carefully with the settled view on claim built, and I…
ASKHMIASNP+71 80 1.1k 14mo

Related topics — sharing the tags disputed, observational data, effect size

TopicParticipantsRepliesViewsActivity
The retatrutide phase 2 obesity paper, read closely
Posting this under the heading it deserves: The retatrutide phase 2 obesity paper, read closely Everything below is what sits behind that. Retatrutide phase 2 obesity paper, from the point of view of someone…
KTDEF 2 65k 10mo
Journal club: LEADER as the historical anchor
Journal club: LEADER as the historical anchor Writing it up because I had to work it out twice and would rather nobody else did. What changes if the standard account of LEADER is wrong? I ask because I have…
AKACRIGKR+103 110 8.1k 2h
Sample size intuition for a personal experiment
On the subject in the title: Sample size intuition for a personal experiment Working notes rather than a conclusion. A follow-up question about sample size intuition that I did not know to ask the first time.…
RKHECAHTT 4 62k 18mo
What TRIUMPH is designed to answer, and why we should not pre-empt it
What TRIUMPH is designed to answer, and why we should not pre-empt it I have a specific reason for asking rather than idle curiosity, and the context is below. TRIUMPH keeps being re-asked here and I think…
NNRNCIHBEK+4 8 142 6h
Why cagrilintide alone is discussed so much less than in combination — does this still hold?
Why cagrilintide alone is discussed so much less than in combination — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Cagrilintide alone:…
SBKRSICPMN+27 31 1.2k 22h