The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Trials · continued

How to read a forest plot, properly, from scratch posts 31–60

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1 · go to the accepted answer.

KF
k.fonsecaTL223 Sep 2025#31
c.correia, post #9: Post #8 describes the usual case. This is about the unusual one. A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers. Go to post

Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.

The disagreement above is smaller than it looks once the terms are fixed.

3 likes in reply to #9 10mo
KV
k.vanheckeTL225 Sep 2025#32
v.kirchner, post #16: Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit. Second-hand, so weight it accordingly. Go to post

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

That distinction has done more work for me than anything else in this category.

10 likes in reply to #16 10mo
VB
v.baptistaTL227 Sep 2025#33

That is a fair summary of where the discussion has got to.

30 likes 10mo
BN
bench_notesTL4 Moderator30 Sep 2025#34

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

0 likes 10mo
RF
r.friskTL22 Oct 2025 · edited#35

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

6 likes 10mo
HF
h.ferrariTL24 Oct 2025#36
v.szabo, post #15: Adding the measurement that post #13 says would settle it. Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers. Scoping that to what I have actually seen rather than what I have read. Go to post

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

I would rather say I do not know than round it up to an answer.

15 likes in reply to #15 10mo
EL
e.lehtinenTL26 Oct 2025#37

Post #34 answers the question as asked. The question underneath it is different.

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

That much is documented. The rest is how I have interpreted it.

0 likes 10mo
BA
b.aaltoTL29 Oct 2025#38

I read post #36 twice before replying, because I had assumed the opposite.

Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.

1 like 10mo
K
KForsbergTL2Member11 Oct 2025#39

Taking post #38 at face value and following it one step further.

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

0 likes 10mo
KK
k.kimaniTL213 Oct 2025#40
b.vanhecke, post #29: Clear enough that I do not think I have a follow-up, which is unusual. Go to post

Post #36 and I disagree about the size of the effect, not about the direction.

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

3 likes in reply to #29 9mo
BP
bench_peakTL3Regular15 Oct 2025 · edited#41

Coming back to post #37, because the follow-up matters more than the original answer.

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

I looked this up rather than remembered it, which is the right order.

6 likes 9mo
RC
r.coelhoTL218 Oct 2025#42

Composite endpoints should be read component by component. A composite driven entirely by its softest component is a different finding from one where the components move together.

If it helps: the failure mode here is usually boring rather than dramatic.

1 like 9mo
O
OTeixeiraTL3Regular20 Oct 2025#43

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

0 likes 9mo
SO
s.oyelaranTL222 Oct 2025#44
r.petrov, post #27: A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers. I would hold that lightly until someone with a larger sample weighs in. Go to post

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

23 likes in reply to #27 9mo
CD
cohort_driftTL3Regular24 Oct 2025#45
d.fontaine, post #13: Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting. Go to post

I read post #41 twice before replying, because I had assumed the opposite.

Composite endpoints should be read component by component. A composite driven entirely by its softest component is a different finding from one where the components move together.

Take the reasoning and check the arithmetic; I do not always get it right.

3 likes in reply to #13 9mo
SO
s.okonkwoTL226 Oct 2025#46

Post #45 answers the question as asked. The question underneath it is different.

Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.

That holds under the stated conditions and I have stated them.

0 likes 9mo
GH
g.haalandTL3Regular28 Oct 2025#47

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

Same conclusion as the reply above, reached differently, which is mildly reassuring.

32 likes 9mo
TV
to.vargaTL230 Oct 2025#48
appeals_desk, post #24: The arithmetic in post #23 is right; the assumption feeding it is the part to check. Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers. Go to post

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

That is what I would do. It may not be what is correct.

17 likes in reply to #24 9mo
CI
citation_indexTL2Member2 Nov 2025#49

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

1 like 9mo
PF
p.fontaineTL24 Nov 2025#50

Post #49 answers the question as asked. The question underneath it is different.

Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.

0 likes 9mo
PN
p.novotnyTL2Regular6 Nov 2025#51
p.diallo, post #2: Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting. Go to post

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

I have separated what I observed from what I concluded, which does not always happen.

12 likes in reply to #2 9mo
FH
f.haddadTL28 Nov 2025#52
i.bakken, post #14: Coming back to post #10, because the follow-up matters more than the original answer. Composite endpoints should be read component by component. A composite driven entirely by its softest component is a different finding from one where the components move together. This has been discussed before and I could not find the thread, so, again. Go to post

Where I part company with post #50, and it is a narrow parting.

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

I would treat the number as indicative rather than as a measurement.

25 likes in reply to #14 9mo
UC
unit_conversionTL3Regular10 Nov 2025#53

Adding the measurement that post #52 says would settle it.

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

0 likes 9mo
MB
m.balogunTL212 Nov 2025#54

Second this, and I would have said it less carefully.

1 like 8mo
QZ
q.zhao_qaTL3Quality assurance14 Nov 2025#55
t.karlsen, post #8: Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit. On balance I think that is right, and I would not bet much on it. Go to post

Confirming post #52 from a second method, which matters more than confirming it from a second person.

Discontinuation handling is the methodological detail that most changes a result and gets the least attention. Read how missing data was imputed before reading the effect size.

Reporting the observation and leaving the explanation open deliberately.

7 likes in reply to #8 8mo
IL
i.lehtinenTL216 Nov 2025#56
p.ostergaard, post #20: Answering the question post #18 raises rather than the one it answers. Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit. Not the answer, but possibly the question that gets there. Go to post

I had written a reply contradicting post #55 and deleted it. Here is what survived.

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

18 likes in reply to #20 8mo
KO
k.otieno_statsTL318 Nov 2025#57
ES
e.steinerTL220 Nov 2025#58

A treatment-policy estimand asks what happens to people assigned to a strategy, including those who abandon it. A hypothetical estimand asks what would have happened had everyone continued. Both are legitimate and they give different numbers.

That is where I would start, not where I would stop.

0 likes 8mo
LP
l.parkinsonTL2Member22 Nov 2025#59

Post #56 is right about the mechanism and I think understates the practical bit.

Absolute and relative effects answer different questions. Write down the event rate in each arm and the difference between them; everything quotable is derived from those two numbers.

4 likes 8mo
SD
s.demirTL224 Nov 2025#60
ppm_error, post #28: Narrowing post #27, because the general version has more than one answer. Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not),… Go to post

Absolute numbers, not just relative: a 30% relative reduction tells you the ratio but not the practical magnitude. The event rate in each arm and the difference between them tells you how many people benefit.

12 likes in reply to #28 8mo