The figure that circulates in coverage is almost always whichever estimand gives the larger effect. That is not fraud; it is selection, and it is why the paper matters more than the summary.
Second pass at: Trial registration and comparing the protocol with the paper
Post #14 put the caveat in the right place and I want to underline it.
Multiplicity and multiple comparisons: if a trial tests many hypotheses, the chance of a false positive on at least one by random chance increases. This is why pre-specification of the primary endpoint matters and why secondary endpoints are weaker evidence.
The evidence for this is thinner than the way I have phrased it suggests.
Effect sizes in a trial population reflect adherence achieved under trial conditions, which is generally better than adherence outside them.
Picking up post #26: that is the part I would want checked first.
Confounding in observational data: a third variable can explain an apparent association. In a randomised trial, randomisation balances unknown confounders. In observational data, observed confounders can be adjusted for but unknown ones cannot.
I would be interested in a counterexample if anyone has one.
Trial duration determines what can be observed. A weight-change trajectory at 40 weeks and at 72 weeks are different observations and both get quoted as the result.
Read the full topic (35 posts)
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Coming back to: Sample size calculations, read backwards from the published number
On the subject in the title: Sample size calculations, read backwards from the published number Working notes rather than a conclusion. Sample size calculations — I have the observation and I do not trust my…
|
+82 | 88 | 1.8k | 11mo |
|
Adjudicated events and why the definition matters — the long version
Adjudicated events and why the definition matters — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Adjudicated events, deliberately…
|
+125 | 146 | 13k | 15mo |
|
Primary endpoint hierarchies and why order matters — one year on
On the subject in the title: Primary endpoint hierarchies and why order matters — one year on Working notes rather than a conclusion. A follow-up question about Primary endpoint hierarchies that I did not…
|
+56 | 61 | 37k | 11h |
|
Run-in periods and the population they select — the long version
Run-in periods and the population they select — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Run-in periods, deliberately narrow,…
|
2 | 8.9k | 4mo | |
|
Subgroup analyses: pre-specified versus discovered — a second dataset
On the subject in the title: Subgroup analyses: pre-specified versus discovered — a second dataset Working notes rather than a conclusion. Posting a small dataset on Subgroup analyses. It is mine, it is…
|
+71 | 79 | 906 | 3mo |
Related topics — sharing the tags estimand, discontinuation & dropout, randomised trial
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
The C-cell question: rodent findings and their human context — what changed since
The C-cell question: rodent findings and their human context — what changed since — setting out what I have, and where I think it stops being reliable. What changes if the standard account of c-cell question…
|
+61 | 65 | 1.3k | 22mo |
|
Journal club: orforglipron phase 2 and the non-peptide question
Journal club: orforglipron phase 2 and the non-peptide question Writing it up because I had to work it out twice and would rather nobody else did. Orforglipron phase 2, and specifically the version of it that…
|
+120 | 132 | 13k | 1d |
|
Tracking semaglutide's approved indications across jurisdictions, dated — does this still hold?
Tracking semaglutide's approved indications across jurisdictions, dated — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Practical question…
|
+58 | 62 | 49k | 20mo |
|
Why fasting instructions for oral semaglutide are not optional advice — does this still hold?
Asking directly, because I could not find a straight answer: Why fasting instructions for oral semaglutide are not optional advice — does this still hold? A methods question rather than a substantive one,…
|
+98 | 106 | 3.1k | 10mo |
|
Tirzepatide in type 2 diabetes: the SURPASS programme, summarised honestly
Tirzepatide in type 2 diabetes: the SURPASS programme, summarised honestly — setting out what I have, and where I think it stops being reliable. I have spent a fortnight trying to pin tirzepatide in type 2…
|
+150 | 163 | 22k | 11mo |