Evidence · Study critique · continued

Criticising the method without criticising the authors posts 61–62

Evidence › Study critique disputed observational data confounding effect size

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

b.oseiTL23 May 2025#61

Multiple comparisons without adjustment is a defensible choice when declared in advance and a problem when discovered afterwards. The registry entry settles which happened.

The step people skip is the one I have spelled out.

0 likes 15mo

k.radichTL26 May 2025#62

Collapsed as off-topic by two members at trust level 3 or above

Adding the measurement that post #61 says would settle it.

Worth stating the null on criticising the method without criticising before we explain it: the observation may be nothing. That possibility deserves a sentence and usually does not get one.

Suggested topics

Topic	Participants	Replies	Views	Activity
About the Study critique category Evidence › Study critique risk of bias confounding observational data Pinned Wiki Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…		4	114	16mo
A well-designed study with a badly written abstract Evidence › Study critique disputed effect size risk of bias observational data Posting this under the heading it deserves: A well-designed study with a badly written abstract Everything below is what sits behind that. Reading back through what has been written here about well-designed…	+117	128	7.2k	14mo
A structured critique template this community uses — a second dataset Evidence › Study critique observational data effect size confounding Solved On the subject in the title: A structured critique template this community uses — a second dataset Working notes rather than a conclusion. Posting a small dataset on structured critique template. It is mine,…	+47	51	16k	15h
Criticising the method without criticising the authors — one year on Evidence › Study critique confounding effect size disputed risk of bias Solved Closed On the subject in the title: Criticising the method without criticising the authors — one year on Working notes rather than a conclusion. A methods question rather than a substantive one, about Criticising…	+16	20	61k	11mo
A critique that turned out to be unfair, retracted by its author Evidence › Study critique confounding risk of bias effect size observational data Wiki Posting this under the heading it deserves: A critique that turned out to be unfair, retracted by its author Everything below is what sits behind that. Critique, and specifically the version of it that the…	+34	38	20k	17h

Related topics — sharing the tags disputed, observational data, confounding

Topic	Participants	Replies	Views	Activity
Aggregated purity results across four services, with caveats Data & Tools › Datasets observational data site feedback data table Posting this under the heading it deserves: Aggregated purity results across four services, with caveats Everything below is what sits behind that. Aggregated purity results across four, from the point of…		3	24k	9mo
Selection into a registry and what it does to the estimate Evidence › Study critique risk of bias disputed observational data Selection into a registry and what it does to the estimate — setting out what I have, and where I think it stops being reliable. Working notes on selection rather than a conclusion. I would rather post the…		2	55k	7mo
Journal club: STEP 3 and the intensive behavioural therapy floor Evidence › Journal club randomised trial journal club effect size risk of bias Posting this under the heading it deserves: Journal club: STEP 3 and the intensive behavioural therapy floor Everything below is what sits behind that. Two things I would like separated before anyone answers…	+6	10	13k	28d
What I would record differently if I started again Outcomes › Progress reports DXA long read data table effect size Closed Asking directly, because I could not find a straight answer: What I would record differently if I started again Asking about the phase almost nobody writes about. The material here on losing is good. The…		2	12k	5mo
Tirzepatide in obstructive sleep apnoea: reading SURMOUNT-OSA Compounds › Tirzepatide SURMOUNT programme tirzepatide randomised trial effect size Posting this under the heading it deserves: Tirzepatide in obstructive sleep apnoea: reading SURMOUNT-OSA Everything below is what sits behind that. Reading back through what has been written here about…	+4	8	14k	8mo