Evidence · Study critique

Coming back to: A critique that turned out to be unfair, retracted by its author

Evidence › Study critique disputed observational data effect size confounding risk of bias

Closed

i.amankwahTL222 Mar 2025#1

A critique that turned out to be unfair, retracted by its author — setting out what I have, and where I think it stops being reliable.

Reading back through what has been written here about critique, three questions come up every time and only one has ever been answered properly.

Listing all three, with what I think the state of the answer is for each, so the thread can start further along than the last one did.

36 likes 16mo

quiet_lurkerTL2Regular23 Apr 2025#2

That is a cleaner way of putting what I was circling around.

8 likes 15mo

j.bhattacharyaTL215 May 2025 · edited#3

i.amankwah, post #1: A critique that turned out to be unfair, retracted by its author — setting out what I have, and where I think it stops being reliable. Reading back through what has been written here about critique, three questions come up every time and only one has ever been answered properly. Listing all three, with what I think the state of the… Go to post

The strongest critiques cite the section they rely on. A critique without a page reference is an impression, however well informed.

Anyone with a larger sample, please post it.

2 likes in reply to #1 14mo

This topic was referenced in

Criticising the method without criticising the authorsEvidence › Study critique · 61 replies
Coming back to: A structured critique template this community usesEvidence › Study critique · 69 replies
[2026 update] Confounding by indication, explained with a concrete exampleEvidence › Study critique · 116 replies
Coming back to: Measurement error in a self-reported exposureEvidence › Study critique · 27 replies

This topic was closed 90 days after the last reply. Closing is automatic for quiet topics so that a settled answer does not collect new questions underneath it. If you have a follow-up, open a new topic and link back to this one — that keeps both readable and gives your question its own title.

Suggested topics

Topic	Participants	Replies	Views	Activity
A well-designed study with a badly written abstract — does this still hold? Evidence › Study critique disputed confounding risk of bias Solved Closed A well-designed study with a badly written abstract — does this still hold? I have a specific reason for asking rather than idle curiosity, and the context is below. Asking about well-designed study on behalf…		2	28k	20mo
Critiquing an observational claim about a class effect Evidence › Study critique disputed risk of bias effect size observational data Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that. I was wrong about critiquing an observational claim in a thread…		2	6.9k	14mo
A claim built entirely on a subgroup analysis — what changed since Evidence › Study critique disputed effect size observational data risk of bias Closed On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion. What changes if the standard account of claim built is wrong? I ask…		2	2k	18mo
Reverse causation in a cohort study of weight and outcome — a second dataset Evidence › Study critique risk of bias observational data confounding Reverse causation in a cohort study of weight and outcome — a second dataset Writing it up because I had to work it out twice and would rather nobody else did. Posting a small dataset on Reverse causation. It…	+112	131	1.5k	10mo
Immortal time bias in a claims-database study Evidence › Study critique risk of bias observational data disputed confounding Closed Immortal time bias in a claims-database study — setting out what I have, and where I think it stops being reliable. Asking about immortal time bias directly, because I have read four threads on it and each…	+29	34	28k	11mo

Related topics — sharing the tags disputed, observational data, effect size

Topic	Participants	Replies	Views	Activity
Coming back to: What the published dose-response for semaglutide actually looks like above 2.4 mg Compounds › Semaglutide effect size type 2 diabetes semaglutide STEP programme Solved The question in the title: What the published dose-response for semaglutide actually looks like above 2.4 mg I will give what I have already checked below so nobody repeats it. I would like to know what…	+23	27	9.9k	1mo
Distinguishing a red flag from an inconvenience Sourcing › Red flags mislabelling documentation quality moderation underdosing Solved Distinguishing a red flag from an inconvenience — setting out what I have, and where I think it stops being reliable. Something about distinguishing a red flag does not reconcile and I would like a second…		2	38k	6mo
Heterogeneity as information rather than as a nuisance Evidence › Meta-analyses heterogeneity risk of bias meta-analysis effect size Posting this under the heading it deserves: Heterogeneity as information rather than as a nuisance Everything below is what sits behind that. An honest uncertainty about heterogeneity rather than a disguised…	+88	95	1.2k	6mo
Evidence quality in the secretagogue literature: an honest assessment Compounds › Secretagogues & GH axis ipamorelin observational data GHRP class tesamorelin Solved Evidence quality in the secretagogue literature: an honest assessment Writing it up because I had to work it out twice and would rather nobody else did. I have spent a fortnight trying to pin evidence quality…		2	25k	9d
Correlation in a self-tracked dataset: what it can support Research Methods › Statistics effect size heterogeneity worked example number needed to treat Closed Correlation in a self-tracked dataset: what it can support — setting out what I have, and where I think it stops being reliable. Posting a small dataset on correlation. It is mine, it is uncontrolled, and the…	+152	166	48k	23mo

Sponsored Sigma-Aldrich — certified reference materialsReference standards, analytical reagents and certified materials for method calibration. If you are validating a method, this is where the standard comes from.Reference standards →