High heterogeneity is the finding rather than a nuisance to be minimised. If the effect genuinely differs across settings, an average of those settings is an average of things that should not have been averaged.
Heterogeneity as information rather than as a nuisance posts 91–96
This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.
Building on post #89 rather than restating it.
Careful with the language on heterogeneity. "Not detected" and "not present" are different findings and the first is a statement about the method.
Having read the whole heterogeneity thread before replying: the question in the first post has not actually been answered yet, and three of us have answered a nearby one instead.
Double extraction with disagreement resolution is standard and is worth checking for, because single extraction errors are common and non-random.
Post #93 and I disagree about the size of the effect, not about the direction.
The thing about heterogeneity that took me longest to accept is that a plausible mechanism is not evidence of an effect. It is a reason to look, not a result.
Adding thanks rather than a view. I do not have a view worth the space.
This topic was referenced in
- Coming back to: Reading a meta-analysis you disagree with, fairlyEvidence › Meta-analyses · 34 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
About the Meta-analyses category
Pooled estimates, heterogeneity, publication bias, and when pooling was a mistake. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author…
|
4 | 15k | 13mo | |
|
Revisiting: What pooling buys you and what it destroys
On the subject in the title: Revisiting: What pooling buys you and what it destroys Working notes rather than a conclusion. Pooling buys — I have the observation and I do not trust my interpretation of it, so…
|
+97 | 107 | 4k | 19h |
|
Coming back to: Reading a meta-analysis you disagree with, fairly
Reading a meta-analysis you disagree with, fairly Writing it up because I had to work it out twice and would rather nobody else did. Reading a meta-analysis — I have the observation and I do not trust my…
|
+30 | 34 | 9.3k | 17mo |
|
Pooling trials with different estimands — what changed since
Pooling trials with different estimands — what changed since — setting out what I have, and where I think it stops being reliable. What changes if the standard account of Pooling trials with different…
|
+57 | 64 | 12k | 7mo |
|
Individual participant data versus aggregate data
Posting this under the heading it deserves: Individual participant data versus aggregate data Everything below is what sits behind that. Something about individual participant data versus aggregate does not…
|
+30 | 34 | 64k | 14mo |
Related topics — sharing the tags heterogeneity, risk of bias, meta-analysis
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Is there a ceiling dose beyond which semaglutide stops adding benefit?
Is there a ceiling dose beyond which semaglutide stops adding benefit? I have a specific reason for asking rather than idle curiosity, and the context is below. Putting the numbers in the first post, because…
|
2 | 14k | 2mo | |
|
About the Statistics category
Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
|
+4 | 8 | 2.3k | 7mo |
|
Sample size intuition for a personal experiment
On the subject in the title: Sample size intuition for a personal experiment Working notes rather than a conclusion. A follow-up question about sample size intuition that I did not know to ask the first time.…
|
4 | 62k | 18mo | |
|
The "under review" status pill and when a moderator applies it
Posting this under the heading it deserves: The "under review" status pill and when a moderator applies it Everything below is what sits behind that. A question about how this site should cite something that…
|
+96 | 119 | 17k | 3mo |
|
Measurement error in home scales, with a worked standard deviation — a second dataset
Measurement error in home scales, with a worked standard deviation — a second dataset — setting out what I have, and where I think it stops being reliable. Posting a small dataset on Measurement error in home…
|
2 | 13k | 7mo |