Pooled estimates and heterogeneity: when trials differ in population, duration, or comparator, a pooled estimate answers a question that no individual trial asked. High heterogeneity means effects genuinely differ across studies. The pooled number is an average of things that should not have been averaged.
Pooling trials with different estimands — what changed since posts 61–65
This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.
On post #59 — agreed on the reasoning, with one qualification.
Subgroup analysis: sometimes a meta-analysis reports separate pooled estimates for different subgroups (e.g., by baseline body mass index or by trial duration). Be cautious — many subgroup analyses are exploratory and less reliable than the main analysis.
post #63 answers the question as asked. The question underneath it is different.
When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.
Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.
This topic was referenced in
- When a network meta-analysis is defensible and when it is notEvidence › Meta-analyses · 2 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Second pass at: What pooling buys you and what it destroys
Posting this under the heading it deserves: Second pass at: What pooling buys you and what it destroys Everything below is what sits behind that. I have seen STEP 8 ( JAMA , 2022) cited in support of a claim…
|
+32 | 36 | 19k | 4mo |
|
Second pass at: When a network meta-analysis is defensible and when it is not
Posting this under the heading it deserves: Second pass at: When a network meta-analysis is defensible and when it is not Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with LEADER…
|
2 | 2.8k | 21mo | |
|
Second pass at: A pooled estimate that changed when one trial was added
On the subject in the title: Second pass at: A pooled estimate that changed when one trial was added Working notes rather than a conclusion. Session topic: SELECT ( N Engl J Med , 2023). Please read it before…
|
+26 | 30 | 22k | 1mo |
|
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
|
+74 | 83 | 6.6k | 8mo |
|
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it…
|
+95 | 106 | 20k | 17mo |
Related topics — sharing the tags publication bias, risk of bias, meta-analysis
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Retatrutide's phase 2 heart-rate signal and how to think about it
On the subject in the title: Retatrutide's phase 2 heart-rate signal and how to think about it Working notes rather than a conclusion. I have seen PIONEER 6 ( N Engl J Med , 2019) cited in support of a claim…
|
+19 | 23 | 20k | 7mo |
|
Critiquing an observational claim about a class effect — one year on
Critiquing an observational claim about a class effect — one year on — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim…
|
+5 | 9 | 3.2k | 8mo |
|
Regression to the mean in progress reports
On the subject in the title: Regression to the mean in progress reports Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the discussion…
|
+30 | 34 | 49k | 12mo |
|
About the Statistics category
Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
|
+4 | 8 | 2.3k | 7mo |
|
Journal club: SELECT, absolute risk, and how it was reported — a second dataset
On the subject in the title: Journal club: SELECT, absolute risk, and how it was reported — a second dataset Working notes rather than a conclusion. Comparing SURMOUNT-1 ( N Engl J Med , 2022) with SELECT ( N…
|
4 | 1.3k | 1mo |