Fixed-effects versus random-effects models: fixed-effects assumes all studies are estimating the same thing and variation is sampling error. Random-effects assumes studies are estimating effects from different distributions and allows between-study variance. Choice matters if heterogeneity is high.
Risk-of-bias tools and the judgement they conceal
post #5 is right about the mechanism and I think understates the practical bit.
Publication bias: what did not get published? Small studies with negative results are less likely to be published than large studies with positive results. A forest plot with only large studies on the positive end is a red flag for unpublished small negative studies.
On post #5 — agreed on the reasoning, with one qualification.
Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.
Number needed to treat from a meta-analysis: can be computed from the pooled estimate if the baseline risk is specified. More interpretable than pooled relative effects.
This follows post #10 rather than contradicting it.
Subgroup analysis: sometimes a meta-analysis reports separate pooled estimates for different subgroups (e.g., by baseline body mass index or by trial duration). Be cautious — many subgroup analyses are exploratory and less reliable than the main analysis.
Read the full topic (13 posts)
This topic was referenced in
- Pooling trials with different estimandsEvidence › Meta-analyses · 132 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
|
+74 | 83 | 6.6k | 8mo |
|
Coming back to: Prediction intervals and why they are more honest than confidence intervals
Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURMOUNT-OSA ( N Engl J Med , 2024)…
|
2 | 65 | 22mo | |
|
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Comparing SUSTAIN 6 ( N Engl J Med , 2016) with LEADER (…
|
2 | 27k | 4h | |
|
Follow-up: Individual participant data versus aggregate data
Individual participant data versus aggregate data — setting out what I have, and where I think it stops being reliable. Comparing LEADER ( N Engl J Med , 2016) with SURPASS-4 ( Lancet , 2021) and finding the…
|
+101 | 111 | 23k | 18mo |
|
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it…
|
+95 | 106 | 20k | 17mo |
Related topics — sharing the tags meta-analysis, heterogeneity, publication bias
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Comparing SUSTAIN 6 ( N Engl J Med , 2016) with LEADER (…
|
2 | 27k | 4h | |
|
[2026 update] Journal club: is percentage weight change the right endpoint?
Journal club: is percentage weight change the right endpoint? — that is the question, and I have not found it answered plainly anywhere I have looked. Comparing SURPASS-2 ( N Engl J Med , 2021) with…
|
+105 | 118 | 18k | 11mo |
|
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURMOUNT-OSA ( N Engl J Med ,…
|
+81 | 90 | 54k | 9mo |
|
Measurement error in home scales, with a worked standard deviation
Measurement error in home scales, with a worked standard deviation Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURPASS-4 ( Lancet , 2021) with STEP 1 ( N Engl…
|
+26 | 31 | 4.3k | 4mo |
|
Journal club: STEP 8 and the fairness of the comparator dose — a second dataset
Posting this under the heading it deserves: Journal club: STEP 8 and the fairness of the comparator dose — a second dataset Everything below is what sits behind that. Session topic: SURPASS-2 ( N Engl J Med ,…
|
+18 | 22 | 656 | 13h |