The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Topic summary

Follow-up: Individual participant data versus aggregate data

This is a generated summary. It shows the 9 most-liked posts from a topic of 112, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
NN
n.norgaardTL2 Moderator7 Jan 2025#8

Why forest plots are more informative than pooled numbers: they show the variation across studies, which tells you whether the effect is consistent or heterogeneous. A narrow confidence interval around a meaningless centre is less useful than a wider interval that shows real differences.

29 likes 19mo
PN
p.novotnyTL2Regular8 Jan 2025#16
n.norgaard, post #8: Why forest plots are more informative than pooled numbers: they show the variation across studies, which tells you whether the effect is consistent or heterogeneous. A narrow confidence interval around a meaningless centre is less useful than a wider interval that shows real differences. Go to post

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

28 likes in reply to #8 19mo
MA
m.almeidaTL2 Moderator8 Jan 2025#26
q.zhao_qa, post #20: Two things before anyone answers the substance. First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound. Go to post

When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.

32 likes in reply to #20 19mo
CL
coldchain_liuTL3Regular10 Jan 2025#56
m.duarte, post #7: Publication bias: what did not get published? Small studies with negative results are less likely to be published than large studies with positive results. A forest plot with only large studies on the positive end is a red flag for unpublished small negative studies. Go to post

Coming back to post #54, because the follow-up matters more than the original answer.

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

30 likes in reply to #7 19mo
FP
f.petrovTL2 Moderator10 Jan 2025#64

post #63 is right about the mechanism and I think understates the practical bit.

Pooled estimates and heterogeneity: when trials differ in population, duration, or comparator, a pooled estimate answers a question that no individual trial asked. High heterogeneity means effects genuinely differ across studies. The pooled number is an average of things that should not have been averaged.

32 likes 19mo
VS
v.salgadoTL2 Moderator10 Jan 2025 · edited#69

Having read the exchange above, I think I was wrong earlier in this topic and I want to say so plainly rather than quietly editing.

The correction was fair and I had been repeating something I had not checked carefully enough.

30 likes 19mo
NV
n.vukovicTL2 Moderator11 Jan 2025#75
r.lundgren, post #22: Study quality and weighting: some meta-analyses weight all studies equally; others weight by study size or study quality. The choice affects the result and should be stated and justified. Go to post

When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.

32 likes in reply to #22 19mo
NM
n.moreauTL2 Moderator11 Jan 2025#85

Worth separating two things that post #81 runs together.

Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.

30 likes 19mo
ZS
z.szaboTL2 Moderator12 Jan 2025 · edited#111
a.weiss, post #59: Number needed to treat from a meta-analysis: can be computed from the pooled estimate if the baseline risk is specified. More interpretable than pooled relative effects. Go to post

On post #107 — agreed on the reasoning, with one qualification.

Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.

32 likes in reply to #59 18mo

Read the full topic (112 posts)

Suggested topics

TopicParticipantsRepliesViewsActivity
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
MDEHDHPMNA+74 83 6.6k 8mo
About the Meta-analyses category
Pooled estimates, heterogeneity, publication bias, and when pooling was a mistake. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author…
SLDOERZSIT 4 15k 13mo
Second pass at: When a network meta-analysis is defensible and when it is not
Posting this under the heading it deserves: Second pass at: When a network meta-analysis is defensible and when it is not Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with LEADER…
LSOID 2 2.8k 21mo
Reading a meta-analysis you disagree with, fairly
Posting this under the heading it deserves: Reading a meta-analysis you disagree with, fairly Everything below is what sits behind that. I have seen SURPASS-2 ( N Engl J Med , 2021) cited in support of a…
SOHNPOLASD+7 13 2.5k 23mo
Revisiting: What pooling buys you and what it destroys
On the subject in the title: Revisiting: What pooling buys you and what it destroys Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the…
JWZAEFIGGF+97 107 4k 19h

Related topics — sharing the tags meta-analysis, effect size, publication bias

TopicParticipantsRepliesViewsActivity
Second pass at: Triple agonism: additive, synergistic, or neither?
Second pass at: Triple agonism: additive, synergistic, or neither? — that is the question, and I have not found it answered plainly anywhere I have looked. I have seen STEP 8 ( JAMA , 2022) cited in support…
KHALBDSBBO+114 120 1.4k 10mo
SURMOUNT-4 and what withdrawal data does and does not tell an individual — one year on
Posting this under the heading it deserves: SURMOUNT-4 and what withdrawal data does and does not tell an individual — one year on Everything below is what sits behind that. Comparing SURPASS-2 ( N Engl J Med…
GOGTMMDSRM+122 136 48k 9mo
[2026 update] Heterogeneity as information rather than as a nuisance
Heterogeneity as information rather than as a nuisance Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a claim I…
PSGCCFDCL 4 32k 11mo
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURMOUNT-OSA ( N Engl J Med ,…
AWFLAWCFZL+81 90 54k 9mo
Multiplicity when you track fifteen variables
Multiplicity when you track fifteen variables — setting out what I have, and where I think it stops being reliable. Comparing LEADER ( N Engl J Med , 2016) with SURMOUNT-OSA ( N Engl J Med , 2024) and finding…
JATNNA 2 60k 11mo