The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Topic summary

Pooling trials with different estimands — what changed since

This is a generated summary. It shows the 9 most-liked posts from a topic of 65, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
ML
m.lindqvistTL2 Moderator12 Jul 2025#3

Worth separating two things that the opening post runs together.

Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.

32 likes 13mo
RM
ra.mensaTL2 Moderator30 Jul 2025#8

I disagree with the reply above, and I think the disagreement is substantive rather than terminological.

The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.

23 likes 12mo
JP
j.petrovTL2 Moderator20 Aug 2025#15

Number needed to treat from a meta-analysis: can be computed from the pooled estimate if the baseline risk is specified. More interpretable than pooled relative effects.

28 likes 11mo
MH
ms_hollowayTL4Mass spectrometrist21 Sep 2025#27

Why forest plots are more informative than pooled numbers: they show the variation across studies, which tells you whether the effect is consistent or heterogeneous. A narrow confidence interval around a meaningless centre is less useful than a wider interval that shows real differences.

31 likes 10mo
CC
c.correiaTL2 Moderator3 Oct 2025#32

On post #28 — agreed on the reasoning, with one qualification.

Two things before anyone answers the substance.

First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound.

32 likes 10mo
SO
sa.okonkwoTL2 Moderator10 Oct 2025#35

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

23 likes 10mo
DV
d.vestergaardTL2 Moderator24 Oct 2025#41

On post #37 — agreed on the reasoning, with one qualification.

Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.

24 likes 9mo
RP
r.petrovTL2 Moderator23 Nov 2025#55

This follows post #52 rather than contradicting it.

Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.

26 likes 8mo
AW
a.wikstromTL2 Moderator11 Dec 2025#64

post #63 answers the question as asked. The question underneath it is different.

When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.

24 likes 8mo

Read the full topic (65 posts)

Suggested topics

TopicParticipantsRepliesViewsActivity
Second pass at: What pooling buys you and what it destroys
Posting this under the heading it deserves: Second pass at: What pooling buys you and what it destroys Everything below is what sits behind that. I have seen STEP 8 ( JAMA , 2022) cited in support of a claim…
MHCCYMRMBJ+32 36 19k 4mo
Second pass at: When a network meta-analysis is defensible and when it is not
Posting this under the heading it deserves: Second pass at: When a network meta-analysis is defensible and when it is not Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with LEADER…
LSOID 2 2.8k 21mo
Second pass at: A pooled estimate that changed when one trial was added
On the subject in the title: Second pass at: A pooled estimate that changed when one trial was added Working notes rather than a conclusion. Session topic: SELECT ( N Engl J Med , 2023). Please read it before…
FLSTYAWNRM+26 30 22k 1mo
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
MDEHDHPMNA+74 83 6.6k 8mo
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it…
NCJVSDBSEF+95 106 20k 17mo

Related topics — sharing the tags publication bias, risk of bias, meta-analysis

TopicParticipantsRepliesViewsActivity
Retatrutide's phase 2 heart-rate signal and how to think about it
On the subject in the title: Retatrutide's phase 2 heart-rate signal and how to think about it Working notes rather than a conclusion. I have seen PIONEER 6 ( N Engl J Med , 2019) cited in support of a claim…
MVBERMBJER+19 23 20k 7mo
Critiquing an observational claim about a class effect — one year on
Critiquing an observational claim about a class effect — one year on — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim…
FELDKRAWDO+5 9 3.2k 8mo
Regression to the mean in progress reports
On the subject in the title: Regression to the mean in progress reports Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the discussion…
HAAMTFAVDM+30 34 49k 12mo
About the Statistics category
Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
SLJMBVCAV+4 8 2.3k 7mo
Journal club: SELECT, absolute risk, and how it was reported — a second dataset
On the subject in the title: Journal club: SELECT, absolute risk, and how it was reported — a second dataset Working notes rather than a conclusion. Comparing SURMOUNT-1 ( N Engl J Med , 2022) with SELECT ( N…
VKJBFNAITH 4 1.3k 1mo