The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Topic summary

Heterogeneity as information rather than as a nuisance

This is a generated summary. It shows the 9 most-liked posts from a topic of 96, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
SR
sa.rasmussenTL2 Moderator24 Nov 2025#7

Picking up post #4: that is the part I would want checked first.

Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.

29 likes 8mo
SG
s.grigorescuTL2Member5 Dec 2025#16
Norrington, post #4: I read the opening post twice before replying, because I had assumed the opposite. Having read the exchange above, I think I was wrong earlier in this topic and I want to say so plainly rather than quietly editing. The correction was fair and I had been repeating something I had not checked carefully enough. Go to post

Thank you for the correction. I have edited my earlier post with a note rather than silently, so the thread still makes sense to read. The error was mine and it was the kind that comes from remembering a figure instead of looking it up.

28 likes in reply to #4 8mo
IA
id.almeidaTL2 Moderator10 Dec 2025#21

This follows post #18 rather than contradicting it.

Pooled estimates and heterogeneity: when trials differ in population, duration, or comparator, a pooled estimate answers a question that no individual trial asked. High heterogeneity means effects genuinely differ across studies. The pooled number is an average of things that should not have been averaged.

30 likes 8mo
CB
careful_beginnerTL1Member24 Dec 2025#36

post #35 answers the question as asked. The question underneath it is different.

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

32 likes 7mo
JH
j.habermannTL3Regular27 Dec 2025#40

When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.

24 likes 7mo
DA
d.achebeTL2 Moderator9 Jan 2026#55

I read post #53 twice before replying, because I had assumed the opposite.

Having read the exchange above, I think I was wrong earlier in this topic and I want to say so plainly rather than quietly editing.

The correction was fair and I had been repeating something I had not checked carefully enough.

32 likes 7mo
L
LJankowiakTL3Regular16 Jan 2026#64
g.tamm, post #13: Worth separating two things that post #9 runs together. When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate. Go to post

Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.

27 likes in reply to #13 6mo
EN
electrolyte_notesTL2Regular29 Jan 2026#81

post #80 answers the question as asked. The question underneath it is different.

Study quality and weighting: some meta-analyses weight all studies equally; others weight by study size or study quality. The choice affects the result and should be stated and justified.

31 likes 6mo
ED
e.dalgleishTL3Regular8 Feb 2026#95
DOdendaal, post #1: Posting this under the heading it deserves: Heterogeneity as information rather than as a nuisance Everything below is what sits behind that. Session topic: SCALE ( N Engl J Med , 2015). Please read it before posting; the discussion is much better when everyone has. The question I would like us to start with is what the trial set out to… Go to post

Coming back to post #93, because the follow-up matters more than the original answer.

When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.

29 likes in reply to #1 6mo

Read the full topic (96 posts)

Suggested topics

TopicParticipantsRepliesViewsActivity
About the Meta-analyses category
Pooled estimates, heterogeneity, publication bias, and when pooling was a mistake. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author…
SLDOERZSIT 4 15k 13mo
Revisiting: What pooling buys you and what it destroys
On the subject in the title: Revisiting: What pooling buys you and what it destroys Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the…
JWZAEFIGGF+97 107 4k 19h
Coming back to: Reading a meta-analysis you disagree with, fairly
Reading a meta-analysis you disagree with, fairly Writing it up because I had to work it out twice and would rather nobody else did. I have seen STEP 1 ( N Engl J Med , 2021) cited in support of a claim I do…
TVBDJIPMCT+30 34 9.3k 17mo
Pooling trials with different estimands — what changed since
Pooling trials with different estimands — what changed since — setting out what I have, and where I think it stops being reliable. Comparing STEP 4 ( JAMA , 2021) with SURPASS-4 ( Lancet , 2021) and finding…
BERRMLDYAW+57 64 12k 7mo
Individual participant data versus aggregate data
Posting this under the heading it deserves: Individual participant data versus aggregate data Everything below is what sits behind that. Session topic: SCALE ( N Engl J Med , 2015). Please read it before…
EAKBTEMAK+30 34 64k 14mo

Related topics — sharing the tags heterogeneity, risk of bias, meta-analysis

TopicParticipantsRepliesViewsActivity
Is there a ceiling dose beyond which semaglutide stops adding benefit?
Is there a ceiling dose beyond which semaglutide stops adding benefit? I have a specific reason for asking rather than idle curiosity, and the context is below. I have seen SURPASS-4 ( Lancet , 2021) cited in…
NHAVBT 2 14k 2mo
About the Statistics category
Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
SLJMBVCAV+4 8 2.3k 7mo
Sample size intuition for a personal experiment
On the subject in the title: Sample size intuition for a personal experiment Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before posting; the discussion is…
RKHECAHTT 4 62k 18mo
The "under review" status pill and when a moderator applies it
Posting this under the heading it deserves: The "under review" status pill and when a moderator applies it Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024). Please read it…
NLAMDOVRV+96 119 17k 3mo
Measurement error in home scales, with a worked standard deviation — a second dataset
Measurement error in home scales, with a worked standard deviation — a second dataset — setting out what I have, and where I think it stops being reliable. Comparing FLOW ( N Engl J Med , 2024) with SURPASS-2…
AKKSA 2 13k 7mo