The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique

A claim built entirely on a subgroup analysis — what changed since

Closed
AW
a.weissTL2 Moderator7 Jan 2025#1

On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion.

I have seen PIONEER 6 (N Engl J Med, 2019) cited in support of a claim I do not think it supports, twice this month, so I would like to work through what it actually shows.

My reading is that the trial is sound for its own question and is being stretched to answer a different one. I might be wrong about that, which is why this is a topic rather than a correction.

What I would like from this discussion: someone who disagrees with me to say why, with the section of the paper they are relying on.

36 likes 19mo
ZC
z.cardosoTL2 Moderator23 Jan 2025 · edited#2

Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.

0 likes 18mo
QZ
q.zhao_qaTL3Quality assurance3 Feb 2025#3

post #2 is right about the mechanism and I think understates the practical bit.

Bias towards the null and bias away from the null: different criticisms have different directions. Differential dropout might bias away from null; conservative statistical analysis might bias toward null.

0 likes 18mo
This topic was closed 60 days after the last reply. Closing is automatic for quiet topics so that a settled answer does not collect new questions underneath it. If you have a follow-up, open a new topic and link back to this one — that keeps both readable and gives your question its own title.

Suggested topics

TopicParticipantsRepliesViewsActivity
A structured critique template this community uses
A structured critique template this community uses — setting out what I have, and where I think it stops being reliable. Comparing SURMOUNT-2 ( Lancet , 2023) with SURPASS-4 ( Lancet , 2021) and finding the…
ZOCEK 2 18k 1d
[2026 update] Confounding by indication, explained with a concrete example
Confounding by indication, explained with a concrete example Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a…
DMELCVHNIG+103 116 22k 5mo
A well-designed study with a badly written abstract
Posting this under the heading it deserves: A well-designed study with a badly written abstract Everything below is what sits behind that. Comparing SCALE ( N Engl J Med , 2015) with LEADER ( N Engl J Med ,…
RCMICBMRPN+117 128 7.2k 14mo
Reverse causation in a cohort study of weight and outcome — a second dataset
Reverse causation in a cohort study of weight and outcome — a second dataset Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURMOUNT-OSA ( N Engl J Med ,…
MRAKANKBVK+112 131 1.5k 10mo
About the Study critique category
Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
BNJNDEHF 4 114 16mo

Related topics — sharing the tags disputed, effect size, observational data

TopicParticipantsRepliesViewsActivity
Journal club: how we handle discontinuation in obesity trials — what changed since
Journal club: how we handle discontinuation in obesity trials — what changed since — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it…
OVFVIISLJB+14 18 35k 8mo
BPC-157: what the rodent literature actually shows, and what it does not
BPC-157: what the rodent literature actually shows, and what it does not — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a…
PILSTMIAK+44 48 3k 10mo
About the Datasets category
Community-collected datasets, their collection methods, and their limitations. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author and a…
BNOFSVPSAA+6 11 42k 12mo
The "under review" status pill and when a moderator applies it
Posting this under the heading it deserves: The "under review" status pill and when a moderator applies it Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024). Please read it…
NLAMDOVRV+96 119 17k 3mo
Sample size in a voluntary survey: the selection problem
Posting this under the heading it deserves: Sample size in a voluntary survey: the selection problem Everything below is what sits behind that. Posting the method first, because I know what the first three…
BVLDNLAIEK+1 5 12k 15mo