The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Research Methods · N-of-1 designs

An ABAB design with a data table and honest limitations

SS
system_suitabilityTL3Analytical chemist29 Jul 2025#1

An ABAB design with a data table and honest limitations Writing it up because I had to work it out twice and would rather nobody else did.

Session topic: SURPASS-4 (Lancet, 2021). Please read it before posting; the discussion is much better when everyone has.

The question I would like us to start with is what the trial set out to estimate, rather than what it found. Once that is on the table we can talk about whether the design could have answered it, and only then about the numbers.

Specific things I would like covered: the population and how far it generalises, how discontinuation was handled, whether the comparator was a fair one, and what the absolute rather than relative effect looks like.

I will summarise at the end and the summary will feed the relevant digest page.

12 likes 12mo
DS
d.szymanskiTL3Wiki editor27 Nov 2025#2

Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.

1 like 8mo
EF
e.ferreiraTL3Regular23 Feb 2026#3

Coming back to the opening post, because the follow-up matters more than the original answer.

Two things before anyone answers the substance.

First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound.

32 likes 5mo

Suggested topics

TopicParticipantsRepliesViewsActivity
Blinding yourself: practical methods and their limits — the long version
Blinding yourself: practical methods and their limits — the long version Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURMOUNT-OSA ( N Engl J Med , 2024)…
CTSDNGJEMD+7 11 1.8k 22h
An ABAB design with a data table and honest limitations — a second dataset
On the subject in the title: An ABAB design with a data table and honest limitations — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before…
VELIGRAC+106 118 25k 4mo
Coming back to: Why most self-reports here are not experiments, and that is fine
The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. Comparing LEADER ( N Engl J Med , 2016) with…
MHAPNTKNK+56 62 11k 4mo
Washout with a one-week half-life: the arithmetic — does this still hold?
Washout with a one-week half-life: the arithmetic — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Comparing SURPASS-2 ( N Engl J Med , 2021)…
AFANABANNN+41 45 12k 1d
Designing a personal experiment that could change your mind — one year on
Designing a personal experiment that could change your mind — one year on — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it before…
TKNMPMBSMC+74 80 17k 2d

Related topics — sharing the tags effect size, confounding, worked example

TopicParticipantsRepliesViewsActivity
Prediction intervals and why they are more honest than confidence intervals
Posting this under the heading it deserves: Prediction intervals and why they are more honest than confidence intervals Everything below is what sits behind that. Comparing SURMOUNT-4 ( JAMA , 2024) with FLOW…
DBWSRMON+21 25 46k 4mo
A claim built entirely on a subgroup analysis — what changed since
On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion. I have seen PIONEER 6 ( N Engl J Med , 2019) cited in support of a claim…
AWZCQZ 2 2k 18mo
Follow-up: Is "synergy" the right word for the combination data?
Is "synergy" the right word for the combination data? I have a specific reason for asking rather than idle curiosity, and the context is below. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a…
CLBKSS 2 41k 14mo
Coming back to: What the published dose-response for semaglutide actually looks like above 2.4 mg
The question in the title: What the published dose-response for semaglutide actually looks like above 2.4 mg I will give what I have already checked below so nobody repeats it. I have seen LEADER ( N Engl J…
SCHJSATKO+23 27 9.9k 1mo
Follow-up: Where the four-week escalation interval comes from, and what it is not
Where the four-week escalation interval comes from, and what it is not Writing it up because I had to work it out twice and would rather nobody else did. I have read the maintained page on this and I still…
TNOBJEPPMV+131 147 47k 18mo