Journal club: indirect comparison between two programmes, defended and attacked

Journal club: indirect comparison between two programmes, defended and attacked Writing it up because I had to work it out twice and would rather nobody else did.

Comparing SUSTAIN 6 (N Engl J Med, 2016) with STEP 4 (JAMA, 2021) and finding the comparison harder than it looks.

Different populations, different durations, different endpoints defined slightly differently, and in one case a different estimand. People compare the headline percentages anyway, including me until recently.

Is there a defensible way to put these side by side, or is the honest answer that there is not and we should stop?

TRIUMPH (ongoing): Retatrutide phase 3. No results yet. Nothing should be attributed to it because it has not finished. When it does, this discussion will return to it.

I read the opening post twice before replying, because I had assumed the opposite.

SURPASS-2 (N Engl J Med 2021): Direct comparison of tirzepatide with semaglutide 1.0 mg. The 1.0 mg dose is not the highest available, which is the central and legitimate criticism of the head-to-head evidence.

This follows post #3 rather than contradicting it.

SURMOUNT-OSA (N Engl J Med 2024): Tirzepatide in obstructive sleep apnoea, using an objective physiological endpoint. Notable because soft endpoints are avoided. Two parallel trials addressed the confounder directly.

On the opening post — agreed on the reasoning, with one qualification.

Session format: read the paper before posting. The discussion is much better when everyone has. Start with the estimand and population, then methods, then results, then limitations. That order makes critique coherent.

STEP 1 (N Engl J Med 2021): The pivotal obesity trial for semaglutide and the reference point for most subsequent comparison. Mean weight reduction was substantially larger than anything previously achieved pharmacologically.

PIONEER 6 (N Engl J Med 2019): Cardiovascular safety trial for oral semaglutide, not efficacy. Non-inferiority for safety was met. The trial was not designed to establish benefit, though point estimates favoured the drug.

Picking up post #5: that is the part I would want checked first.

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

Worth separating two things that post #5 runs together.

SURMOUNT-1 (N Engl J Med 2022): Tirzepatide obesity trial. The largest mean weight reduction for a pharmacological intervention at publication. Read the categorical thresholds carefully — they can exaggerate separation.

post #9 is right about the mechanism and I think understates the practical bit.

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

I disagree with the reply above, and I think the disagreement is substantive rather than terminological.

The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.

On post #8 — agreed on the reasoning, with one qualification.

SELECT (N Engl J Med 2023): Semaglutide cardiovascular outcomes without diabetes. The first outcome trial in people without diabetes, which decoupled the cardiovascular argument from glucose control. Read the absolute numbers, not just the relative reduction.

Critical appraisal template: (1) What did the trial set out to estimate? (2) Could the design answer that question? (3) Was the population sufficiently similar to your population to apply the results? (4) What was the absolute effect, not just the relative one? (5) What are the two strongest criticisms available?

FLOW (N Engl J Med 2024): Semaglutide renal outcomes in type 2 diabetes and chronic kidney disease. Stopped early for efficacy. Component-by-component analysis is essential because the components differ in how patient-important they are.