Generalisability: the enrolled population was selected in ways that matter. Entry criteria, run-in periods, and the simple fact that people who agree to a multi-year trial differ from people who do not, all narrow the population. That is how internal validity is bought, at the cost of external validity.
[2026 update] Composite endpoints and the component doing the work
Confounding in observational data: a third variable can explain an apparent association. In a randomised trial, randomisation balances unknown confounders. In observational data, observed confounders can be adjusted for but unknown ones cannot.
For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.
Worth separating two things that post #18 runs together.
Population narrowness: most trials in this class enrolled fairly specific groups. Baseline body mass index ranges, exclusion of renal disease, exclusion of certain comorbidities, all narrow the population. Applying point estimates to someone well outside the range is an extrapolation.
On post #44 — agreed on the reasoning, with one qualification.
The estimand: what the trial set out to estimate. Two trials can be identical in structure but estimate different things by using different handling rules for people who stop taking the drug. Treatment-policy and hypothetical approaches are both legitimate but answer different questions.
Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.
post #59 is right about the mechanism and I think understates the practical bit.
Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.
The estimand: what the trial set out to estimate. Two trials can be identical in structure but estimate different things by using different handling rules for people who stop taking the drug. Treatment-policy and hypothetical approaches are both legitimate but answer different questions.
I read post #77 twice before replying, because I had assumed the opposite.
Risk of bias: structured appraisal of internal validity. Key things to assess: randomisation method (was it truly random or could someone predict the next assignment), concealment (could randomisation be subverted), blinding (who was blinded and why or why not), completeness of outcome reporting.
Read the full topic (88 posts)
This topic was referenced in
- [2026 update] Reading a supplementary appendix and finding the interesting partEvidence › Trials · 44 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Comparators chosen for regulatory reasons rather than clinical ones — one year on
Comparators chosen for regulatory reasons rather than clinical ones — one year on — setting out what I have, and where I think it stops being reliable. Session topic: SURMOUNT-2 ( Lancet , 2023). Please read…
|
+82 | 87 | 1.1k | 12mo |
|
Adjudicated events and why the definition matters — the long version
Adjudicated events and why the definition matters — the long version Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURPASS-4 ( Lancet , 2021) with STEP 4 ( JAMA…
|
+125 | 146 | 13k | 15mo |
|
How to read a forest plot, properly, from scratch
The question in the title: How to read a forest plot, properly, from scratch I will give what I have already checked below so nobody repeats it. Session topic: STEP 4 ( JAMA , 2021). Please read it before…
|
+73 | 81 | 17k | 7mo |
|
Open-label extensions: what survives and what does not
Posting this under the heading it deserves: Open-label extensions: what survives and what does not Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with PIONEER 6 ( N Engl J Med ,…
|
4 | 22k | 3mo | |
|
Composite endpoints and the component doing the work
Composite endpoints and the component doing the work Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a claim I do…
|
+3 | 7 | 33k | 13h |
Related topics — sharing the tags surrogate endpoints, discontinuation & dropout, estimand
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Journal club: FLOW and the renal composite, component by component
On the subject in the title: Journal club: FLOW and the renal composite, component by component Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before posting;…
|
+84 | 91 | 18k | 2y |
|
Follow-up: Open-label extensions: what survives and what does not
Open-label extensions: what survives and what does not — setting out what I have, and where I think it stops being reliable. Comparing SURMOUNT-2 ( Lancet , 2023) with SURMOUNT-1 ( N Engl J Med , 2022) and…
|
+22 | 26 | 397 | 16mo |
|
Journal club: indirect comparison between two programmes, defended and attacked
Journal club: indirect comparison between two programmes, defended and attacked Writing it up because I had to work it out twice and would rather nobody else did. Comparing SUSTAIN 6 ( N Engl J Med , 2016)…
|
+122 | 131 | 5.2k | just now |
|
Run-in periods and the population they select — the long version
Run-in periods and the population they select — the long version Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SUSTAIN 6 ( N Engl J Med , 2016). Please read…
|
2 | 8.9k | 4mo | |
|
Journal club: SUSTAIN 6 and its retinopathy signal — does this still hold?
The question in the title: Journal club: SUSTAIN 6 and its retinopathy signal — does this still hold? I will give what I have already checked below so nobody repeats it. I have seen SURMOUNT-2 ( Lancet ,…
|
+60 | 66 | 12k | 16mo |