Evidence · subcategory

Study critique

Structured criticism of a specific published study. Criticise the method, not the author.

24 topics1,050 posts7 solved Moderators: bench_notes About this category

risk of bias confounding observational data effect size disputed

24 topics

Topic	Participants	Replies	Views	Activity
Measurement error in a self-reported exposure confounding risk of bias effect size disputed Solved Closed Posting this under the heading it deserves: Measurement error in a self-reported exposure Everything below is what sits behind that. Session topic: SURPASS-2 ( N Engl J Med , 2021). Please read it before…	+117	129	45k	5mo
A well-designed study with a badly written abstract disputed effect size risk of bias observational data Posting this under the heading it deserves: A well-designed study with a badly written abstract Everything below is what sits behind that. Comparing SCALE ( N Engl J Med , 2015) with LEADER ( N Engl J Med ,…	+117	128	7.2k	14mo
Reverse causation in a cohort study of weight and outcome — a second dataset risk of bias observational data confounding Reverse causation in a cohort study of weight and outcome — a second dataset Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURMOUNT-OSA ( N Engl J Med ,…	+112	131	1.5k	10mo
[2026 update] Confounding by indication, explained with a concrete example observational data disputed risk of bias Confounding by indication, explained with a concrete example Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a…	+103	116	22k	5mo
Criticising the method without criticising the authors disputed observational data confounding effect size Criticising the method without criticising the authors Writing it up because I had to work it out twice and would rather nobody else did. I have seen STEP 1 ( N Engl J Med , 2021) cited in support of a claim…	+55	61	60k	15mo
A claim built entirely on a subgroup analysis risk of bias observational data confounding disputed Solved A claim built entirely on a subgroup analysis Writing it up because I had to work it out twice and would rather nobody else did. I have seen SUSTAIN 6 ( N Engl J Med , 2016) cited in support of a claim I do…	+71	80	1.1k	14mo
Coming back to: A structured critique template this community uses confounding risk of bias disputed observational data Posting this under the heading it deserves: A structured critique template this community uses Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with SURMOUNT-1 ( N Engl J Med , 2022)…	+63	69	17k	18h
Criticising the method without criticising the authors — one year on confounding effect size disputed risk of bias Solved Closed On the subject in the title: Criticising the method without criticising the authors — one year on Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before posting;…	+16	20	61k	11mo
A structured critique template this community uses — a second dataset observational data effect size confounding Solved On the subject in the title: A structured critique template this community uses — a second dataset Working notes rather than a conclusion. Session topic: SELECT ( N Engl J Med , 2023). Please read it before…	+47	51	16k	15h
Coming back to: Measurement error in a self-reported exposure risk of bias observational data effect size disputed Measurement error in a self-reported exposure — setting out what I have, and where I think it stops being reliable. I have seen FLOW ( N Engl J Med , 2024) cited in support of a claim I do not think it…	+23	27	49k	3mo
Immortal time bias in a claims-database study risk of bias observational data disputed confounding Closed Immortal time bias in a claims-database study — setting out what I have, and where I think it stops being reliable. I have seen FLOW ( N Engl J Med , 2024) cited in support of a claim I do not think it…	+29	34	28k	11mo
A critique that turned out to be unfair, retracted by its author confounding risk of bias effect size observational data Wiki Posting this under the heading it deserves: A critique that turned out to be unfair, retracted by its author Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024). Please read it…	+34	38	20k	17h
Immortal time bias in a claims-database study — one year on effect size risk of bias confounding Solved Posting this under the heading it deserves: Immortal time bias in a claims-database study — one year on Everything below is what sits behind that. Comparing SURPASS-2 ( N Engl J Med , 2021) with SURMOUNT-1 (…	+41	46	3.7k	22h
Selection into a registry and what it does to the estimate risk of bias disputed observational data Selection into a registry and what it does to the estimate — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it before posting; the…		2	55k	7mo
Confounding by indication, explained with a concrete example confounding observational data disputed On the subject in the title: Confounding by indication, explained with a concrete example Working notes rather than a conclusion. Comparing SURMOUNT-1 ( N Engl J Med , 2022) with SURPASS-2 ( N Engl J Med ,…	+21	25	21k	11mo
Selection into a registry and what it does to the estimate — a second dataset confounding risk of bias effect size disputed Solved Posting this under the heading it deserves: Selection into a registry and what it does to the estimate — a second dataset Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024).…	+28	32	1.3k	1d
A well-designed study with a badly written abstract — does this still hold? disputed confounding risk of bias Solved Closed A well-designed study with a badly written abstract — does this still hold? I have a specific reason for asking rather than idle curiosity, and the context is below. Comparing STEP 1 ( N Engl J Med , 2021)…		2	28k	20mo
Reverse causation in a cohort study of weight and outcome disputed observational data effect size On the subject in the title: Reverse causation in a cohort study of weight and outcome Working notes rather than a conclusion. Comparing SELECT ( N Engl J Med , 2023) with FLOW ( N Engl J Med , 2024) and…	+10	14	11k	7mo
A structured critique template this community uses observational data effect size risk of bias A structured critique template this community uses — setting out what I have, and where I think it stops being reliable. Comparing SURMOUNT-2 ( Lancet , 2023) with SURPASS-4 ( Lancet , 2021) and finding the…		2	18k	1d
Critiquing an observational claim about a class effect — one year on observational data disputed risk of bias Pinned Critiquing an observational claim about a class effect — one year on — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim…	+5	9	3.2k	8mo
Critiquing an observational claim about a class effect disputed risk of bias effect size observational data Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that. Session topic: SCALE ( N Engl J Med , 2015). Please read it before…		2	6.9k	14mo
Coming back to: A critique that turned out to be unfair, retracted by its author disputed observational data effect size confounding Closed A critique that turned out to be unfair, retracted by its author — setting out what I have, and where I think it stops being reliable. I have seen STEP 4 ( JAMA , 2021) cited in support of a claim I do not…		2	1.3k	14mo
A claim built entirely on a subgroup analysis — what changed since disputed effect size observational data risk of bias Closed On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion. I have seen PIONEER 6 ( N Engl J Med , 2019) cited in support of a claim…		2	2k	18mo
About the Study critique category risk of bias confounding observational data Pinned Wiki Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…		4	114	16mo

Sponsored PeptideMeter — peptide analytics and supplier verificationPurity analysis and structured supplier verification, published as dated records rather than scores. Referenced throughout our sourcing documentation.View analytics →