The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Research Methods · N-of-1 designs · continued

Blinding yourself: practical methods and their limits posts 31–45

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

YR
y.ramosTL2 Moderator4 Jun 2026#31

I read post #29 twice before replying, because I had assumed the opposite.

Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result.

2 likes 2mo
ID
integrator_draftTL3Regular8 Jun 2026#32

I disagree with the reply above, and I think the disagreement is substantive rather than terminological.

The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.

0 likes 2mo
PF
p.friskTL2 Moderator11 Jun 2026#33
j.steiner, post #17: Sample size in n-of-1: you are the sample. Repeated measurements (weekly weighings, daily mood scores) increase the power to detect a real effect even though n=1. Go to post

Sample size in n-of-1: you are the sample. Repeated measurements (weekly weighings, daily mood scores) increase the power to detect a real effect even though n=1.

26 likes in reply to #17 2mo
VM
v.milanoviTL3Regular15 Jun 2026#34
KTurkington, post #10: I read post #8 twice before replying, because I had assumed the opposite. When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient. Go to post

post #33 is right about the mechanism and I think understates the practical bit.

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

12 likes in reply to #10 1mo
LF
l.ferreiraTL2 Moderator18 Jun 2026 · edited#35

Coming back to post #33, because the follow-up matters more than the original answer.

Two things before anyone answers the substance.

First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound.

4 likes 1mo
G
GDashwoodTL3Regular22 Jun 2026#36

Picking up post #33: that is the part I would want checked first.

Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.

0 likes 1mo
SS
s.solbergTL2 Moderator26 Jun 2026#37

When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient.

0 likes 1mo
VK
v.klausenTL3Regular29 Jun 2026#38
s.leclerc, post #7: Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid. Go to post

Generalisability: a robust n-of-1 result applies to you. It does not tell you much about whether the effect generalises to others similar to you, much less to people different from you.

18 likes in reply to #7 29d
KB
ka.batistaTL2 Moderator2 Jul 2026#39
s.leclerc, post #7: Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid. Go to post

When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient.

7 likes in reply to #7 25d
F
FairweatherTL2Member6 Jul 2026#40

Generalisability: a robust n-of-1 result applies to you. It does not tell you much about whether the effect generalises to others similar to you, much less to people different from you.

1 like 22d
MR
m.restrepoTL2 Moderator9 Jul 2026 · edited#41

Picking up post #38: that is the part I would want checked first.

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

4 likes 19d
LO
l.oseiTL2 Moderator13 Jul 2026#42
c.rasmussen, post #3: post #2 is right about the mechanism and I think understates the practical bit. Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune. Go to post

Coming back to post #40, because the follow-up matters more than the original answer.

Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.

12 likes in reply to #3 15d
JS
j.silvaTL2 Moderator16 Jul 2026#43

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

0 likes 12d
T
ThibodeauTL3Regular20 Jul 2026#44

Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result.

0 likes 8d
PM
p.marchettiTL2 Moderator23 Jul 2026#45

This follows post #42 rather than contradicting it.

Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune.

1 like 5d

Suggested topics

TopicParticipantsRepliesViewsActivity
Washout with a one-week half-life: the arithmetic
Washout with a one-week half-life: the arithmetic — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim I do not think it…
SKTPBLCSF+90 96 44k 20mo
Designing a personal experiment that could change your mind — one year on
Designing a personal experiment that could change your mind — one year on — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it before…
TKNMPMBSMC+74 80 17k 2d
An ABAB design with a data table and honest limitations — a second dataset
On the subject in the title: An ABAB design with a data table and honest limitations — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before…
VELIGRAC+106 118 25k 4mo
Coming back to: Why most self-reports here are not experiments, and that is fine
The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. Comparing LEADER ( N Engl J Med , 2016) with…
MHAPNTKNK+56 62 11k 4mo
Second pass at: Designing a personal experiment that could change your mind
Second pass at: Designing a personal experiment that could change your mind Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURPASS-4 ( Lancet , 2021). Please…
JSJISTGBM+39 44 632 14mo

Related topics — sharing the tags confounding, data table, effect size

TopicParticipantsRepliesViewsActivity
A structured critique template this community uses
A structured critique template this community uses — setting out what I have, and where I think it stops being reliable. Comparing SURMOUNT-2 ( Lancet , 2023) with SURPASS-4 ( Lancet , 2021) and finding the…
ZOCEK 2 18k 1d
A 40-week log with the measurement method stated
On the subject in the title: A 40-week log with the measurement method stated Working notes rather than a conclusion. Longitudinal report with the method stated, because a number without a method is not a…
SMCRRSGPRN+87 97 18k 9mo
Carryover and the ghost peak from last week's standard — what changed since
Carryover and the ghost peak from last week's standard — what changed since Writing it up because I had to work it out twice and would rather nobody else did. Posting the method first, because I know what the…
FDLTZYFWAA+98 114 37k 22d
Trifluoroacetate content and its consequences
Trifluoroacetate content and its consequences — setting out what I have, and where I think it stops being reliable. A documentation question rather than an analytical one. I have a certificate in front of me…
AIRDRVHFAV+123 134 31k 5mo
Washout with a one-week half-life: the arithmetic
Washout with a one-week half-life: the arithmetic — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim I do not think it…
SKTPBLCSF+90 96 44k 20mo