The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Research Methods · N-of-1 designs · continued

Second pass at: Designing a personal experiment that could change your mind posts 31–45

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1 · go to the accepted answer.

LS
l.solbergTL2 Moderator20 May 2025#31

Picking up post #28: that is the part I would want checked first.

Thank you for the correction. I have edited my earlier post with a note rather than silently, so the thread still makes sense to read. The error was mine and it was the kind that comes from remembering a figure instead of looking it up.

16 likes 14mo
EV
e.verhoevenTL2 Moderator20 May 2025#32

Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result.

32 likes 14mo
DB
d.bakkerTL2 Moderator20 May 2025 · edited#33
s.kuusela, post #13: Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid. Go to post

When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient.

0 likes in reply to #13 14mo
PM
p.marchettiTL2 Moderator21 May 2025#34
m.balogun, post #21: On post #17 — agreed on the reasoning, with one qualification. Two things before anyone answers the substance. First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound. Go to post

Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.

3 likes in reply to #21 14mo
CB
c.boatengTL2 Moderator21 May 2025#35

This follows post #32 rather than contradicting it.

Designing a personal experiment that could actually change your mind: that is the standard for an n-of-1 design. An experiment designed so that any result confirms what you already believed has not changed anything.

23 likes 14mo
OB
owen.bradyTL4 Moderator21 May 2025#36
Staff post. Actions described here are recorded in the public moderation log and may be challenged in Meta.

I read post #34 twice before replying, because I had assumed the opposite.

Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.

0 likes 14mo
RL
r.laurentTL2 Moderator21 May 2025#37

Blinding: blinding yourself (not knowing which condition you are in) removes expectation bias. This is hard to do with these compounds (the appetite suppression is hard to miss) but partial blinding is possible (measuring something objective without knowing whether you took it today).

1 like 14mo
MP
mira.patelTL4 Admin21 May 2025#38
h.brandt, post #19: Designing a personal experiment that could actually change your mind: that is the standard for an n-of-1 design. An experiment designed so that any result confirms what you already believed has not changed anything. Go to post

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

6 likes in reply to #19 14mo
O
OstrowskiTL2Member21 May 2025#39
j.ivaturi, post #2: Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias. Go to post

Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune.

30 likes in reply to #2 14mo
JS
j.silvaTL2 Moderator21 May 2025#40

Sample size in n-of-1: you are the sample. Repeated measurements (weekly weighings, daily mood scores) increase the power to detect a real effect even though n=1.

0 likes 14mo
VS
v.szaboTL3Analytical chemist21 May 2025#41

I read post #39 twice before replying, because I had assumed the opposite.

Blinding: blinding yourself (not knowing which condition you are in) removes expectation bias. This is hard to do with these compounds (the appetite suppression is hard to miss) but partial blinding is possible (measuring something objective without knowing whether you took it today).

8 likes 14mo
HV
h.vargaTL2 Moderator22 May 2025#42

This follows post #39 rather than contradicting it.

Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.

2 likes 14mo
DO
d.oyelaranTL3Pharmacist22 May 2025#43
s.kuusela, post #13: Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid. Go to post

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

14 likes in reply to #13 14mo
CT
c.tullochTL2 Moderator22 May 2025#44

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

20 likes 14mo
CL
coldchain_liuTL3Regular22 May 2025#45

Coming back to post #43, because the follow-up matters more than the original answer.

Two things before anyone answers the substance.

First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound.

13 likes 14mo

Suggested topics

TopicParticipantsRepliesViewsActivity
An ABAB design with a data table and honest limitations — a second dataset
On the subject in the title: An ABAB design with a data table and honest limitations — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before…
VELIGRAC+106 118 25k 4mo
Why most self-reports here are not experiments, and that is fine
Why most self-reports here are not experiments, and that is fine — that is the question, and I have not found it answered plainly anywhere I have looked. I have seen SURPASS-2 ( N Engl J Med , 2021) cited in…
SBSKGF 2 46k 11mo
Designing a personal experiment that could change your mind — one year on
Designing a personal experiment that could change your mind — one year on — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it before…
TKNMPMBSMC+74 80 17k 2d
Washout with a one-week half-life: the arithmetic
Washout with a one-week half-life: the arithmetic — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim I do not think it…
SKTPBLCSF+90 96 44k 20mo
An ABAB design with a data table and honest limitations
An ABAB design with a data table and honest limitations Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURPASS-4 ( Lancet , 2021). Please read it before…
SSDSEF 2 45k 5mo

Related topics — sharing the tags worked example, effect size, confounding

TopicParticipantsRepliesViewsActivity
Coming back to: Column chemistry choices for a 40-residue peptide
On the subject in the title: Column chemistry choices for a 40-residue peptide Working notes rather than a conclusion. Posting the method first, because I know what the first three replies will otherwise be.…
MLFPHB 2 43k 16mo
[2026 update] Reporting a disappointing outcome, and why it belongs here
On the subject in the title: Reporting a disappointing outcome, and why it belongs here Working notes rather than a conclusion. Longitudinal report with the method stated, because a number without a method is…
KRSRCB 2 11k 8mo
How this community labels and discusses unrefereed work
How this community labels and discusses unrefereed work — that is the question, and I have not found it answered plainly anywhere I have looked. I have seen SCALE ( N Engl J Med , 2015) cited in support of a…
DVDHKTFWV+112 119 1.3k 2y
Revisiting: List price versus negotiated price versus what you pay
Revisiting: List price versus negotiated price versus what you pay — setting out what I have, and where I think it stops being reliable. A coverage question with the paperwork detail included, since that is…
VKBVIABDGR+24 28 50k 12mo
Follow-up: Why the titration planner refuses to produce a schedule below a floor
The question in the title: Why the titration planner refuses to produce a schedule below a floor I will give what I have already checked below so nobody repeats it. I would like to understand what this number…
COCKHCNRM+120 146 14k 10mo