Thank you for the correction. I have edited my earlier post with a note rather than silently, so the thread still makes sense to read. The error was mine and it was the kind that comes from remembering a figure instead of looking it up.
Pre-registering a personal experiment, seriously — a second dataset
Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune.
I disagree with the reply above, and I think the disagreement is substantive rather than terminological.
The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.
Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.
I read post #49 twice before replying, because I had assumed the opposite.
Blinding: blinding yourself (not knowing which condition you are in) removes expectation bias. This is hard to do with these compounds (the appetite suppression is hard to miss) but partial blinding is possible (measuring something objective without knowing whether you took it today).
Read the full topic (67 posts)
This topic was referenced in
- Washout with a one-week half-life: the arithmeticResearch Methods › N-of-1 designs · 96 replies
- Designing a personal experiment that could change your mind — one year onResearch Methods › N-of-1 designs · 80 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Pre-registering a personal experiment, seriously
Pre-registering a personal experiment, seriously — setting out what I have, and where I think it stops being reliable. Comparing STEP 4 ( JAMA , 2021) with SUSTAIN 6 ( N Engl J Med , 2016) and finding the…
|
+96 | 119 | 58k | 14mo |
|
Why most self-reports here are not experiments, and that is fine
Why most self-reports here are not experiments, and that is fine — that is the question, and I have not found it answered plainly anywhere I have looked. I have seen SURPASS-2 ( N Engl J Med , 2021) cited in…
|
2 | 46k | 11mo | |
|
Designing a personal experiment that could change your mind
Posting this under the heading it deserves: Designing a personal experiment that could change your mind Everything below is what sits behind that. Session topic: STEP 8 ( JAMA , 2022). Please read it before…
|
+2 | 6 | 695 | 6mo |
|
Coming back to: Why most self-reports here are not experiments, and that is fine
The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. Comparing LEADER ( N Engl J Med , 2016) with…
|
+56 | 62 | 11k | 4mo |
|
Blinding yourself: practical methods and their limits
On the subject in the title: Blinding yourself: practical methods and their limits Working notes rather than a conclusion. Comparing PIONEER 6 ( N Engl J Med , 2019) with STEP 4 ( JAMA , 2021) and finding the…
|
+40 | 44 | 33k | 5d |
Related topics — sharing the tags data table, worked example, confounding
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
A calculator that gives a right answer to the wrong question
Posting this under the heading it deserves: A calculator that gives a right answer to the wrong question Everything below is what sits behind that. I would like to understand what this number means before I…
|
+32 | 36 | 1.9k | 17h |
|
A 5 mg vial and a 0.25 mg dose: the arithmetic in full — what changed since
Posting this under the heading it deserves: A 5 mg vial and a 0.25 mg dose: the arithmetic in full — what changed since Everything below is what sits behind that. I have read the maintained page on this and I…
|
+86 | 93 | 25k | 13mo |
|
Coming back to: Column chemistry choices for a 40-residue peptide
On the subject in the title: Column chemistry choices for a 40-residue peptide Working notes rather than a conclusion. Posting the method first, because I know what the first three replies will otherwise be.…
|
2 | 43k | 16mo | |
|
Peak-to-trough ratio at steady state for a weekly agent
On the subject in the title: Peak-to-trough ratio at steady state for a weekly agent Working notes rather than a conclusion. I would like to understand what this number means before I repeat it anywhere. A…
|
+58 | 64 | 9.7k | 2mo |
|
Measurement error in home scales, with a worked standard deviation — the long version
On the subject in the title: Measurement error in home scales, with a worked standard deviation — the long version Working notes rather than a conclusion. Session topic: SURMOUNT-1 ( N Engl J Med , 2022).…
|
+96 | 105 | 2k | 2mo |