The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Research Methods · N-of-1 designs · continued

An ABAB design with a data table and honest limitations — a second dataset posts 31–60

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1 · go to the accepted answer.

FF
f.fontaineTL23 Mar 2026#31
VPoulsen, post #1: On the subject in the title: An ABAB design with a data table and honest limitations — a second dataset Working notes rather than a conclusion. Posting a small dataset on ABAB design. It is mine, it is uncontrolled, and the method is stated so it can be discounted appropriately. What I would like is not agreement but a second dataset… Go to post

Answering the question post #29 raises rather than the one it answers.

Expectation effects in an unblinded self-experiment are large and are not a character flaw. Knowing what you expect to find is a reason to design against it.

I would hold that lightly until someone with a larger sample weighs in.

11 likes in reply to #1 5mo
P
PSundbergTL2Member4 Mar 2026#32
c.tulloch, post #25: Generalisability: a robust n-of-1 result applies to you. It does not tell you much about whether the effect generalises to others similar to you, much less to people different from you. Go to post

Measure the same thing the same way at the same time of day. Most of the noise in personal data is measurement protocol rather than biology.

That is the practical version. The rigorous version is longer and says the same thing.

3 likes in reply to #25 5mo
YE
y.eriksenTL24 Mar 2026#33

The confident answers on ABAB design and the well-sourced answers are not the same answers, which is the most useful thing I have learned reading this category.

0 likes 5mo
ST
sterile_tableTL3Regular4 Mar 2026#34

Post #33 is the version of this I will quote in future. One addition.

Adding the boring version of ABAB design, because the interesting version keeps getting posted and the boring one is usually right.

Check the ordinary explanations, in order, and stop when one of them accounts for what you are seeing. Most of the time the second one does.

32 likes 5mo
GB
g.bakkenTL25 Mar 2026#35
Ridgeway, post #4: Right — I had this wrong and I am glad to have read it before it mattered. Go to post

That reframing is the whole thing. The facts I already had.

7 likes in reply to #4 5mo
WT
week_threeTL1Member5 Mar 2026 · edited#36

A photograph or a device reading is a harder record than a recollection, and where one is available it should be the record.

This is the sort of thing that ought to be settled and apparently is not.

1 like 5mo
JI
j.ivaturiTL25 Mar 2026#37

I had written a reply contradicting post #33 and deleted it. Here is what survived.

The question underneath ABAB design is usually "how would I tell?" rather than "what is true?", and that one has a method attached to it.

Write down what you would expect to see under each hypothesis before you collect anything. If they predict the same observation, collecting it will not help.

0 likes 5mo
RH
revision_historyTL3Wiki editor6 Mar 2026#38

Confirming post #37 from a second method, which matters more than confirming it from a second person.

Committing to post the result before you know it is a useful precommitment, and this subcategory is a reasonable place to make it.

Two sources, same conclusion, and I could not rule out that one copied the other.

24 likes 5mo
AA
a.adeyemiTL26 Mar 2026#39
m.dumitru, post #9: Adding a small correction to the ABAB design summary above rather than a disagreement with it. The substance holds; one of the figures is out by a factor that matters. Go to post

A request rather than an answer: could whoever has the primary source for ABAB design post it? I have seen the claim three times this month and each version had lost a qualifier.

23 likes in reply to #9 5mo
M
microgramsTL2Regular6 Mar 2026#40

Speaking only to ABAB design as I have actually seen it, rather than as it is usually described: the effect is real, it is smaller than the thread suggests, and the variance between people is larger than the effect.

10 likes 5mo
GD
glossary_deskTL3Regular7 Mar 2026#41

Seconded. It reads as careful rather than confident, which is the right register.

6 likes 5mo
DA
d.achebeTL27 Mar 2026#42
N
NicolaidesTL3Regular7 Mar 2026#43
v.szabo, post #28: I had read the opposite somewhere and cannot now find where, which tells me something. Go to post

Small methodological point on ABAB design: repeating a measurement is cheap and resolves most of what is being argued about here at no cost to anyone.

0 likes in reply to #28 5mo
FP
f.piresTL28 Mar 2026#44

Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.

Somebody will have a better source than mine, and I hope they post it.

1 like 5mo
AL
aliquot_lineTL3Regular8 Mar 2026#45

Confirming post #43 from a second method, which matters more than confirming it from a second person.

Careful with the language on ABAB design. "Not detected" and "not present" are different findings and the first is a statement about the method.

10 likes 5mo
VS
v.stanescuTL28 Mar 2026#46
Ziegler, post #10: Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid. Go to post

I had written a reply contradicting post #44 and deleted it. Here is what survived.

Two questions I would want answered before drawing anything from the ABAB design data above: how were the cases selected, and what happened to the ones that dropped out.

22 likes in reply to #10 5mo
FT
fr.translation_moTL2Translator · FR9 Mar 2026#47
c.tulloch, post #25: Generalisability: a robust n-of-1 result applies to you. It does not tell you much about whether the effect generalises to others similar to you, much less to people different from you. Go to post

A single-person experiment can be genuinely informative if it has a pre-specified outcome, a defined period, and a plan written before the data arrives. Most accounts here have none of those.

0 likes in reply to #25 5mo
RW
r.weissTL29 Mar 2026 · edited#48

The practical version of ABAB design is three sentences long. The rigorous version is three pages and reaches the same conclusion with the conditions attached.

3 likes 5mo
BT
baseline_tableTL2Member9 Mar 2026 · edited#49

Order effects matter. If you always try A before B, you cannot separate the treatment from the sequence, and alternating is cheap.

Posting it because the silence on this was starting to look like agreement.

15 likes 5mo
TB
t.brandtTL210 Mar 2026#50

Blinding yourself is harder than it sounds and is not impossible. Somebody else preparing labelled containers is the usual approach and it requires a second person you trust.

It reads as pedantry until the day it does not.

30 likes 5mo
TI
trough_indexTL3Regular10 Mar 2026 · edited#51

My understanding of ABAB design is a few years old and may have been superseded. If it has been, I would genuinely like to know rather than keep repeating it.

0 likes 5mo
AN
a.norgaardTL210 Mar 2026#52

Narrowing post #51, because the general version has more than one answer.

The best thing about this subcategory is that people post their protocols before their results. That order is what keeps it honest.

0 likes 5mo
K
KTurkingtonTL3Regular11 Mar 2026#53
physio_marchetti, post #22: Expectation effects in an unblinded self-experiment are large and are not a character flaw. Knowing what you expect to find is a reason to design against it. Genuinely open to being wrong about this one. Go to post

Post #51 and I disagree about the size of the effect, not about the direction.

Adding what did not work for me on ABAB design, since the failures never get written up and they are half the useful information.

12 likes in reply to #22 5mo
EM
e.mwangiTL211 Mar 2026#54

ABAB design has a well-known answer and a correct answer, and the interesting work is establishing that they are the same. Nobody has done that here yet.

4 likes 5mo
TN
t.ndiayeTL211 Mar 2026#55

Saving this. It is the version I will quote when the question comes round again.

0 likes 5mo
TD
t.demirTL212 Mar 2026#56

Post #54 answers the question as asked. The question underneath it is different.

A rolling mean over several days is far more informative than any single reading for anything that varies day to day, which is nearly everything.

I would put the burden of proof on the interesting explanation, not the dull one.

26 likes 5mo
EL
e.lokkenTL212 Mar 2026#57
n.lehtinen, post #30: My position on ABAB design is current rather than settled. I have revised it once already and I expect to again, so treat it accordingly. Go to post

Something worth flagging about ABAB design: the strongest-sounding claims in this thread are the ones with no source attached, which is the usual pattern and not a coincidence.

8 likes in reply to #30 5mo
AF
a.friskTL212 Mar 2026#58
abstract_peak, post #17: Where I part company with post #15, and it is a narrow parting. The version of ABAB design that I was taught turned out to be a teaching simplification. Useful, and not true in the way I had assumed it was. Go to post

An n of one tells you about one person, which is the person you are most interested in. That is the whole value and it is not nothing.

That is what the documentation says. What happens in practice is usually close.

2 likes in reply to #17 5mo
IT
integrator_traceTL2Member13 Mar 2026#59

The bit of ABAB design that nobody enjoys is that the answer changes depending on what you are trying to decide with it. Say what the decision is and the thread will converge.

0 likes 5mo
NK
n.kirchnerTL213 Mar 2026 · edited#60
e.lokken, post #57: Something worth flagging about ABAB design: the strongest-sounding claims in this thread are the ones with no source attached, which is the usual pattern and not a coincidence. Go to post

Second-hand on ABAB design, so weight it accordingly — someone whose method I trust told me this and I have not verified it myself.

19 likes in reply to #57 5mo