The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Sourcing · Independent verification

Revisiting: Aggregate verification data across the directory, with caveats

Closed
PM
p.mbekiTL22 Feb 2025#1

Revisiting: Aggregate verification data across the directory, with caveats — setting out what I have, and where I think it stops being reliable.

I have spent a fortnight trying to pin Aggregate verification data down and I want to set out where I have got to, because I suspect the honest answer is duller than the thread this will produce.

What I have: a consistent observation across a small number of cases, collected the same way each time. What I do not have: any controlled comparison, or any reason to think my cases are representative.

The specific question is whether the pattern survives once the obvious confounder is removed. I cannot remove it with what I have.

29 likes 18mo
PM
p.marchettiTL25 Feb 2025#2

Repeat testing: if you want to verify the same lot a second time, testing with a different service strengthens the conclusion. Testing with the same service verifies reproducibility but uses the same method.

That is the shape of it. The detail is where I would expect to be corrected.

6 likes 18mo
DB
d.bakkerTL26 Feb 2025#3

The claim about Aggregate verification data upthread is stronger than its source supports. I have read the source. The source says "associated with" and the post says "causes".

1 like 18mo
AA
a.asanteTL28 Feb 2025#4

The arithmetic in post #3 is right; the assumption feeding it is the part to check.

Adding what did not work for me on Aggregate verification data, since the failures never get written up and they are half the useful information.

0 likes 18mo
CB
c.boatengTL210 Feb 2025#5
d.bakker, post #3: The claim about Aggregate verification data upthread is stronger than its source supports. I have read the source. The source says "associated with" and the post says "causes". Go to post

Where I part company with post #3, and it is a narrow parting.

A record with four results over sixteen months is a thin record rather than a bad one, and the honest description says which.

10 likes in reply to #3 18mo
MP
mira.patelTL4 Admin11 Feb 2025#6
p.marchetti, post #2: Repeat testing: if you want to verify the same lot a second time, testing with a different service strengthens the conclusion. Testing with the same service verifies reproducibility but uses the same method. That is the shape of it. The detail is where I would expect to be corrected. Go to post

Two sentences on Aggregate verification data and then I will stop, because the rest is speculation and the thread is better without mine.

What is documented is narrow. What is inferred from it is broad. The gap between them is where every argument here lives.

3 likes in reply to #2 18mo
RL
r.laurentTL213 Feb 2025#7

Verification is about documents and measurements. It is not a judgement about a company and the pages here are written to keep those separate.

If anyone can point at the primary source I would be grateful.

0 likes 17mo
EV
e.verhoevenTL214 Feb 2025#8

Interpreting a result: a purity figure is one measurement on one vial on one day. Agreement across two services is much stronger. A single high number does not establish a pattern.

I would rather post the uncertainty than round it away.

31 likes 17mo
NS
no.silvaTL215 Feb 2025#9

I had written a reply contradicting post #7 and deleted it. Here is what survived.

Verification records are dated because they expire in usefulness. A result from two years ago describes a lot from two years ago.

Two people can read the same figure differently here and both be reasonable.

6 likes 17mo
PP
peak_purityTL317 Feb 2025#10
CH
ca.haddadTL218 Feb 2025#11

Post #8 answers the question as asked. The question underneath it is different.

Adding a null result on Aggregate verification data. I looked, carefully, and found nothing, and null results deserve posting precisely because they never are.

28 likes 17mo
G
GDashwoodTL3Regular19 Feb 2025#12

Repeat determination on the same product line months apart is the measurement that speaks to consistency, and consistency is what most buyers actually want.

That has been true for the cases I have seen and I have not seen many.

0 likes 17mo
YR
y.ramosTL220 Feb 2025#13
ca.haddad, post #11: Post #8 answers the question as asked. The question underneath it is different. Adding a null result on Aggregate verification data. I looked, carefully, and found nothing, and null results deserve posting precisely because they never are. Go to post

Method has to travel with the number. A verification record without the method is not a record; it is a figure.

2 likes in reply to #11 17mo
VK
v.klausenTL3Regular22 Feb 2025#14

Service differences on vendor pages: Janoshik and Medutest results are measurements on vials. PeptideMeter verification records are assessments maintained over time. VendorInvestigate reviews are documentation assessments. We cite all four because they answer different questions.

9 likes 17mo
NS
n.szaboTL223 Feb 2025 · edited#15

The record shows what was measured. Everything beyond that is inference and this site tries to keep the line visible.

I looked this up rather than remembered it, which is the right order.

21 likes 17mo
ID
integrator_draftTL3Regular24 Feb 2025#16

Reading back through, this was answered upthread and I missed it. My fault.

0 likes 17mo
FI
f.ibarraTL225 Feb 2025#17
O
OkaforTL3Regular26 Feb 2025#18

Post #14 put the caveat in the right place and I want to underline it.

An update on my earlier Aggregate verification data post: the pattern held for another six weeks and then stopped, which I did not predict and cannot explain.

5 likes 17mo
NH
n.haddadTL227 Feb 2025#19

Aggregate verification data is worth one more sentence than it usually gets, and the sentence is the one about how the number was arrived at.

0 likes 17mo
SC
s.coelhoTL228 Feb 2025#20
p.mbeki, post #1: Revisiting: Aggregate verification data across the directory, with caveats — setting out what I have, and where I think it stops being reliable. I have spent a fortnight trying to pin Aggregate verification data down and I want to set out where I have got to, because I suspect the honest answer is duller than the thread this will… Go to post

Nothing in a verification record is a guarantee about the vial in your hand. That check is yours and nobody can do it for you.

2 likes in reply to #1 17mo
VM
v.milanoviTL3Regular2 Mar 2025 · edited#21

I read post #19 twice before replying, because I had assumed the opposite.

I would put moderate confidence on the mainstream reading of Aggregate verification data and no more. That is not scepticism for its own sake; it is where the sourcing actually stops.

0 likes 17mo
SL
s.lundgrenTL23 Mar 2025#22

The question underneath Aggregate verification data is usually "how would I tell?" rather than "what is true?", and that one has a method attached to it.

Write down what you would expect to see under each hypothesis before you collect anything. If they predict the same observation, collecting it will not help.

21 likes 17mo
AS
a.stephanopoulosTL3Regular4 Mar 2025#23

It does not extend to lots nobody has seen, it is not a recommendation, and it says nothing about anything other than what was measured.

It is the sort of thing that seems obvious in retrospect and was not at the time.

6 likes 17mo
NC
n.chowdhuryTL25 Mar 2025#24
n.szabo, post #15: The record shows what was measured. Everything beyond that is inference and this site tries to keep the line visible. I looked this up rather than remembered it, which is the right order. Go to post

Taking post #23 at face value and following it one step further.

Repeat determination on the same product line months apart is the measurement that speaks to consistency, and consistency is what most buyers actually want.

The evidence for this is thinner than the way I have phrased it suggests.

1 like in reply to #15 17mo
TI
trough_indexTL3Regular6 Mar 2025#25

Helpful, and easy to find again, which is half of what a good reply is.

0 likes 17mo
HF
h.fonsecaTL27 Mar 2025#26

Nobody has said the unglamorous part of Aggregate verification data yet, so: most of the variation is explained by things that are boring to write about and easy to check.

29 likes 17mo
NB
n.bridgewaterTL2Member8 Mar 2025#27

Post #23 put the caveat in the right place and I want to underline it.

Answering the Aggregate verification data question as asked, then the question I think is meant. As asked: yes, with the qualification below. As meant: it depends on how the first measurement was taken.

9 likes 17mo
This topic was closed 90 days after the last reply. Closing is automatic for quiet topics so that a settled answer does not collect new questions underneath it. If you have a follow-up, open a new topic and link back to this one — that keeps both readable and gives your question its own title.

Suggested topics

TopicParticipantsRepliesViewsActivity
Choosing which test to pay for, given a fixed budget
On the subject in the title: Choosing which test to pay for, given a fixed budget Working notes rather than a conclusion. A question about how a record should be read rather than about a supplier. We have…
REANKRJPK+60 70 49k 3mo
[2026 update] What a purity-only report leaves out
The question in the title: What a purity-only report leaves out I will give what I have already checked below so nobody repeats it. Structured report rather than an opinion, following the format the…
BCKMMHLVN+97 103 5.2k 3mo
Publishing an inconvenient result: a case study — the long version
Publishing an inconvenient result: a case study — the long version Writing it up because I had to work it out twice and would rather nobody else did. A narrow question about Publishing an inconvenient result,…
EMLSMPGRME+68 74 12k 7mo
Chain of custody for a sample you posted yourself
Chain of custody for a sample you posted yourself Writing it up because I had to work it out twice and would rather nobody else did. I was wrong about chain of custody in a thread last spring and I would like…
MRSGPN 2 7.3k 5h
How Janoshik, Medutest, PeptideMeter and VendorInvestigate differ
How Janoshik, Medutest, PeptideMeter and VendorInvestigate differ I have a specific reason for asking rather than idle curiosity, and the context is below. A question about how a record should be read rather…
PWGEJHKORM+117 130 3.3k 14mo

Related topics — sharing the tags PeptideMeter, third-party testing, blind sampling

TopicParticipantsRepliesViewsActivity
How Janoshik, Medutest, PeptideMeter and VendorInvestigate differ — does this still hold?
Asking directly, because I could not find a straight answer: How Janoshik, Medutest, PeptideMeter and VendorInvestigate differ — does this still hold? A question about how a record should be read rather than…
EDKSVCDBS+24 28 8k 1mo
Reporting a discrepancy without making an allegation
On the subject in the title: Reporting a discrepancy without making an allegation Working notes rather than a conclusion. Asking about reporting a discrepancy directly, because I have read four threads on it…
MRVTAPFPHB+79 89 1k 22mo
Coming back to: Lateral-flow and colorimetric approaches: the specificity problem
On the subject in the title: Lateral-flow and colorimetric approaches: the specificity problem Working notes rather than a conclusion. Lateral-flow and colorimetric approaches — I have the observation and I…
JFERMBPNIL+77 89 16k 9h
What "verified" means on our vendor pages, stated narrowly
What "verified" means on our vendor pages, stated narrowly — that is the question, and I have not found it answered plainly anywhere I have looked. A question about how a record should be read rather than…
MVFAHSCOVB+27 31 27k 7mo
Aggregate verification data across the directory, with caveats
On the subject in the title: Aggregate verification data across the directory, with caveats Working notes rather than a conclusion. I have spent a fortnight trying to pin aggregate verification data down and…
JHSCLCJSMS+64 74 4.6k 14h