Diadia Transparency Lab

Transparency Reports

Every health claim an AI makes, decomposed into a mechanism, checked against the evidence, and published with the reasoning fully in the open.

Abstract — Generative models now answer health questions in fluent, confident prose. That fluency hides its own reasoning. And when these models are put to work in clinical settings, fluency is not enough: claims that inform care demand a higher bar of scrutiny — each one verified against the published evidence before it is trusted. This resource publishes the reasoning instead: for each claim we show what was asserted, what the evidence supports, and what the system inferred — as an inspectable mechanism graph rather than a verdict to be taken on trust.

01 — Purpose

Why this exists

State-of-the-art models still hallucinate — they produce fluent, plausible-sounding health claims that are subtly wrong, unsupported, or invented outright, and present each one with the same confidence. In a clinical context the reader cannot tell a well-evidenced claim from a confident guess — and the cost of being wrong is asymmetric.

This project exists to shed light on that gap. Every claim here is put through Diadia’s proprietary claim-verification process — decomposed into its underlying mechanism, checked against the published evidence link by link, and rolled up into an auditable verdict. The aim is not another opaque answer to trust, but clarity: the reasoning, the evidence, and the uncertainty, all in the open.

02 — What this is

A library of decomposed claims

Each report is built around one living figure: an interactive mechanism graph whose nodes are biomedical entities — biomarkers, processes, symptoms, outcomes — and whose edges are causal or evidential links. Links are encoded by evidence state through line weight, dash and glyph, never by colour alone, so every figure reads in greyscale and in print.

The catalogue spans nutrition, sleep, immunity, metabolism and mood. Some claims hold; some break; most land in the honest middle — plausible, not proven.

03 — Methodology

How every claim is checked

The same four steps run on every claim, so reports stay comparable across the library:

  1. DecomposeThe claim is broken into mechanism steps and drawn as a neutral hypothesis graph — every link an equal hairline.
  2. Map evidenceStudies reweigh each link. Some thicken to established, some hold moderately, some break, some are left untested.
  3. EnrichEvidence may reveal explanatory routes the claim never mentioned, surfaced as parallel paths.
  4. Roll upSurviving paths combine into a single auditable verdict — traceable back to every edge and source.
=s(ℓe)·f(ce)
=mine∈p
=unsupporteda critical edge breakssupportedevery path fully supportedplausibleotherwise

An edge weight scales its evidence label by confidence, and a path is only as strong as its weakest edge. The verdict is a deterministic label roll-up over every root-to-leaf path — not a numeric score: weights rank and display the evidence, while labels, confidence and critical-edge priority decide the verdict.

4554
claims published
2924 / 4554
claims not fully established
72049
citations across all claims

The full methodology — and an evaluation of it across frontier models — is detailed in our paper, Claim-Level Transparency Analysis of LLM-Generated Diagnostic Reports ↗.

Browse all claims

4554 claims
Plausible
neurological

Does progesterone metabolize into allopregnanolone that modulates GABA-A receptors?

Progesterone is converted to allopregnanolone, which positively modulates GABA-A receptors and supports sleep and emotional regulation.

22 sourcesRead report
Plausible
hematological

Can low folate and vitamin B12 impair homocysteine remethylation and cause macrocytic red-cell changes?

Low folate and vitamin B12 can disrupt homocysteine remethylation, raise homocysteine, and contribute to macrocytic red-cell changes.

24 sourcesRead report
Plausible
nutritional

Can low folate, vitamin B12, and magnesium despite supplementation indicate absorption or utilization problems?

Persistently low folate, vitamin B12, and magnesium with elevated homocysteine despite supplementation can indicate absorption, formulation, dosing, or utilization problems.

18 sourcesRead report
Plausible
metabolic

Can cutaneous porphyrias result from hepatic heme-synthesis defects?

Cutaneous porphyrias can arise from inherited or acquired defects in the hepatic heme-synthesis pathway, causing porphyrin accumulation and photosensitive skin lesions.

18 sourcesRead report
Plausible
nutrition

Does avoiding fish and fish-derived foods lower intake of EPA, DHA, selenium, zinc, and vitamin D?

Avoiding fish and fish-derived foods lowers intake of EPA, DHA, selenium, zinc, and vitamin D and can reduce their systemic status.

15 sourcesRead report
Plausible
endocrine

Can elevated cortisol and chronic sleep restriction lower free T3 by suppressing T4-to-T3 conversion?

Elevated cortisol and chronic sleep restriction can contribute to lower free T3 by impairing peripheral T4-to-T3 conversion.

8 sourcesRead report