Skip to content

Read epidemiology figures in report 12's Prevalence check - #150

Merged
KrishnaTO merged 2 commits into
mainfrom
claude/research-gaps-epidemiology
Oct 16, 2026
Merged

KrishnaTO merged 2 commits into
mainfrom
claude/research-gaps-epidemiology

Conversation

@KrishnaTO

Copy link
Copy Markdown
Owner

Report 12's Prevalence check still looked for the flat rate fields that claude/migrate-epidemiology-229 (#146) removed. A rebuild would have shown the 211 diseases with rates as text-only Partial. This PR fixes the check and regenerates the report.

Stacked on claude/clinical-biomarkers-model-1e02a3 (commit b2b5bb0). That branch has no PR yet, so this diff includes it. Merge the biomarkers PR first, or merge this one to land both.

Changes

  • notebook/research-gaps/build_research_gaps.py: a disease is Published when at least one EpidemiologyProfile linked by hasEpidemiologyProfile has an epiRatePer100k. The note lists the figure labels, e.g. "Prevalence · US · All". Text only in ARI_PrevalenceDesc still counts as Partial.
  • data/4-reports/12_Research_Gaps.xlsx regenerated:
    • Prevalence: 211 Published, 9 Partial, 7 Research. That matches the 211 diseases with figures.
    • Clinical Biomarkers: 11 Published, i.e. the 10 diseases from the biomarkers change plus T1D.
  • notebook/master-list-comparison/import_prevalence.py is marked superseded and exits immediately. Its 2026-10-08 import has already been migrated into figures. Running it again would write properties the ontology no longer declares.
  • data/4-reports/README.md describes that import in the past tense and explains the figure shape.
  • changelog.md entry added.

Verification

  • python notebook/research-gaps/build_research_gaps.py: Summary counts as above.
  • python .github/scripts/validate_mappings.py: 0 errors. The 5 warnings were there before this change.

🤖 Generated with Claude Code

KrishnaTO and others added 2 commits October 16, 2026 14:33
Renames BiochemicalMarker to ClinicalBiomarker and moves the field from
Disposition/Serological Markers to Clinical Profile, so biopsy, imaging and
physiological tests have a home alongside lab analytes. Adds markerType,
markerSensitivity, markerSpecificity and loincCode, types the six T1D markers,
and rebuilds twelve retired ARI#132 test findings as biomarkers on their
diseases. Data model v4 spreadsheet and OWL updated; report 12's field list
follows v4.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude/migrate-epidemiology-229 moved prevalence and incidence into
EpidemiologyProfile figures and removed the flat fields, but
build_research_gaps.py still looked for them, so a rebuild showed the 211
diseases with rates as text-only Partial. The check now counts a disease
as Published when a figure linked by hasEpidemiologyProfile has an
epiRatePer100k, keeping the ARI_PrevalenceDesc -> Partial fallback.

Report 12 is regenerated: Prevalence 211 Published / 9 Partial / 7
Research; Clinical Biomarkers 11 Published.

import_prevalence.py is marked superseded and exits, since its import was
already migrated and re-running it would write undeclared properties. The
reports README describes the figure shape instead of the old field names.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@KrishnaTO
KrishnaTO merged commit fd161e5 into main Oct 16, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant