Written by

Founder & Product Designer at MedVertical
Discussion André Sheydin · 4 hr ago

Continuous FHIR conformance with IRIS/HealthShare: regression testing + drift tracking patterns

Hello everyone,

I am André from MedVertical. We are exploring InterSystems-native ways to operationalize continuous FHIR conformance: repeatable regression runs, baseline/delta comparisons, and evidence-style reporting to detect drift after releases and IG changes.

In many FHIR implementations, validation is done “point-in-time” in pre-prod, but conformance degrades in production due to IG/profile updates, terminology changes, mapping evolution, upstream releases, and configuration drift.

Environment context (to anchor recommendations):

  • InterSystems: IRIS for Health and/or HealthShare (both relevant)
  • FHIR: R4 and R5 depending on customer setup
  • Goal: repeatable regression runs after deployments/upgrades; deterministic results and reproducibility metadata captured per run

If helpful, this is the reference context for what I mean by baseline/delta + evidence reporting: https://medvertical.com/records

I’m looking for proven InterSystems-native patterns (or community tooling) for:

  • Regression testing as a gate: 
    What do you use to run automated regression tests repeatedly (e.g., %UnitTest, IPM-based test runs, CI pipelines)? Any reference implementations?
  • Test data + scenarios:
    How do you manage stable but meaningful FHIR fixtures (Bundles/resources/search scenarios) for regression testing?
  • Baseline/delta + evidence reporting:
    If you track changes over time, which metrics or report formats have worked best to make deltas actionable (beyond pass/fail)?

If you can share links to Open Exchange packages, repos, or CI examples—and a short note on what worked vs. what didn’t—that would be very helpful.