IRIS8 Talk to us
Regulation · Healthcare

Private LLM for HIPAA workloads: what HIPAA requires

What the Privacy, Security and Breach Rules ask of a language model that touches PHI, and how to run one in your own cloud.

Your environmentYour cloud account (VPC), or on-prem as a scoped data-centre install in a managed engagement
You own the modelWeights, prompts and logs stay with you
8-week pilotOne workflow, a pass mark agreed in week 1
JurisdictionUS

Last reviewed

01

The rules that apply to an LLM handling PHI

Rule What it requires (paraphrased) Why it matters for an LLM Source
Security Rule (45 CFR Part 164, Subpart C) Administrative, physical and technical safeguards for electronic PHI, including risk analysis, access controls and audit controls Prompts, outputs, training data and logs that contain PHI are all ePHI HHS Security Rule
Privacy Rule Limits uses and disclosures of PHI; minimum necessary standard Training a model is a use of PHI; send only what the task needs HHS Privacy Rule
Business associate rules A vendor that creates, receives, maintains or transmits PHI for you is a business associate and needs a BAA Every vendor in the AI chain — cloud, model host, support team — that touches PHI HHS, Business Associates
Cloud guidance A cloud provider that stores ePHI is a business associate even if the data is encrypted and it has no key Encryption alone does not take a model host out of HIPAA scope HHS, HIPAA & Cloud Computing
De-identification (45 CFR 164.514) Data de-identified by Safe Harbor or Expert Determination is not PHI De-identified training data falls outside the Privacy Rule HHS, De-identification
Breach Notification Rule Notify individuals, HHS and sometimes media after a breach of unsecured PHI Leaked prompts or a copied model trained on PHI can be a reportable breach HHS, Breach Notification
02

What this means in practice

Most vendor HIPAA claims for AI come down to one thing: the vendor will sign a BAA. That's necessary, not sufficient. A BAA lets a vendor handle PHI; it doesn't run your risk analysis, decide what's minimum necessary, or keep a record of which patient data trained which model version. Three questions decide whether an LLM setup holds up:

How many parties touch PHI?

Each one needs a BAA and becomes part of your risk analysis. Running the model in your own cloud account, under the BAA you already have with your cloud provider, keeps that list short.

Does PHI end up in the model?

Fine-tuning on identifiable notes means the weights may encode PHI. We default to de-identifying training data (HHS methods) and only train on identifiable data where the task needs it and your privacy officer agrees.

Can you show what happened?

The Security Rule expects audit controls. Every prompt, output, training run and model release should be logged inside your environment.

HIPAA is not the only rule. State health-privacy laws and, for substance-use records, 42 CFR Part 2 can add requirements; your counsel should map those for your use case.

See how this would work on your data.

Book a call
03

How IRIS8 runs it

Deployment

in your AWS, Azure or GCP account under your existing cloud BAA, or on-prem as a scoped data-centre install in a managed engagement. See on-prem and VPC deployment.

Training

de-identified examples by default; masking at the gateway for anything else. See fine-tuning.

Records

on customer-VPC and on-prem deployments, logs, model versions and evals stay in your environment.

04

What we'd do first

  1. 1
    Pick one administrative workflow that touches PHI and has a clear right answer, such as prior-authorization summaries or coding support.
  2. 2
    Map the PHI it uses with your privacy officer, confirm the BAAs you already have with your cloud provider, de-identify the training examples where the task allows, and agree the pass mark.
  3. 3
    Then train and test the model in your own cloud account and reach a canary release in 8 weeks.
  4. 4
    See the 8-week pilot.
FAQ

Frequently asked questions

Is there such a thing as a HIPAA-certified LLM?

No. HHS doesn't certify products. Compliance depends on how a covered entity or business associate uses the system (HHS).

Do we need a BAA with our AI vendor?

If the vendor creates, receives, maintains or transmits PHI for you, yes (HHS).

If our data is encrypted, is the model host still a business associate?

Yes. HHS says lacking the key doesn't exempt a cloud provider (HHS).

Can we train on de-identified data without HIPAA limits?

Data properly de-identified under 164.514 is not PHI, so the Privacy Rule doesn't apply to it (HHS).

Is this the same as a private LLM for healthcare?

This page is about the rules. For use cases, see private LLM for healthcare.

Talk to us about one workflow

A 30-minute call with the IRIS8 team about your data, your environment and a first pilot.

Talk to us