Private LLM for HIPAA workloads: what HIPAA requires
What the Privacy, Security and Breach Rules ask of a language model that touches PHI, and how to run one in your own cloud.
The rules that apply to an LLM handling PHI
| Rule | What it requires (paraphrased) | Why it matters for an LLM | Source |
|---|---|---|---|
| Security Rule (45 CFR Part 164, Subpart C) | Administrative, physical and technical safeguards for electronic PHI, including risk analysis, access controls and audit controls | Prompts, outputs, training data and logs that contain PHI are all ePHI | HHS Security Rule |
| Privacy Rule | Limits uses and disclosures of PHI; minimum necessary standard | Training a model is a use of PHI; send only what the task needs | HHS Privacy Rule |
| Business associate rules | A vendor that creates, receives, maintains or transmits PHI for you is a business associate and needs a BAA | Every vendor in the AI chain — cloud, model host, support team — that touches PHI | HHS, Business Associates |
| Cloud guidance | A cloud provider that stores ePHI is a business associate even if the data is encrypted and it has no key | Encryption alone does not take a model host out of HIPAA scope | HHS, HIPAA & Cloud Computing |
| De-identification (45 CFR 164.514) | Data de-identified by Safe Harbor or Expert Determination is not PHI | De-identified training data falls outside the Privacy Rule | HHS, De-identification |
| Breach Notification Rule | Notify individuals, HHS and sometimes media after a breach of unsecured PHI | Leaked prompts or a copied model trained on PHI can be a reportable breach | HHS, Breach Notification |
What this means in practice
Most vendor HIPAA claims for AI come down to one thing: the vendor will sign a BAA. That's necessary, not sufficient. A BAA lets a vendor handle PHI; it doesn't run your risk analysis, decide what's minimum necessary, or keep a record of which patient data trained which model version. Three questions decide whether an LLM setup holds up:
How many parties touch PHI?
Each one needs a BAA and becomes part of your risk analysis. Running the model in your own cloud account, under the BAA you already have with your cloud provider, keeps that list short.
Does PHI end up in the model?
Fine-tuning on identifiable notes means the weights may encode PHI. We default to de-identifying training data (HHS methods) and only train on identifiable data where the task needs it and your privacy officer agrees.
Can you show what happened?
The Security Rule expects audit controls. Every prompt, output, training run and model release should be logged inside your environment.
HIPAA is not the only rule. State health-privacy laws and, for substance-use records, 42 CFR Part 2 can add requirements; your counsel should map those for your use case.
See how this would work on your data.
Book a callHow IRIS8 runs it
Deployment
in your AWS, Azure or GCP account under your existing cloud BAA, or on-prem as a scoped data-centre install in a managed engagement. See on-prem and VPC deployment.
Training
de-identified examples by default; masking at the gateway for anything else. See fine-tuning.
Records
on customer-VPC and on-prem deployments, logs, model versions and evals stay in your environment.
What we'd do first
- 1Pick one administrative workflow that touches PHI and has a clear right answer, such as prior-authorization summaries or coding support.
- 2Map the PHI it uses with your privacy officer, confirm the BAAs you already have with your cloud provider, de-identify the training examples where the task allows, and agree the pass mark.
- 3Then train and test the model in your own cloud account and reach a canary release in 8 weeks.
- 4See the 8-week pilot.
Frequently asked questions
Is there such a thing as a HIPAA-certified LLM?
No. HHS doesn't certify products. Compliance depends on how a covered entity or business associate uses the system (HHS).
Do we need a BAA with our AI vendor?
If the vendor creates, receives, maintains or transmits PHI for you, yes (HHS).
If our data is encrypted, is the model host still a business associate?
Yes. HHS says lacking the key doesn't exempt a cloud provider (HHS).
Can we train on de-identified data without HIPAA limits?
Data properly de-identified under 164.514 is not PHI, so the Privacy Rule doesn't apply to it (HHS).
Is this the same as a private LLM for healthcare?
This page is about the rules. For use cases, see private LLM for healthcare.