← Field Notes
·14 min read·Heath Parish

Why Hospitals, Law Firms, and Defense Contractors Cannot Deploy AI Without Governed Memory

Hospitals, law firms, and defense contractors operate under HIPAA, attorney-client privilege, ITAR, CMMC, and CUI rules that most AI memory systems were never designed to respect. Here is what governed memory changes for each sector, and why authority verification at execution time is now a procurement requirement.

Enterprise AI adoption is no longer theoretical. Hospitals are piloting clinical documentation assistants. Law firms are running discovery, drafting, and research through AI copilots. Defense contractors are experimenting with AI for logistics, engineering documentation, and program management. The technology has moved past demonstration and into production.

The governance layer has not moved with it.

In each of these three sectors, the rules that govern information are older than the AI systems now being asked to handle it. HIPAA was written in 1996. Attorney-client privilege predates the United States. ITAR has governed defense-related technical data since 1976. CMMC is newer, but the underlying requirements around Controlled Unclassified Information have existed for decades. None of these frameworks were designed for autonomous systems that retain context across sessions, retrieve information on their own, and take action on behalf of users.

That mismatch is the reason regulated organizations cannot deploy general-purpose AI memory without a governance layer built into the execution path. This post walks through what each sector actually requires, where standard AI memory fails, and what governed memory looks like in practice.

Why This Matters Now

Three forces are converging at the same time:

  • AI systems are moving from stateless chat to persistent memory. Every major model provider now offers some form of long-term memory, retrieval, or continuity across sessions.
  • AI agents are moving from suggestions to actions. They retrieve records, draft communications, submit forms, and increasingly touch systems of record.
  • Regulators are moving from guidance to enforcement. HHS, state attorneys general, bar associations, and the Department of Defense have all signaled that AI does not receive a compliance exemption.

The organizations most exposed to this convergence are the ones that already operate under the strictest data-handling rules. Hospitals, law firms, and defense contractors do not get to treat AI as an experiment. Every AI action in these environments is a potential regulatory event.

Hospitals: HIPAA, PHI, and the 18 Identifiers

HIPAA does not care whether a system is an intern, a database, or a large language model. If protected health information (PHI) enters a system, that system becomes part of the covered entity's compliance surface. The Privacy Rule and Security Rule apply. Business Associate Agreements apply. Breach notification applies.

PHI is not limited to diagnoses or medical record numbers. HIPAA defines eighteen identifiers that, when combined with health information, create protected data. That list includes names, addresses smaller than a state, dates related to an individual, phone numbers, email addresses, Social Security numbers, medical record numbers, health plan numbers, account numbers, certificate numbers, vehicle identifiers, device identifiers, URLs, IP addresses, biometric identifiers, full-face photographs, and any other unique identifying number or code.

Most AI memory systems store whatever the user or agent sends them. There is no execution-time inspection of the payload. There is no automated detection of PHI. There is no policy that says a certain identifier must be tokenized before storage. The memory system simply remembers.

That is a HIPAA problem the moment a clinician, a patient portal, or an intake agent uses the tool. And it is not solved by encryption at rest. Encryption protects data from external attackers. It does not stop the AI from retrieving PHI on behalf of a user whose authority to see that patient has expired.

Governed memory approaches this differently. Sensitive identifiers are detected before storage, tokenized so the raw value never enters the memory store, and reauthorized on every retrieval. If a clinician's relationship to a patient ends, the memory does not forget the record, but the authority to detokenize it does not survive the change. That distinction is what HIPAA has always required and what most AI memory systems cannot demonstrate.

Law Firms: Privilege, Conflicts, and the Ethics Opinions Already on the Table

Law firms operate under a different but equally strict regime. Attorney-client privilege is not a policy the firm chooses to adopt. It is a rule of evidence and a rule of professional conduct. ABA Model Rules 1.1, 1.6, and 1.9 create duties of competence, confidentiality, and loyalty that extend to every system that touches client information.

In the last two years, formal ethics opinions have made the AI implications explicit. ABA Formal Opinion 512, issued in 2024, requires lawyers using generative AI to understand the technology, protect confidential information, ensure competent use, communicate with clients about material use, and supervise AI output. Several state bars have issued similar guidance.

None of that is satisfied by an AI memory system that stores privileged material without an authority model. The specific risks are concrete:

  • Cross-matter contamination. An associate uses the same AI assistant on Matter A and Matter B. Without tenant isolation and authority scoping, retrieved context from one matter can bleed into work product on another.
  • Conflict exposure. If the AI retrieves information from a prior matter that creates a positional or direct conflict, and the firm cannot prove authority was checked at retrieval, the firm has a Rule 1.7 and 1.9 problem.
  • Waiver of privilege. Privilege can be waived by disclosure to a third party. A memory system operated by a vendor without a defensible authority chain and audit trail creates a plausible waiver argument for opposing counsel.
  • Discovery obligations. Once a firm uses AI memory, that memory may become discoverable. If the firm cannot produce audit evidence of what the system stored, retrieved, and disclosed, the firm is exposed.

Governed memory addresses these risks by making authority verification part of every retrieval, tokenizing sensitive fields before storage, isolating tenants at the data layer, and producing audit evidence that shows who requested what, when, under what authority, and what governance decision was made. Those are not premium features. In legal, they are the price of using AI at all.

Defense Contractors: ITAR, EAR, CMMC, and CUI

Defense contractors face the most operationally strict framework of the three. Technical data covered by the International Traffic in Arms Regulations (ITAR) or the Export Administration Regulations (EAR) cannot be disclosed to a foreign person without a license. A foreign person includes a foreign national employee, a foreign cloud region, and in many cases a foreign-owned service provider.

Controlled Unclassified Information (CUI) has its own set of rules under DFARS 252.204-7012 and the Cybersecurity Maturity Model Certification (CMMC) 2.0 framework. CMMC Level 2 requires alignment with all 110 controls in NIST SP 800-171, including access control, audit and accountability, identification and authentication, and system and information integrity.

A general-purpose AI memory system almost certainly fails several of these controls out of the box:

  • Access control (3.1.x). Standard AI memory does not enforce authority at retrieval time or scope access by role, project, or need-to-know.
  • Audit and accountability (3.3.x). Standard AI memory does not produce tamper-evident audit records that show why each access decision was made.
  • Identification and authentication (3.5.x). Standard AI memory often accepts a session token established at login and treats it as valid for the life of the session, even if authority has changed.
  • Media protection (3.8.x). Standard AI memory stores sensitive fields in plaintext inside vector databases and logs, creating uncontrolled copies.

For an ITAR-regulated program, a single retrieval by a memory system hosted in a foreign region, or accessed by a foreign national engineer whose clearance changed yesterday, is a reportable event. The contractor cannot argue that the AI did it. The contractor is responsible for the system.

Governed memory reduces this exposure by verifying authority at execution time, tokenizing controlled technical data before it enters the store, isolating tenants so program data does not cross program boundaries, and producing the audit evidence CMMC assessors ask for. It does not replace the compliance program. It gives the compliance program something to point at.

What These Three Sectors Have in Common

The specific rules differ. The underlying pattern is identical. In each sector:

  • Sensitive information is defined by law, not by policy.
  • Authority to access that information is conditional and can change without notice.
  • The organization is required to prove, after the fact, why access was granted or denied.
  • The organization, not the vendor, is on the hook when the system fails.

That pattern is exactly what execution-time governance is built for. Authorization at session start cannot answer the question a HIPAA auditor, a bar counsel, or a CMMC assessor is going to ask. The question is not whether the user logged in. The question is whether the specific retrieval, the specific disclosure, the specific action was still supported by valid authority at the moment it occurred, and whether the organization can prove it.

What Governed Memory Actually Does Differently

Trace Continuity is built around a single principle: governance belongs in the execution path, not in a dashboard reviewed later. In practice, that means every governed operation follows a defined order.

  • Authority is verified against the current state of the user, agent, delegation, and revocation record.
  • Governance policy is evaluated against the requested action, the tenant, and the classification of the data involved.
  • Sensitive fields are detected and tokenized before anything is written to governed memory.
  • The governed action executes only if authority and policy allow it.
  • Retrieval reauthorizes against current authority, not the authority that existed when the memory was written.
  • Audit evidence is written as part of the operation, not reconstructed from logs later.

For a hospital, that means the discharge summary the AI drafted last week does not become retrievable by a clinician whose relationship to that patient ended yesterday. For a law firm, that means the memo the AI drafted on Matter A does not surface in Matter B when a conflict exists. For a defense contractor, that means the technical data on Program X does not leak into a query submitted by an engineer cleared only for Program Y.

The mechanism is the same in every case. Authority is checked at execution time, not inherited from a login that happened hours or days earlier.

Procurement Questions That Actually Matter

If an organization in one of these sectors is evaluating an AI memory or agent platform, the following questions separate marketing from architecture:

  • Where and when is authority verified? At session start only, or before every governed action?
  • How does the system handle revocation between the time information was stored and the time it is retrieved?
  • Are sensitive identifiers detected and tokenized before storage, or after?
  • Is there a mandatory execution path that all reads and writes go through, or can developers bypass it?
  • Is bypass detectable? Does the build fail when someone writes code that skips the governance layer?
  • What audit evidence is produced, and can it be exported in a form an auditor or regulator will accept?
  • How is tenant isolation enforced at the data layer, not just the application layer?
  • Where is data stored, and can the vendor demonstrate that no foreign-person access exists on ITAR workloads?

The vendors that can answer these questions with architecture, not adjectives, are the ones ready for regulated deployment. The vendors that cannot are the ones that will cause a breach, a bar complaint, or a DFARS incident report inside the first year of use.

The Practical Path Forward

The right posture for regulated organizations is not to avoid AI. Competitors are adopting it. Patients, clients, and program offices are starting to expect it. The right posture is to insist that the memory layer, the authority layer, and the audit layer meet the standard the rest of the organization already meets.

That is what Trace Continuity Labs is built to provide. Governed memory infrastructure with execution-time authority verification, tokenization before storage, tenant isolation, and audit evidence produced as part of every operation. Designed for the sectors that cannot afford to remember irresponsibly.

For a related discussion of why authorization at session start is no longer sufficient, see "AI Governance Cannot Stop at Authorization." For the distinction between identity and permission that underlies all of this, see "Authentication Is Not Authority."

In regulated sectors, AI does not get a compliance exemption. Governance has to be built into the memory, not bolted on after the breach.

Trace Continuity Labs — Governed memory infrastructure for hospitals, law firms, and defense contractors.

Healthcare AILegal AIDefense AIHIPAACMMCITARAI GovernanceCompliance