How AI Phone Agents Verify Callers Under HIPAA: Caregivers, Voicemail, BAAs and Voice Clones
· Alex Dalyac, Founder & CEO
An AI phone agent can be HIPAA compliant, but only if the vendor signs a BAA and the practice sets clear rules for who may hear what. HIPAA requires verifying a caller's identity and authority when they aren't known, without prescribing a method.
Below: a disclosure ladder, caregiver calls, voice-clone scams, BAAs, and language access.
Why is the phone the weakest point for patient privacy?
A phone caller can't show ID, and the usual check, name plus date of birth, is often easy for someone else to know. The FBI now warns that AI-cloned voices "can sound nearly identical" to real people (FBI IC3, May 2025).
Before a disclosure, a covered entity must verify the identity and authority of a person requesting protected health information if they aren't already known (45 CFR 164.514(h)). HHS's audio-only guidance confirms the rules don't mandate a specific method (HHS OCR).
| Phone risk | What goes wrong | What the guidance says |
|---|---|---|
| Caller knows name and date of birth | A relative or ex-partner hears results they shouldn't | Verify identity and authority when the caller isn't known |
| Cloned or spoofed voice | A "doctor" or "patient" asks to change a phone number or send records | Hang up and call back on a number you already trust |
| Message left on voicemail | A housemate hears a diagnosis | Leave minimal content: name, number, call back |
Most phone privacy failures come from unclear rules, not from the technology.
How should an AI phone agent verify callers before sharing information?
Match the check to the request: scheduling needs two identifiers matched to the chart; clinical details and contact changes go to the portal or a human.
| Caller request | Check before acting | Who handles it |
|---|---|---|
| Book, reschedule or cancel their own visit | Name and date of birth matched to the EHR | AI agent |
| Prescription refill request | Identifiers plus medication name; request only, nothing disclosed | AI takes it, staff approve |
| Test results or clinical questions | Results via the patient portal, or a clinician call back | Staff or clinician |
| Change phone number, address or email | Call back on the number already on file | Staff |
| Records release to a third party | Written authorization | Staff |
| Caller can't be matched | Share nothing, take a message | AI, then staff |
The callback rule for contact changes stops most account takeovers, cloned voice or not.
The practice sets each rule. On pharmacy refill calls, for example, YouSquared's AI Receptionist collects the prescription number and date of birth before taking the request.
Can healthcare voice AI handle calls where a caregiver or spouse is on the line?
Yes. HIPAA lets a provider share information with family or friends involved in the patient's care if the patient is present and agrees, doesn't object, or non-objection can be reasonably inferred (45 CFR 164.510(b); HHS FAQ). No written permission is required.
| Scenario | What the AI can do | When to hand to staff |
|---|---|---|
| Patient on the line with a spouse | Ask the patient "Is it OK if we discuss this with them?", then book or confirm | Clinical questions |
| Caregiver calls alone, scheduling only | Book or move the visit; share nothing beyond the appointment | Caregiver asks about results |
| Caller claims authority that isn't on file | Take a message | Always |
Asking the patient on the call is the simplest consent, and it belongs in the call record.
How should practices protect against AI-cloned voice scams?
Treat the voice as unverified and check the request instead. The FBI's advice is to "independently identify a phone number for the person and call to verify their authenticity" (FBI IC3).
| Request that triggers a callback | Call back on |
|---|---|
| A "doctor" asking for a patient's records or results | The office's published number |
| A "patient" changing their phone number or email | The number already in the chart |
| A "vendor" or "pharmacy" asking for payment or login details | The number on your contract |
None of these requests needs to be completed on the same call.
YouSquared's transfers dial out from your verified caller ID or your dedicated YouSquared number, never an unfamiliar number (see call transfer).
Which parts of an AI or VoIP phone stack need a BAA?
Anything that stores call audio, transcripts or messages with patient information. HHS says a cloud provider that maintains ePHI is a business associate even if it can't read the encrypted data (HHS cloud guidance).
| Component | Needs a BAA? | Ask the vendor |
|---|---|---|
| AI receptionist (audio, transcripts, summaries) | Yes | Retention, deletion, and whether your data trains models |
| VoIP host, voicemail, call recording | Yes | Are voicemail and recordings stored? |
| SMS and fax | Yes, if PHI is sent | What content goes in texts |
| Pure transmission with no storage | Usually not ("conduit") | Confirm nothing is stored |
| Google Voice | Only Workspace "managed users" are covered (Google) | Accept the BAA in the Admin console |
| Overseas virtual assistants | Yes, as workforce or business associate | Access controls and where data is stored |
The conduit exception is narrow: storage of any kind makes a vendor a business associate.
HIPAA doesn't ban storing ePHI outside the US, but HHS says the added risks belong in your risk analysis (HHS FAQ). YouSquared is HIPAA compliant, SOC 2 audited, and signs a BAA on Business and Enterprise plans.
How do small practices handle non-English-speaking callers under Section 1557?
Offer a qualified interpreter when interpretation is needed, and never make the patient bring their own (45 CFR 92.201; HHS OCR). Machine translation of critical documents must be reviewed by a qualified human translator.
| Option | Available | Best for |
|---|---|---|
| Bilingual front desk | Office hours | Everything, if staffed |
| Phone interpreter line | 24/7, billed per minute | Clinical and consent conversations |
| AI receptionist in the caller's language | 24/7 | Scheduling, refills, routing |
A practice that's mostly Spanish-speaking still needs a human interpreter path for clinical calls.
YouSquared's AI Receptionist handles calls in 57 languages and switches automatically when a caller speaks another one.
Results: 75% of calls resolved by the AI, the rest transferred with a summary
In our data from a 12-location gastroenterology group in New York, 75% of calls were resolved without a human and 25% were transferred, each with a summary. Of after-hours calls, 19% were urgent clinical and were flagged for the on-call team. In two primary care practices, 52% were resolved by the AI and 48% transferred by design during open hours (YouSquared call data, 2026).
| Practice | AI answers | Resolved without a human |
|---|---|---|
| 12-location GI group, New York | Every call, 24/7 | 75% |
| Two primary care practices, New York | Overflow and after hours | 52% |
Strict disclosure rules don't stop the AI handling most calls: scheduling needs little PHI.
How to set it up
Sign the BAA, then write your disclosure ladder: which requests the AI completes, which go to the portal, and which transfer to whom. We configure it with you.
See how YouSquared works for primary care, behavioral health, gastroenterology, and other healthcare practices. Pricing starts from $1 a call (pricing). Start free on the web or book a demo to walk through your rules with our team.
Key terms
- Business associate agreement (BAA). The contract HIPAA requires with any vendor that creates, receives, stores or transmits PHI for a practice.
- Conduit exception. Transmission-only services with no more than temporary storage, which don't need a BAA.
- Qualified interpreter. Under Section 1557, an interpreter with demonstrated proficiency in both languages, not a family member.
FAQ
Do I need HIPAA compliance for an AI call agent that books into my practice management system? Yes. It hears and stores patient information, so the vendor is a business associate and must sign a BAA.
What can a practice leave on a patient's voicemail? Keep it minimal: the practice name, a call-back number, and what's needed to confirm an appointment (HHS FAQ).
Is Google Voice OK for a small psychiatry practice? Only on a Google Workspace account with the BAA accepted; personal Google Voice isn't covered. Check your state's mental health privacy rules too.
Is YouSquared secure for a medical practice? Yes. YouSquared is HIPAA compliant, SOC 2 audited, and signs a business associate agreement (BAA). See Security.