Policy Archive · Episode 04

The Case of the Fitness Frenzy

Explore the real-world policies behind this case. Follow proposed and existing policy, potential gaps, and outcomes as they develop.

• Proposed Policy Draft — Not for Implementation

  FDA Artificial Intelligence-Enabled Device Software Functions: Lifecycle Management and Marketing Submission Recommendations

  FDA's draft guidance proposes recommendations for the design, development, deployment, maintenance, and marketing submissions of AI-enabled medical devices.

  Identifier

  FDA AI Device Lifecycle Draft Guidance

  Jurisdiction

  United States (Federal)

  Status

  Draft — Not for Implementation

  Dates

  FDA issued the draft guidance in January 2025. It remains Draft — Not for Implementation. Related federal device regulations include 21 CFR Parts 803 and 806, among other applicable FDA device regulations.

  Latest update

  January 2025

  What it does: FDA's draft guidance proposes recommendations for the design, development, deployment, maintenance, and marketing submissions of AI-enabled medical devices. It takes a total-product-lifecycle approach to managing AI-related risks and supporting the safety and effectiveness of AI-enabled devices.

  Potential impact: If finalized, the guidance would provide manufacturers and FDA with a more comprehensive framework for evaluating AI-enabled medical devices throughout their lifecycle rather than focusing only on the device at the time of its initial authorization. Its relevance to Episode 4 is limited by an important boundary: the guidance applies to AI-enabled devices regulated by FDA. It does not establish a comparable framework for general consumer or wellness products that fall outside FDA medical-device oversight.

  Sources

  • FDA — Artificial Intelligence-Enabled Device Software Functions: Lifecycle Management and Marketing Submission Recommendations
• Existing Policy In Effect

  FDA Medical Device Regulation and General Wellness Policy

  FDA regulates products that meet the federal definition of a medical device, and FDA's General Wellness policy explains its approach to low-risk products intended to maintain or encourage a healthy lifestyle.

  Identifier

  21 CFR § 890.5850

  Jurisdiction

  United States (Federal)

  Status

  In Effect

  Dates

  FDA medical-device requirements are in effect. The current General Wellness guidance was issued in January 2026. Relevant regulation includes 21 CFR § 890.5850 — Powered Muscle Stimulator.

  Latest update

  General Wellness guidance — January 2026 21 CFR § 890.5850 — in effect

  What it does: FDA regulates products that meet the federal definition of a medical device. Depending on their classification and intended use, medical devices can be subject to requirements involving premarket review, quality systems, labeling, safety, and post-market oversight. For example, federal regulations specifically classify powered muscle stimulators under 21 CFR § 890.5850. FDA's General Wellness: Policy for Low Risk Devices, revised in January 2026, explains FDA's approach to low-risk products intended to maintain or encourage a healthy lifestyle. This creates an important regulatory boundary for Episode 4. A product's status depends on factors including its intended use and claims; simply calling a product "wellness" does not automatically place it outside FDA oversight.

  Potential impact: FDA provides substantial oversight when a product falls within medical-device regulation. But some low-risk consumer wellness products may fall outside FDA medical-device oversight. That becomes particularly significant as consumer products incorporate AI and connected hardware capable of affecting a person's body or immediate physical environment.

  Sources

  • eCFR — 21 CFR § 890.5850, Powered Muscle Stimulator
  • FDA — General Wellness: Policy for Low Risk Devices
  • FDA — Guidances with Digital Health Content
• Existing Policy Final Guidance

  FDA Predetermined Change Control Plans for AI-Enabled Medical Devices

  FDA's guidance on Predetermined Change Control Plans (PCCPs) provides a framework for manufacturers of FDA-regulated AI-enabled devices to identify certain planned modifications in advance.

  Identifier

  FDA PCCP Guidance

  Jurisdiction

  United States (Federal)

  Status

  Final Guidance

  Dates

  FDA's PCCP guidance for AI-enabled device software functions is final. It applies within existing FDA medical-device marketing pathways and requirements.

  Latest update

  Final guidance

  What it does: FDA's guidance on Predetermined Change Control Plans (PCCPs) provides a framework for manufacturers of FDA-regulated AI-enabled devices to identify certain planned modifications in advance. A PCCP can describe proposed modifications, how they will be developed and validated, and how their potential impact will be assessed. FDA reviews the plan as part of the device's marketing submission.

  Potential impact: The framework addresses an important issue raised by Episode 4: an AI-enabled device may change after deployment. For FDA-regulated medical devices, PCCPs provide a mechanism for evaluating certain planned changes while continuing to consider device safety and effectiveness. However, PCCPs do not establish a general consumer right to approve, reject, stop, or override individual changes. The framework also does not extend to general consumer-wellness products outside FDA medical-device oversight.

  Sources

  • FDA — Marketing Submission Recommendations for a Predetermined Change Control Plan for Artificial Intelligence-Enabled Device Software Functions
• Policy Gap Partial Gap

  AI-Mediated Physical Control and Bodily Autonomy

  Jurisdiction

  United States (Federal)

  Status

  Partial Gap

  What it does: Existing federal frameworks provide important protections. FDA regulates medical devices, the Consumer Product Safety Commission (CPSC) has authority over safety hazards associated with many consumer products, and FTC Act Section 5 prohibits unfair or deceptive acts or practices. But Judge GPT TV's research did not identify a federal framework specifically addressing AI-controlled consumer devices as a category when those systems can take actions that physically affect a person's body or immediate environment but fall outside FDA medical-device regulation. The issue is therefore not an absence of product-safety or consumer-protection law. The potential gap lies in AI-mediated physical control itself — including the boundaries placed on software that has authority to act physically upon its user.

  Potential Policy Question

  When an AI-controlled consumer device can physically affect its user, what safeguards should govern the system's authority over the person's body or immediate environment?

  Sources

  • FDA — General Wellness: Policy for Low Risk Devices
  • U.S. Consumer Product Safety Commission — Regulations, Laws & Standards — CPSC
  • Federal Trade Commission — Federal Trade Commission Act, Section 5 — FTC
• Policy Gap Partial Gap

  Ongoing Consent, Override, and Escalation

  Jurisdiction

  United States (Federal)

  Status

  Partial Gap

  What it does: Existing federal policy addresses parts of this problem. FDA's PCCP framework addresses certain planned changes to FDA-regulated AI-enabled medical devices. FTC Section 5 can address unfair or deceptive consumer practices. CPSC has broader authority over consumer-product hazards. But Judge GPT TV's research did not identify a federal framework specifically determining whether initial consent to an AI-enabled consumer service authorizes later or increasingly intensive physical interventions. Research also did not identify a general federal requirement specifically requiring AI-controlled consumer devices outside FDA medical-device oversight to provide users with an effective mechanism to withdraw authorization, override the AI, or immediately stop its physical actions.

  Potential Policy Question

  When an AI-controlled consumer device changes or escalates its physical interventions, should the user be required to retain an effective way to withdraw consent, override the system, or stop its actions?

  Sources

  • FDA — Predetermined Change Control Plans for AI-Enabled Device Software Functions
  • Federal Trade Commission — Federal Trade Commission Act, Section 5 — FTC
  • U.S. Consumer Product Safety Commission — Regulations, Laws & Standards — CPSC