Is AI ready to take over your prescriptions? Doctors are wary of Utah’s automated refill program

Utah’s AI-Powered Prescription Refill Program Sparks Debate on Medical Automation

Is AI ready to take over – Earlier this year, a groundbreaking initiative in Utah brought the question of AI’s role in healthcare to the forefront: Can artificial intelligence assume responsibilities once reserved for human doctors? The state’s new automated prescription refill system, operated by the AI platform Doctronic, allows residents to obtain refills without visiting a physician. This development has ignited a heated discussion among medical professionals, legal experts, and public health officials about whether AI is prepared to handle critical medical decisions.

The Rise of AI in Routine Healthcare

The pilot program, which began in January, enables patients to access their medications through an online interface managed by Doctronic. By interacting with an AI chatbot, users can verify their prescriptions, provide medical history, and receive refills instantly. This system taps into a national pharmacy database to ensure prescriptions are valid and up-to-date. While proponents argue it streamlines care and reduces administrative burdens, critics worry about the implications of delegating medical authority to machines.

Doctronic’s rollout was facilitated by Utah’s “regulatory sandbox” policy, which permits state officials to temporarily waive certain rules for innovative technologies. This framework allowed the AI company to bypass traditional licensing requirements, creating a unique scenario where AI specialists, not doctors, oversee the process. The initiative has been met with mixed reactions, with some experts praising its efficiency and others questioning its long-term safety.

Experts Weigh In on AI’s Readiness

Dr. Eric Bressman, a physician at the University of Pennsylvania, acknowledges the significance of the program. “We have crossed a threshold in terms of granting a non-human entity a medical license,” he said. While not opposing AI’s use in healthcare, Bressman emphasizes the need for strict oversight. “AI should meet the same rigorous standards as human doctors, who undergo years of training and testing before practicing,” he added.

Others share similar concerns. Dr. Alan Smith, head of Utah’s medical licensing board, expressed frustration over the program’s implementation. “We were essentially told: ‘Yes this is going on. And no, you don’t have a say in it,’” Smith said in a recent statement. His board, composed of 11 members, issued a March letter urging the program’s suspension, citing risks such as incorrect drug prescriptions and potential side effects. Despite these warnings, Doctronic continues to operate, with plans to shift fully to automated refills in the near future.

Regulatory Challenges and Legal Questions

The program has exposed a critical gap between state and federal regulations. While medical professionals are typically licensed by state boards, federal agencies like the FDA are responsible for overseeing technologies that directly affect patient care. This division has raised questions about whether Doctronic’s AI qualifies for federal oversight, given its ability to make independent medical decisions.

Doctronic’s executives defend their approach, stating their focus is on improving patient access. “Our goal is to meet patients where they need healthcare,” said Dr. Adam Oskowitz, a co-founder of the company. “We try not to get too deep into the weeds on the regulatory side.” However, some argue that the system’s autonomy has blurred the line between AI and human expertise. “If an AI can prescribe medication without a doctor’s review, it’s no longer just a tool—it’s a decision-maker,” said one public health advocate.

Lawmakers in other states are also exploring similar models. Texas and Wyoming have already implemented rule waivers for AI-driven healthcare services, while Iowa and Idaho have introduced legislation to formally license AI medical programs. These bills often draw from a template developed by the Cicero Institute, a nonprofit think tank led by Joe Lonsdale, co-founder of Palantir. The institute advocates for AI integration into healthcare, but its proposals have sparked debates about accountability and oversight.

How the Program Functions

Patients using Doctronic’s system begin by confirming their identity through a secure login. The AI chatbot then asks about their current medications, health conditions, and any recent changes. By cross-referencing this information with a national pharmacy database, the system verifies the validity of prescriptions. If no issues are detected, it automatically generates a refill order. In more complex cases, the chatbot transfers the request to a Doctronic-affiliated physician for review.

During the program’s initial phase, human doctors have acted as a safeguard, ensuring accuracy before approvals. However, this role is expected to diminish as the system transitions to full automation. “We’re looking at a future where AI handles routine tasks like ordering tests and analyzing results,” Oskowitz said. “This would allow doctors to focus on more complex cases, potentially managing larger patient volumes.”

While the benefits of efficiency are clear, the program has also highlighted concerns about patient safety. Critics argue that AI lacks the nuanced judgment required for certain medical decisions. For instance, a refill might not account for a patient’s unique health profile or new symptoms that arise. “Even minor errors can have major consequences,” noted a legal expert. “Without human oversight, the risk of mistakes increases.”

Implications for the Future of Medicine

The Utah program serves as a case study for broader debates about AI in medicine. With state and federal regulations evolving, the question remains: How should AI be integrated into medical practice? Some suggest creating hybrid systems where AI assists human doctors rather than replacing them. Others call for stricter federal guidelines to standardize AI’s role in healthcare.

Supporters of AI argue that it can reduce wait times and improve access, particularly in rural areas with limited medical resources. “This system can help patients in remote regions get their medications quickly without traveling long distances,” said a public health official. However, opponents stress that the technology must be tested thoroughly before widespread adoption. “AI is a powerful tool, but it’s not a substitute for human expertise,” Bressman reiterated.

As the program moves forward, it will likely set a precedent for other states. The success of Doctronic’s model could influence the development of AI in other aspects of healthcare, from diagnostics to treatment planning. Yet, the transition from human-led care to AI-assisted care requires careful consideration of legal frameworks, ethical standards, and the potential for errors.

The debate is not just about technology—it’s about trust. Patients must believe that AI systems are reliable, and doctors need assurance that their role is not being diminished. “If AI can make decisions that affect a patient’s health, then it should be held to the same standards as a licensed professional,” Smith emphasized. For now, Utah’s initiative stands as a bold experiment, challenging the boundaries of what machines can do in the medical field.

As more states explore AI-driven solutions, the balance between innovation and accountability will be key. The program’s ability to operate within a regulatory sandbox suggests that flexibility is possible, but whether such models can be replicated nationwide depends on how well they address the concerns of medical professionals and the public. With the future of healthcare increasingly shaped by artificial intelligence, the question is no longer if AI is ready—it’s whether the medical community is prepared to embrace it.