Google Reports Its Medical AI Matched Doctors in Simulated Video Consultations

Google Research published results for a video-capable version of AMIE (Articulate Medical Intelligence Explorer), its experimental diagnostic system, in what it describes as the first demonstration of a real-time clinical video consultation conducted by an artificial intelligence (AI) system.

The study used a randomized Objective Structured Clinical Examination, the standard format for assessing clinical skill. Thirty primary care physicians, fifteen professional patient actors and one hundred scenarios were used to compare AMIE over video, AMIE over text, and physicians over video. Independent clinical evaluators rated the video system on par with or better than the physicians on history-taking, diagnosis, management and physical observation. Patient actors preferred the system's explanations but preferred physicians for rapport.

Architecturally, the paper describes a Gemini-based asynchronous multi-agent system with separate Talker, Planner and Perception components, built on the low-latency stack from Project Astra, so that visual and auditory input is processed while dialogue continues.

The authors state the limits themselves. Every encounter involved actors performing scripted conditions, not patients with real illness, and the system remains weak on fine anatomical precision and rapid movement. Actor-based examinations reward structured questioning, which is exactly what a language model does well.