Google’s AMIE Shows Expert-Level Skills in Live Video Consultations

Google Research and Google DeepMind are moving AMIE, short for Articulate Medical Intelligence Explorer, beyond text-based diagnostic conversations into live clinical video. Built on Gemini and technology associated with Project Astra, the research system uses multiple agents to combine low-latency dialogue, medical reasoning and real-time interpretation of audio and visual cues. It can also guide a patient through a virtual physical examination, a step toward AI that can operate across more of the sensory context used in telehealth.

A preprint submitted on Aug. 10, 2026 described a randomized Objective Structured Clinical Examination involving 30 primary care physicians, 15 patient actors and 100 clinical scenarios. Clinical evaluators rated AMIE’s video version as matching or outperforming physicians in history-taking, diagnosis, management, physical observation and examination. Patient actors favored AMIE’s assessment and explanations, as well as video over text for convenience and feeling understood, though physicians remained stronger in rapport and partnership. The system has not yet been validated for routine real-world care.