Microsoft’s OpenAI-based app instantly transcribes patient notes during doctor visits

Microsoft Speech recognition subsidiary Nuance Communications announced Monday Dragon Ambient eXperience (DAX) Express, an artificial intelligence-powered clinical note-taking application for medical professionals. DAX Express aims to reduce the administrative burden on physicians by automatically drafting clinical notes within seconds of a patient’s visit. The technology is based on a combination of environmental AI, which derives insights from unstructured data such as conversations, and OpenAI’s latest model, GPT-4. Diana Knoll, executive vice president of healthcare at Nuance, said the company wants to “get back to the joy of medicine” so doctors can treat more patients, she told CNBC. . “Our ultimate goal is to reduce cognitive load so that less time is actually spent on administrative tasks,” she said. Microsoft will acquire Nuance for around $16 billion in 2021. The company makes money by selling speech recognition and transcription tools used in doctor visits, customer service calls, and voicemail. DAX Express complements other existing services Nuance already offers in the market. Nole said the technology is powered by his Dragon Medical One voice recognition application on his Nuance, which is used by more than 550,000 doctors. Dragon Medical One is a voice-enabled, cloud-based workflow his assistant that enables physicians to navigate clinical systems and quickly access patient information. Clinical notes generated by DAX Express are displayed on the Dragon Medical One desktop. DAX Express is also based on the original DAX application launched by Nuance in 2020. DAX converts patient oral consultations into clinical records and goes through a human review process to ensure they are accurate and of high quality. The note will appear on your chart within 4 hours of your appointment. In contrast, DAX Express creates clinical notes in seconds, allowing physicians to instantly view an automated summary of patient visits. “I think doctors and clinicians want a combination of all of these because every specialty is different and every patient encounter is different. And we need efficient tools for all these different types of visits,” says Nole.