Google Translate DOES work for doctors whose patients don’t speak English: AI can put simple instructions into Spanish and Chinese – but its mistakes could be deadly, study finds
- About half of American doctors speak language other than English
- We lag behind Europe where half of physicians speak at least two
- University of California, San Francisco researchers examined the translations to Chinese and Spanish of 100 ER discharge papers that used the AI
- English to Spanish translations were over 90 percent accurate
- Translations to Chinese were just above 80 percent accurate
- Colloquial or jargon-y speech threw off the AI, and could even be life treatening
Less than half of American doctors speak another language in addition to English and many of them turn to Google Translate to instruct patients who have a different first language.
Communicating instructions like when and how to take medications is essential to patients’ recovery but – especially in emergency departments – there may not always be a physician available and equipped to do so.
A new study from the University of California San Francisco (UCSF) found that about 60 percent of discharge instructions made by Google translate were accurate, an encouraging stat for tech-reliant doctors.
But four percent were way off – and their inaccuracies could prove dangerous, if not fatal, to patients.
Doctors in the US periodically use Google Translate to supplement their lackluster skills in languages than English. A new University of California study suggests it works fairly well, but reveals that sometimes the mistakes are downright dangerous
Over 20 percent of Americans do not speak English as their first language, and about half of those primarily speak Spanish at home.
And Latino men and women in the US are twice as likely as the general American population to go to an emergency room for non-emergencies.
Nearly 40 percent of Latinos said they ‘rely’ on the ER, according to consumer healthcare nonprofit FAIRHealth.
So the population that looks to the ER for the largest proprotion of their medical needs is also the one that physicians there are less likely to be able to clearly and effectively serve.
Americans on the whole and doctors in particular are becoming more multilingual, with 42 percent of doctors in California now reporting that they are fluent in at least one language besides English.
Researchers demand 400 scientific papers on transplantation…
Mother who got breast implants to fix her ‘mom bod’ suffered…
Share this article
But, internationally, 56 percent of medical graduates report speaking other languages, compared to just 37 percent here.
Translation AIs, like Google Translate, offer tools to bridge that gap, and while they might be better than nothing, they may also lull doctors and patients into a false sense of security that everyone is on the same page.
‘Google Translate is more accurate than a lot of clinicians believe, and I think it’s definitely more useful than not providing anything at all,’ said first study author Dr Elaine Khoong, a primary care researcher at UCSF.
The new UCSF research, published in JAMA Internal Medicine today, revealed just how useful Google’s translation tool is, as well as how dangerous it may be when the AI misses the mark.
Dr Khoong and her team analyzed how Google Translate converted instructions from 100 ER discharge papers into either Spanish or Chinese.
The app is a bit more adept at Spanish, and was about 92 percent accurate in interpreting English instructions for Spanish speakers.
In Chinese, the translations were only about 81 percent accurate.
Some of the results the AI spit out were comical, while others were downright scary.
Translated to Chinese, the simple instruction to ‘skip a meal’ became ‘jump over a meal.’
It’s something we’d never say in seriousness in our own language, but one might logically work it out – or otherwise start jumping the dining table at home, with the excuse, ‘doctor’s orders.’
Less humorous was the result of ‘hold the kidney medication,’ as in, ‘stop taking it for now.’
When Google attempted to translate the phrase to Chinese, it came out ‘keep taking the medication.’ In Spanish, it became ‘keep the medication.’
Either way, the UCSF team decided these were ‘life threatening’ instructions.
The more casually, complexly or jargon-heavily doctors spoke or wrote in English, the more perplexed Google got.
One ER discharge paper said, in English: ‘Please return to the emergency department for worsening abdominal pain, inability to eat or drink due to vomiting, bloody diarrhea, if you pass out or any other concerning symptom.’
A barely intelligible Chinese version read: ‘If you pass, vomiting, bloody diarrhea, unable to eat or drink or any other symptoms; come back to the emergency department for treatment.’
‘It confused the machine because the sentence structure was so complicated,’ Dr Khoong said.
‘It’s certainly an argument for doctors to check themselves when they are writing instructions. We get used to communicating in these very complicated sentences.’
The researchers saw that as far from ideal, but not a fatal error.
In a perfect world, a tool like Google’s should be used in conjunction with a translator or at least a friend or family member with some second language skills.
The researchers suggested instead that maybe doctors should give patients for whom English is a second language an English copy of the discharge order as well as the Google Translated one, so the could ask English speaking friends of family to clarify anything that seemed strange.
Still, they gave Google Translate a tepid endorsement: ‘We cautiously support its use,’ the authors wrote.
Source: Read Full Article