siliconindia logo
Facebook Twitter google+ RSS Feed

New Lip-Reading AI System May Help People With Hearing Loss

Monday, 20 March 2017, 10:47 Hrs
24
cmt right
27
Comment Right
31
cmt right
9
cmt right
Printer Print Email Email


LONDON: Oxford scientists have developed a new artificial intelligence programme that can lip-read more accurately than people, an advance that will help those who suffer from hearing loss. 

The Watch, Attend and Spell (WAS) software system uses computer vision and machine learning methods to learn how to lip-read from a dataset made up of more than 5,000 hours of TV footage, gathered from six different programmes.



The videos contained more than 118,000 sentences in total, and a vocabulary of 17,500 words. 

Researchers from the Oxford University in the UK compared the ability of the machine and a human expert to work out what was being said in the silent video by focusing solely on each speaker's lip movements. 

They found that the software system was more accurate compared to the professional. 

The human lip-reader correctly read 12 pct of words, while the WAS software recognised 50 per cent of the words in the dataset, without error. 

The machine's mistakes were small, including things like missing an "s" at the end of a word, or single letter misspellings. 

The software could support a number of developments, including helping the hard of hearing to navigate the world around them. 

"Lip-reading is an impressive and challenging skill, so WAS can hopefully offer support to this task - for example, suggesting hypotheses for professional lip readers to verify using their expertise," said Joon Son Chung, a graduate student at Oxford University. 

"There are also a host of other applications, such as dictating instructions to a phone in a noisy environment, dubbing archival silent films, resolving multi-talker simultaneous speech and improving the performance of automated speech recognition in general," said Son Chung.



Read Also:
New e-Tattoos To Turn Your Skin Into Smartphone Controls
New Wi-Fi System To Provide 100 Times Faster Internet


Source: PTI
Experts on SiliconIndia
Santhosh  K
Sr. Soft. Engg.
Oracle India
Nehal Vyas
Sr. Team Lead
Cyberoam Tech.
Rani Malli
Sr. Director
Philips
Sr. Executive
ISB
Vijay Balkrishna Konduskar
Business Consultant
Imans Web Tech
Dr L P  Sharma
Technical Director
NIC
Reena Khanna
Founder
Solitaireworld
Dellas  Asse
sys-network admin
Computer Station
Sign Up for DailyDose and Read the Day's Highlights
Follow SiliconIndia :
Write your comment now
Submit Reset