King's researchers receive coveted Future Leaders Fellowship

Dr Timothy Neate, Senior Lecturer in Computer Science in the Department of Informatics

One in five people in the UK will experience communication disabilities at one point in their lives, whether that be difficulty speaking after a stroke, having trouble communicating after a dementia diagnosis, dyslexia in the classroom, or any number of conditions.

While those with complex communication needs stemming from these disabilities are more likely to have an increased risk of depression, psychological stress and poor quality of life, over 60% of current assistive technology is thrown away in a year. These voice-based systems, like Stephen Hawking's voice communication apparatus, are discarded because of the stigma associated with them and their inability to express non-verbal forms of communication, such as tone of voice, gestures and body language.

By utilising AI models that that can help identify and react to the context of conversations between individuals, both online and in-person, Dr Neate aims to create a range of wearable technologies to help aid those with communication difficulties communicate functionally and with confidence.

Deploying devices like smartphones, smartwatches and augmented reality headsets, Dr Neate's software will identify context, such as if the other person in the conversation is a close friend or in a work context, and generate useful phrases that can serve as conversation aids in those specific scenarios.

Dr Neate said: "You would be surprised how well someone who might speak three or four words can communicate. Through gestures, body language and tone of voice people can get their message across effectively. By creating technology that embraces total communication instead of just the verbal communication of traditional devices, we can empower people to communicate confidently and functionally every day, improving their quality of life."

To complete his work, Dr Neate will be working with key partners across the charity, technology and academic sectors, including Microsoft Research, Aphasia Re-Connect, Hidden Disabilities, Tobii Dynavox, TfL and City St George's University of London. He will also be taking an active policy role in the field of assistive technology.