adapted by Phoenix Fry from an article by Sarah Cox
An MA/MFA in computational arts graduate's ‘sign language glove’ has taken first prize in an exclusive South Korean hackathon attended by hand-picked students from some of the world’s best universities.
Hadeel Ayoub, third-year BSc Creative Computing student Leon Fedden, and 2016 MSci Creative Computing graduate Jakub Fiala took part in the IBM Watson A.I. Hackathon in Seoul earlier this month. Organised by the Art Centre Nabi, the hackathon focused on pioneering technology for use in social care.
Hadeel, an MA Computational Arts graduate who is now studying for her PhD, has spent the past year working on the second version of her BrightSign glove, which turns hand motions into text and speech. In addition to the new developments in the glove’s technology, she has also consulted with Rose Sinclair from Goldsmiths’ Department of Design on the best textiles to use for the product.
During the three day hackathon, the Goldsmiths team built, programmed and trained the BrightSign glove on site. On the final day they presented the project at a public event with a judging panel including the director of IBM Watson.
The BrightSign glove contains an on-board, battery-powered single board computer, flex sensors and an accelerometer. Used in combination with a range of gestural and semantic analysis tools, users can generate and control reliable speech through a dictionary of hand gestures.
The first version of the design made international headlines in 2015, with Hadeel explaining the glove’s potential to improve communication between people with different disabilities.
The Goldsmiths team, supervised by the Department of Computing’s Dr Rebecca Fiebrink and Dr Mick Grierson, were up against stiff competition from Seoul National University, the Georgia Institute of Technology and New York University, among others.