Smart glasses and AI help blind people walk without a dog or cane

Scientists have developed glasses that provide real-time guidance to help blind people walk without assistance dogs, canes or other people.

Researchers at Shanghai Jiao Tong University in China have mounted a small computer with AI software on Google's smart glasses prototype, which was discontinued in 2023.

AI algorithms allow the glasses to observe the environment and send signals as the user approaches an obstacle or object.

"The camera can capture the image, the information in front. This image information can then be sent to a small computer," said Leilei Gu, a researcher at Shanghai Jiao Tong University.

 “For example, an image of a chair tells me where the chair is, then I go to the chair, take a step, then actually the information changes because my position has changed,” he said, adding that it also updates new information about where the chair is, so the user can approach the target safety step by step.

The attached computer is as small as a credit card, allowing the user to walk around without the technology being too intrusive.

The researchers also developed 'synthetic skin', a material with built-in sensors that signal when objects are nearby.

When a user approaches an obstacle, a message is sent via bone conduction, a way of transmitting sound to the inner ear by sending vibrations through the bones of the skull.

Unlike air conduction, which passes air through the eardrum, this technology allows the listener to hear even if the ear canal is blocked.

The stretched synthetic skin is 0.1 to 0.2 mm thick, using a polymer called PDMS, but is not connected to the AI ​​software.

"We just need to know from the side whether there is an obstacle or not, we don't care if it is connected or not, it's just to make sure it is safe," Gu explained.

About 18 people in China participated in a study.

'Massive step forward'

In Europe, an estimated 30 million people are partially sighted or blind, according to the European Blind Union. An average of 1 in 30 Europeans experiences vision loss.

The developers say that current devices are a barrier for blind people who use them, and they wanted to create a system where the user is indistinguishable from fully sighted people.

Existing options are expensive, with the costs of training a guide dog reaching up to €60,000 according to medical device industry data.

"Many people with visual impairments want to remain as independent as possible," said Chris Lewis, an independent telecom and access analyst.

"Ultimately, the ability of a camera mounted on glasses to give you information in real time is just a massive step forward," Lewis added.

He says the array of different devices using AI means the cost is becoming less prohibitive and they are being adapted for a larger market, including people with disabilities.

The research team behind the AI ​​glasses hopes that in the future, they can develop a smaller camera that can also be placed in contact lenses./ Euronews.