New VizWiz database aims to teach computers to give blind people the information they need
Computers find it hard to answer questions about an image. This is an important skill as it could help blind people with daily life.
There are apps that blind people can use to take a photo, record a question like -'What is the color of this shirt?' or 'When does this packet of milk expire?’ They can then ask volunteers for the answers. However, the images are often not well framed, or poorly focused, or lack the information needed to answer the question. This is because the photographers are not able to see.
Computer vision systems could help out by removing images that are not suitable. They can ask the photographer to take the image again. However, this is something that machines cannot do right now. This is due to the lack of a significant data set of real-world images that can be used to train them.
A team of researchers in Texas in the United States is working to change this. They have published a database of 31,000 images. The images come with questions and answers about them. The data set comes from an existing app called VizWiz. This has been developed to help blind people.
How VizWiz app works
With the app, a blind person can take a picture, record a question verbally, and send them both to a team of volunteers who answer as best as they can. The app VizWiz has many shortcomings. Volunteers are not always available. Also, the images do not always make an answer possible.
The researchers in Texas have tried to find a solution to these problems. They analyzed the photos gathered by VizWiz from users. The team removed photos that had personal details such as credit card information, addresses, or nudity.
They presented the images and questions to workers and asked them to give an answer made up of a short sentence. The team gathered 10 answers for each image to check for consistency.
These 31,000 images, questions, and answers make up the new VizWiz database, which has been made available to the public.
The team hopes to encourage others to develop more generalized solutions to help blind people. The aim is to offer an opportunity to develop assistive technologies that break down accessibility barriers for blind people.
Read more on Newz Hook
- Technology October 23, 2018 What visually impaired people should look for while buying a phone
- Headlines October 18, 2018 Priyanka Chopra to marry later this year, most likely in Rajasthan
- Headlines October 20, 2018 59 people dead as train runs them over in Amritsar
- Accessibility October 22, 2018 Making gardening fun for wheelchair users
- Headlines October 22, 2018 Amritsar train tragedy - Organisers go missing, police yet to identify accused
- Get-hooked October 23, 2018 Hum-Drum, a participatory musical program for children with disabilities - My Take by Rzhude David
- Parasports October 23, 2018 Mumbai to host first national throwball & swimming camp this week
Ask your question about any issue related to disability, this is your space to find the answer.
Want to feature your inspiring story or share an event with the disabled community? Write to:
Newz Hook - Accessible News