Assistive Technology

Screen Shot 2017-04-15 at 21.32.56Screen Shot 2017-04-15 at 21.32.36Screen Shot 2017-04-15 at 21.32.14

 

Source: https://www.nidcd.nih.gov/health/assistive-devices-people-hearing-voice-speech-or-language-disorders#2

This research lead me to question whether the project falls under the category of assistive technology. I believe that the project is about creating a device that helps people to communicate (by allowing them to understand what other people are saying) and therefore should definitely be listed as an assistive device or a piece of assistive technology.

It was interesting to discover what systems are already available and how hearing loss seems to be the main focus. There are devices which make up part of hearing loop systems which connect with hearing aids in order to transmit sound through an electromagnetic energy, there are FM systems which use radio signals to transmit amplified sounds, infrared systems that use infrared light to transmit sound and personal amplifiers which increase sound levels and decrease background noise. Although all of these devices are useful and each have their own advantages, none of the devices are anything like the project that I am proposing. I strongly believe that there is a gap in the market for a product like this.

Alternative Idea

Following on from my second brainstorm of ideas, I have decided to create a digital media concept that will focus on the Deaf community.

The Aim

My aim is to create a mobile application that incorporates Augmented Reality in order to help deaf people understand and learn sign language as well as helping people who can hear but cannot sign understand sign language in order to have a conversation with someone who is using, what they see as their first language, BSL (British Sign Language).

Inspiration

The inspiration for my App idea came from the following video which introduces the use of AR codes to allow deaf people to access more information regarding an advertisement on a poster or safety information. The App that is used is apparently called “singly.co” but after doing some investigating into this App, it appears to be non-existent. However, the example displayed in this video is very interesting and clever, although I personally feel that this concept can be adapted and improved upon in order to gain better results.

After researching further into the App idea, I realised that there are already multiple mobile apps out there that provide similar services, such as, Mimix Sign Language Translator and ProDeaf Translator. These mobile applications consist of a woman or man clearly displaying sign language on the screen at the command of a word or phrase asked for by the user. I began to think about the concept behind it all and I asked myself how does it work? What software is used and how is it programmed? This led me to ask myself, could this idea be accomplished in a different way? Through a different form of technology? This is where the development process started to take place…

Screen Shot 2017-03-29 at 14.51.21

Sources:

https://play.google.com/store/apps/details?id=me.mimix.roid&hl=en_GB

https://play.google.com/store/apps/details?id=com.Proativa.ProDeafMovel&hl=en_GB

Development

I decided that a mobile app wasn’t the best idea, I wanted to create something different. Something that hadn’t necessarily been done before. I looked back at the brief, and as I read “digital media product” I began to think about other forms of media that could still fit this purpose. I thought about a media product such as a smart lens or a pair of glasses. These would work with the original App idea as they could use augmented reality to create a version of the woman or man signing what is being spoken in the real world, in real time.

Additionally, I thought about reversing the idea so that the product is accessible for those who cannot sign (but can hear spoken language). I thought about an additional product such as an ear piece that could work alongside the lens or glasses for people who can hear so that they can understand sign language easily and communicate with people from the Deaf community as what they are signing would be translated directly into their ear.

Initial Research on Smart Lenses and Smart Glasses

I began researching smart lenses and glasses. I found that major companies such as Google and Samsung have each created a different version of the product. One of the first things I read was that “wearing the lenses would allow users to experience ‘augmented’ reality, with computer-generated images superimposed over the real world” and I immediately thought “Great! That’s exactly what I want!” But then I realised that smart lenses hadn’t been released yet, companies are still working on them, perfecting them. And although they are a “step up from smart glasses”, I felt that they were too advanced and that it would be much more realistic if I focused on creating a pair of smart glasses as opposed to smart lenses.

http://www.independent.co.uk/life-style/gadgets-and-tech/news/samsung-smart-contact-lenses-patent-a6971766.html

https://www.sammobile.com/2016/04/05/samsung-is-working-on-smart-contact-lenses-patent-filing-reveals/

http://www.independent.co.uk/life-style/gadgets-and-tech/news/sony-launches-smart-glasses-weeks-after-google-pulls-its-own-attempt-10053586.html

After speaking with Graham in the workshop time about my proposed idea, it was brought to my attention that reversing the idea would be much more difficult, in fact, most likely impossible. But I didn’t want to give up on my initial idea as I thought it held potential. After realistically evaluating my research on smart lenses, I decided that they would much too difficult to create as the product hasn’t effectively been created itself yet. So I began to think about the concept of a pair of smart glasses which incorporate augmented reality.

Proposal

What is the intended idea / concept behind the proposed project?

A pair of smart glasses that are designed for those with hearing impairments. The glasses will include a microphone which will allow spoken conversation to be interpreted through a Augmented Reality screen which will consist of a woman displaying real-time sign language.

Justify the idea / concept in terms of the needs for its existence (if purely for entertainment, state this and how the output will be innovative/original and creative):

I’ve chosen to create a pair of smart glasses instead of smart lenses because I feel that this product is more manageable. Not only that, in terms of considering the user, it is much easier to maintain a pair of glasses than it is a pair of contact lenses. Lenses can be difficult to adjust to and not everybody can get along with them. Glasses are much easier to “cope” with. Although, they are largely visible on the face, they can be stylised to suit an individual person.

The smart glasses that I am proposing are essential in order for people of the Deaf community who cannot lip read to engage with and understand what is being said through spoken language. For the time being, the language that the product will incorporate will be spoken English and British Sign Language. However, if the product is successful there could be room for the product to potentially display any type of sign language and therefore any spoken language that will accompany it.

After watching some YouTube videos about what it is like for someone with hearing impairments on a day to day basis, the issue of talking within a group came up. It can often be troublesome for people with hearing impairments to understand what other people are saying when having a conversation within a group, especially if people within the group are not directly talking to them. It is difficult because they may not be able to see their lips to lip read or they may not be able to lip read very well. Also, if someone is trying to talk to a Deaf person from behind, it may be difficult for that person to understand/respond as they may not have been able to acknowledge them.

In terms of design, the glasses will be designed so that they do not look any different to a pair or ordinary glasses. The reason for this is so that the people wearing these smart glasses will not feel isolated in any way from “hearing” people. The glasses will also be stylish and comfortable for the user to wear.

Describe the intended audience:

  • People with hearing impairments
  • More likely to be teenagers or adults who will use the product as children may not yet understand sign language. Also, the product will be costly and is not a toy.

How will this project extend your creative and technical skills?

As part of my realisation of concept I will be creating a motion graphic video that describes and promotes the product. I have only ever created one motion graphic before so this will test my skills in that are. Also, the video will consist of a realistic 3D model of the glasses which I will design myself.

Outline how the practical work will be carried out by you and the time-scales involved for each task:

Initial Idea

Research

Planning

Audience

Development of Product

Branding – Logo Design

See schedule on blog for specific and accurate dates.

What other work (by animators, designers, film-makers, writers, digital media producers, etc.) is relevant to your project? (This work may either be relevant for its conceptual or technical similarity): 

  • Google’s smart contact lenses
  • Google’s and Sony’s smart glasses
  • The ear piece that translates a spoken language directly into the receiver’s ear
  • The Babel Fish
  • Ai-Live Computer System (Access Innovation)

The Babel Fish – 

The Babel Fish is a fictitious alien fish that is inserted into the ear and allows humans to understand anything that is said to them in any language.

I found this concept interesting because during my research process I came across an article that introduced a new earpiece that translates different spoken languages directly into your ear. The Babel Fish is a mythical version of this concept whereas The Pilot is a real life piece of technology that enables this process to actually take place.

The Pilot – 

The Pilot is a small piece of technology that fits into the ear. It connects with an App on a mobile phone which stores all the different languages. The App can work alone but it is advised that it is used alongside the earpiece. This piece of technology is fantastic as it breaks down the communication barriers allowing anyone of any language to understand each other and communicate together.

https://www.indiegogo.com/projects/meet-the-pilot-smart-earpiece-language-translator-headphones-travel#/

Ai-Live –

Screen Shot 2017-04-16 at 15.11.38

Screen Shot 2017-04-16 at 15.12.34

 

Although this product is very similar to the one I am proposing, it differs slightly. The project that I am proposing incorporates new and up to date technology such as Augmented Reality. The product that I am proposing has one main advantage over this product which is the fact that it is a pair of smart-glasses, these glasses will be comfortably wearable and lightweight and could even serve the purpose that ordinary glasses do; they could have prescription lenses fitted.

http://www.ai-media.tv/ai-live-captioning/

http://www.smh.com.au/technology/technology-news/computer-system-gives-ears-to-those-who-cannot-hear-20100718-10g3p.html