Introduction
myCommunicator is a daily communication tool for the hearing impaired, designed to enhance 2-way communication between them and a hearing/hearing-impaired person, and to reduce hassle and increase ease of communication anywhere. It looks into two contexts: a conversation with a hearing person and a video call session with another hearing impaired person.
The statement "the need to move information to enhance communication for the hearing impaired" was used as the basis for this design project.
myCommunicator is a daily communication tool for the hearing impaired, designed to enhance 2-way communication between them and a hearing/hearing-impaired person, and to reduce hassle and increase ease of communication anywhere. It looks into two contexts: a conversation with a hearing person and a video call session with another hearing impaired person.
The statement "the need to move information to enhance communication for the hearing impaired" was used as the basis for this design project.
^ View of myCommunicator when it is closed
^ View of myCommunicator when it is opened
^ Back view of myCommunicator when it is partially opened.
User group
In this project, we defined our target user group as the hearing impaired who do not rely heavily on sound in communication. This is important to define this as there are different levels of deafness. The lifestyle of one who is partially deaf is different from one who is profoundly deaf, hence these distinct differences change the way they communicate with others.
As our project is about communication, our user group therefore also extends to the people the hearing impaired communicate with, which could be hearing or otherwise.
In this project, we defined our target user group as the hearing impaired who do not rely heavily on sound in communication. This is important to define this as there are different levels of deafness. The lifestyle of one who is partially deaf is different from one who is profoundly deaf, hence these distinct differences change the way they communicate with others.
As our project is about communication, our user group therefore also extends to the people the hearing impaired communicate with, which could be hearing or otherwise.
Research Findings
We conducted interviews with both hearing and hearing impaired persons, and had first-hand experience with trying to communicate with the hearing impaired. An online survey was used to understand more about communication for this specific target group. We also referred to online material such as articles, videos and the facebook page for the deaf community in Singapore.
We conducted interviews with both hearing and hearing impaired persons, and had first-hand experience with trying to communicate with the hearing impaired. An online survey was used to understand more about communication for this specific target group. We also referred to online material such as articles, videos and the facebook page for the deaf community in Singapore.
We deduced the following insights from our research:
1. Sign language as a first language
Many use sign language to learn other languages such as English. Sign language, being more visual, relates better to the hearing impaired who rely greatly on their sight, and helps them pick up a language better. In the deaf community, sign language is the preferred method of communication, hence the video call function in smartphones have greatly benefited them in this.
2. Writing and typing as a common communication method
During a conversation with someone who does not know sign language, the hearing impaired may lip read or look at gestures and expressions. However, for more specific content, writing or typing becomes a better medium for communication, especially so in places where smartphones become more common. Some find it a hassle, others find it convenient, but nonetheless, it is a common method for communication between the hearing and the hearing impaired.
1. Sign language as a first language
Many use sign language to learn other languages such as English. Sign language, being more visual, relates better to the hearing impaired who rely greatly on their sight, and helps them pick up a language better. In the deaf community, sign language is the preferred method of communication, hence the video call function in smartphones have greatly benefited them in this.
2. Writing and typing as a common communication method
During a conversation with someone who does not know sign language, the hearing impaired may lip read or look at gestures and expressions. However, for more specific content, writing or typing becomes a better medium for communication, especially so in places where smartphones become more common. Some find it a hassle, others find it convenient, but nonetheless, it is a common method for communication between the hearing and the hearing impaired.
^ Written conversation between us and one of our hearing impaired interviewees
3. Hearing people are more intimidated by communicating to the hearing impaired than vice versa.
Generally, hearing people have a high reliance on speech on a day-to-day basis, hence they find it difficult to adapt when communicating to the hearing impaired. This causes them to be intimidated when they want to communicate a message or hold a conversation with the hearing impaired.
4. Activeness in conversations depend more on personality than on disability.
It is a myth that hearing impaired persons are introverts and do not have the capability to actively participate in a conversation. Their disability does not define their personality, contrary of the stereotypical idea that many have of the hearing impaired. Aside from difficulties in understanding what is spoken, level of participation in conversations depends more on their personality.
5. Limited technological help in Singapore
In the United States of America, there are several services and smartphone applications that help the hearing impaired in communication, be it over the phone or for conversations. However, such services and technological help are not available in Singapore, or are not affordable.
Generally, hearing people have a high reliance on speech on a day-to-day basis, hence they find it difficult to adapt when communicating to the hearing impaired. This causes them to be intimidated when they want to communicate a message or hold a conversation with the hearing impaired.
4. Activeness in conversations depend more on personality than on disability.
It is a myth that hearing impaired persons are introverts and do not have the capability to actively participate in a conversation. Their disability does not define their personality, contrary of the stereotypical idea that many have of the hearing impaired. Aside from difficulties in understanding what is spoken, level of participation in conversations depends more on their personality.
5. Limited technological help in Singapore
In the United States of America, there are several services and smartphone applications that help the hearing impaired in communication, be it over the phone or for conversations. However, such services and technological help are not available in Singapore, or are not affordable.
Project Aims
1. 2-way communication between the hearing-impaired person and another person
2. Reduce hassle and increasing ease in communication anywhere
1. 2-way communication between the hearing-impaired person and another person
2. Reduce hassle and increasing ease in communication anywhere
Context: Conversation with a hearing person
2Communicate, an application that works with myCommunicator and makes use of the device's smaller screen, uses speech-to-text and text-to-speech technology to act as a medium between the hearing and hearing impaired. The main user, the hearing impaired person, will be viewing the device from the main screen, while the person he/she is communicating with will be viewing the device from its secondary screen.
The following pictures explain how the 2Communicate interface works. The main screen is displayed on the left, and how the secondary screen corresponds at the same time is shown on the right.
2Communicate, an application that works with myCommunicator and makes use of the device's smaller screen, uses speech-to-text and text-to-speech technology to act as a medium between the hearing and hearing impaired. The main user, the hearing impaired person, will be viewing the device from the main screen, while the person he/she is communicating with will be viewing the device from its secondary screen.
The following pictures explain how the 2Communicate interface works. The main screen is displayed on the left, and how the secondary screen corresponds at the same time is shown on the right.
^ Upon entering the application (icon as shown at the lower right corner of the image), the user selects 'Start Conversation' to activate the device's voice detection system.
^ The device indicates when it is ready to receive voice signals. The top bar of the screen will also indicate when the microphone and speaker are switched on and are working. At this stage, the hearing impaired user can choose to initiate the conversation by selecting the keyboard button.
^ When a voice is detected, it will be indicated on the screen.
^ What the hearing impaired user says is shown not only on the main screen, but also on the secondary screen to provide visual feedback for the hearing user.
^ The hearing impaired user types his reply, and when he selects speak, the device shows it on the screen and 'speaks' it through the speaker.
^ When the hearing user speaks a long sentence, the device detects and processes the sentence in parts so as to reduce the waiting time for the voice signal to be processed into text and to allow the conversation to flow more naturally.
^ The screen scrolls to show the latest in the conversation as it progresses and the page gets longer.
^ The microphone and speakers are placed at the hinge area, facing the hearing person who will be reading from the secondary screen.
^ Side view of myCommunicator when placed on a surface. The chamfered ends of the device help it stand up to a slight tilt so that it is easier to read when sitting at a table. The two screens can be maintained at this angle or adjusted accordingly while being held in the user's hand during a face-to-face conversation.
Context: Conversation with a hearing person
myCommunicator is distinctive with its secondary screen. With this additional fixture, it can support a variety of positions to allow the device to be propped up during video calls. This is useful as sign language often involves two hands, and having to hold up a smartphone for video calls with one hand while signing with the other becomes a hassle for the hearing impaired user.
myCommunicator is distinctive with its secondary screen. With this additional fixture, it can support a variety of positions to allow the device to be propped up during video calls. This is useful as sign language often involves two hands, and having to hold up a smartphone for video calls with one hand while signing with the other becomes a hassle for the hearing impaired user.
^ Front view of device during video call, with main screen propped up.
^ Main screen propped up by secondary screen
^ Secondary screen recessed to prevent it from directly touching surface when used as a platform to prop up main screen.
^ Alternative ways to prop screen up.
^ Dimensions and details of myCommunicator
