MYWAY —
SMART ROUTE ASSISTANT for VISUALLY IMPAIRED PEOPLE
for Bartiméus in 2020
Advanced Concept Design Course - 20 weeks
Design Coach: Wim Schermer
Client & Design Assignment
—
The project was in collaboration with the Bartiméus, an organization that specializes in providing support, tools, and training for visually impaired people (VIP) within the Netherlands. The task was to design a smart object that will help improve the mobility of visually impaired people.
Initial Interviews
—
The goal of the initial interviews that were conducted together with other design students who were working on projects related to VIP was to gain understanding about the lives of visually impaired people (VIP) and about how their visual impairment has an impact on the different aspects of their lives. Another goal was to determine which visual impairment to focus on. It was decided to work on the experiences of 5 VIP that were blind from the birth for the upcoming research activities.
Interviews & Observations
—
The aim of this study was to get a better understanding of the skills, behaviors, and emotions of VIP regarding outdoor mobility. The research was conducted as a team of 6 design students with 5 VIP and consisted of an interview, an observation, and a post-observation interview. Before the actual interview, the participants were sensitized by giving them a remote ‘homework assignment’ about their mobility. According to the findings, three main themes were defined to focus on.
Building Design Vision - Insight Cluster
—
After gathering insights on different expertise areas (culture, ergonomics & technology), the clusters were formed to see patterns for possible concept directions. Besides, the results from the primary and secondary research helped define the initial scope of the project.
Key Quote
—
One of the participants expressed his feelings about being new in an area that he needs to get familiar with. The participant was contacted to get a deeper understanding of certain challenges that he faced. This inquiry resulted in a concept direction to explore the difficulties of being familiar with orientation points (landmarks) in new routes.
Leaning new routes & challenges
—
To obtain more insights about route learning and the challenges that come with it, further interviews were conducted with a visually impaired person (who is blind from birth) and an O&M (Orientation and Mobility) instructor. The results revealed a dependency on other people when it comes to learning a new route. O&M training can be complicated and consists of different and repetitive stages to make VIP learn new routes. Routes are divided into several segments, and according to the trainer, for learning each segment, days or even weeks can be needed. It is important to note that the skills and experiences of VIP have a significant impact on the learning process. Even though the route is learned, VIP need to remember landmarks to get oriented on a route. Therefore, the more routes they want to learn, the more cognitive load they experience. Friends and family members do often help visually impaired people to get familiar with new routes but they do not have the expertise on route learning.
Design Vision
—
After defining the problems in the route learning process, a design vision was formulated as the basis of the product development process. It’s important to help VIP to develop self-reliance for their mobility. The design intervention should have the characteristics of an encouraging and caring partner. Therefore, creating meaningful collaboration between the product and VIP is essential.
Concept Criteria
—
The list of criteria was identified based on the design research done throughout the process. This list was meant to help develop a promising and desirable solution that can achieve the design vision.
Ultra Rapid Prototype
—
An Ultra Rapid Prototyping (URP) workshop was organised with other design students to test and develop the initial ideas and come up with new ones. The URP uses role-play to investigate current as well as new and desired interactions. It helps to approach a design topic from different perspectives to create insights about the user’s motivation and needs. It is an explorative approach of possible interactions and design concepts through quick alternating steps of ideation and reflection. There was a variety of props used during the workshop to come up with new interaction ideas. For each scenario, a new set-up was created and each student performed a director, a product, and a user to gather insights rapidly.
Concept Principle
—
After investigating different directions and discussions with the design coach, a concept that realises the design vision was selected. The selected concept offers a practical approach for VIP to learn and familiarise themselves with new routes by using object recognition technology. To do that Bartiméus (the client) needs to create a landmark database by collecting images from real life. They have the expertise to know what object or surface can be an orientation point (being permanent in a location, easy to reach and recognise, etc.).
Product's Intention
—
The ai-supported product recognises tactile and structural landmarks and directs the user to reach these orientation points. As soon as the user reaches a landmark, they get directional feedback. The product’s intention is to help the user create a mental map of the environment while defining landmarks on routes. After going the same way several times, the user will be able to navigate without the help of the product. When it is needed, the product can help anytime.
Ideation
—
To realise the product’s intention, different feedback modalities and their positioning on the body were considered. These options involved the integration of the technology into everyday life objects as well as the white cane. It was important not to make the product stand out to prevent further stigmatization.
Technology Analysis and Testing
—
Since the concept is dependent on computer vision through cameras to detect landmarks, it was important to investigate the camera positioning on the body. Apart from that, the feedback mechanism was examined to find adequate body parts to place the vibration motors. Lastly, the effectiveness of the vibrotactile feedback in giving directions was tested.
Neck Module Development
—
Three people with different neck base circumference sizes were asked to wear the 3d printed neck module-1 to examine how comfortable the product was while wearing it. The test revealed that the fixed size and shape of the prototype did not allow all subjects a comfortable use. When the neck module-1 was large for a neck, it didn’t provide sufficient touchpoints around the neck to deliver the vibrotactile feedback properly.
To solve these issues the neck module-2 was developed. In this option, the vibration modules are not parts of a single structure but are aligned on a cord. In this way, there is no tightness or looseness of the module around the neck. Furthermore, the modules on the left and the right can be moved on the cord to be adjusted correctly. Thus, a constant touch on the side of the neck is possible. In contrast to modules on the sides, the back module is fixed in its position.
To solve these issues the neck module-2 was developed. In this option, the vibration modules are not parts of a single structure but are aligned on a cord. In this way, there is no tightness or looseness of the module around the neck. Furthermore, the modules on the left and the right can be moved on the cord to be adjusted correctly. Thus, a constant touch on the side of the neck is possible. In contrast to modules on the sides, the back module is fixed in its position.
Vibration Feedback Pre-Experiment Test
—
Before experimenting in a realistic environment, it was necessary to eliminate the variety of feedback patterns developed for each directional feedback for the two alternatives earlier: mono and pair positioning. As part of this study, two blindfolded participants were asked to test each pattern and give feedback on how they felt during the application and what each pattern may indicate. It was important not to reveal the intended function of each pattern. After receiving the participants’ feedback, each pattern was improved and made ready for experiment-1. Nine different patterns were defined for mono positioning, and five for pair positioning. Both participants experienced difficulties discriminating the vibration feedback coming from the two motors placed on the same module. To make the discrimination possible, the distance between the vibration motors needed to be enlarged. That resulted in unclear and misleading stimulation. Therefore, it was decided to continue only with the mono positioning option.
Vibration Pattern Selection
—
This study was conducted indoors with two sighted blindfolded participants. I tested twelve patterns to make a selection for five defined functions (Forward, Left&Right, Landmark_Left&Right, Landmark Forward, Arrival)
Task Scenarios
—
The tests were carried out with three blindfolded adults of different ages, sex, and physical condition. The participants were equipped with the mono positioning neck module applying the selected vibration patterns and a stick to represent the white cane. The first two tests took place in an isolated environment, whereas the last one was conducted in a real use context. All participants were disoriented before performing the tasks. The concept and the main cane use strategies were briefly introduced to the participants. They were encouraged to think aloud during the test.
Camare Module Development
—
The main challenge of the camera module appeared to be the angle problem. When the product is placed on the upper chest, the stable camera unit faces up instead of having a proper view of the ground and surroundings. To prevent that, rotational camera options were considered and the geometries were developed accordingly.
Claps Module
—
Magnetic clasps were considered to make the product easy to put on. Due to the product’s placement around the neck (resembling a necklace), it was found more intuitive to position the clasp on the back module than on the camera module. The neck module’s shape was determined by the neck base circumference measurement (P50, 467mm) obtained from DINED anthropometric database for Dutch adults (2004) from 20-60 years, mixed. The size of the camera module was increased due to the battery size.
Cultural Meaning & Reflection
—
The product declares that VIPs can manage to learn new routes without in person guidance of professional instructors or friends, family members and volunteers. Therefore, their spontaneity is encouraged and their dependency on others is decreased. The product gives the users the self-reliance to achieve tasks on their own.
The product should increase the competence of the user in navigation tasks. By doing this, the product may limit the social contact with others by enabling the user to navigate on her/his own. Furthermore, the product encourages the user to go out, to discover new places and possibly meet new people there. In this way the product will support social engagement. Their involvement in the society will be encouraged by the product and they will be more visible in daily life. The relationship between the user and the product should reflect a type of collaboration that the user’s capabilities in navigation works together with the intelligence of the product. Since the product manifests the user’s competence in navigation, it should not attract attention by being noticeably visible. The technology should be hidden to prevent further stigmatizing.
Final Product -MYWAY
—
Myway is a wearable smart route assistant with the intention to make visually impaired people learn new routes on their own. The product encourages visually impaired people’s spontaneity and decreases their dependency on others. It promotes self-confidence and initiates a sense of accomplishment. By that, Myway improves the emotional well-being of VIP.
Product Vision - Stereo Camera
—
Myway recognises orientation points (landmarks) that are essential for route learning. The product makes use of a deep learning algorithm that is trained to distinguish landmarks during navigation. The pivotable stereo camera is used to scan the environment and it calculates the distance between the user and the landmark to notify the user on time about landmarks’ presence.
Product Guidance
—
Myway takes the user to identified orientation points with vibrotactile feedback through the three modules that are placed around the neck. Four different vibration patterns are communicating the following: turning left & right, walking forward, an indication of landmarks, and arrival. In addition to the vibration feedback mechanism and the object recognition algorithm, a highly accurate global satellite navigation system (Galileo) helps the product to guide the user accurately from landmark to landmark. Myway works together with smartphones and utilise their processors.
Bio Sensor & Route Adjustment
—
The biosensor placed on the back module tracks the user’s emotional state during the navigation. Therefore, the product can make adjustments to the route that the route planning algorithm determines. By revising parts of a route, Myway ensures comfortable route learning.
Adjustable & Secure
—
The lateral position of the modules can be easily adjusted by sliding them back and forth to ensure proper skin contact for vibratory feedback. The magnetic clasp not only makes the product easy to put on but also keeps it securely in place.
Product Modes
—
Myway has two modes: learning and practicing. The Learning mode is the default setting, in which the product tends to make the user learn the route by guiding them from landmark to landmark. By keeping track of the stress level and the travel time, the product knows how comfortable the user is on the route. After practicing a particular new route several times, the product can offer to change the mode to try navigating without direct help from the product. The mode change can be made through the app or by pressing the buttons on the camera module.
Charging Plate
—
The charging plate that utilizes radio frequency (RF) wireless charging supports the convenient user experience.
Maturity Matrix
—
In this matrix, the technological building blocks of the product are listed and elaborated for further
development of the concept.
development of the concept.
Technology Road Map
—
To speed up the reliable data collection process, initial prototypes or products can contribute. First, VIP can be asked to use the initial product during their daily navigation tasks so that the product starts learning from the real context. Secondly, the product can be a part of training sessions and gather data. By tracking the state of VIP during these training, the product can help to improve training strategies and even be marketable for this purpose (for details see the technology road map). In parallel, the datasets can be improved with the help of orientation and mobility (O&M) instructors’ expertise.
