Obstacle Avoidance
Use cases
When a user is approaching an obstacle that:
1) Is not detectable by white cane, (i.e. tree branch)
2) They would like advanced notice, even if it can be detected, (i.e. construction, trash can)
System feedback
As the user approaches an obstacle, a sound icon representing the object plays in stereo to indicate the location of that object. After 1 second, vibrations on the appropriately sided wristband accompany the sound to indicate which direction users should go to avoid the obstacle.
If users get closer to the obstacle, the sound icon repeats more frequently, and the volume slightly increases. The vibration intensity and frequency will also increase to indicate that a higher amount of direction correction is required.
Once, the user moves far enough away to avoid the obstacle, they hear the good chime indicating that they’re on a path which would avoid the obstacle.
Sound files
Tree Branch
Construction
Trash Can
Woman is walking towards a sign blocking her path. She is receiving audio and vibration feedback to help her avoid it.
Obstacle avoidance in action
Imagine you are walking near some local shops, one of which has a small sign out front for the special of the day. As you’re walking you hear a sound referencing a sign at your feet to your left, and you feel vibrations on your right wrist.
As you get closer to the sign, the sound repeats and gets a little louder. The vibration also increases. You steer to the right to avoid the obstacle, and hear a chime leaving you confident that you’ve avoided the object and can continue back to your path.
User requirements
We learned from our users that in scenarios described above, they’d like to know:
Obstacle type
Users would like to have the type of obstacle identified in some way.
For common objects such as tree branches, a specific sound representing that object will be used. There will also be generic sounds when the object type is unknown.
Relative location
Users would like to know the relative direction of the obstacle.
The obstacle sound plays in the ear that correlates to the location of the obstacle. Intensity and volume of the sound will increase based on proximity.
Direction correction
Users would like to know how to safely avoid the obstacle.
To help guide the user safely away from the obstacle, vibration plays through the users wristbands to indicate the direction they should be moving towards.
Avoidance confirmation
Users would like to know when they are on a path that would avoid the obstacle.
A short happy chime plays in both ears after avoiding an obstacle.
Input system requirements
Identify objects
Various sensors are used to detect objects. The system uses a combination of computer vision, virtual tags, LiDARr, and crowd-sourced data to identify objects that may include obstacles, points of interest or on-demand info.
Direction + distance
Sensors detect the direction and measure the distance between the user and the obstacle.
Identify safe path
Sensors determine the safe path for users to deviate toward to avoid the obstacle.