TELEOP
TELEOP
TELEOP
TELEOP
TELEOP
TELEOP
Making Teleoperation for Autonomous Vehicles Easier and Safer
Making Teleoperation for Autonomous Vehicles Easier and Safer
Making Teleoperation for Autonomous Vehicles Easier and Safer
Making Teleoperation for Autonomous Vehicles Easier and Safer
Making Teleoperation for Autonomous Vehicles Easier and Safer
Making Teleoperation for Autonomous Vehicles Easier and Safer
5 Months
Timeline
Product Designer
Role
5 Months
Timeline
Product Designer
Role
Introduction
Introduction
In this case study, I’ll walk you through a project where we worked on improving the User Experience Design for teleoperators. These are the people who remotely control autonomous shuttle buses. Our goal was to help them stay aware of everything happening with the buses, so they could quickly spot and solve any problems. We faced some challenges along the way, but in the end, we came up with some cool design ideas that really made a difference.
In this case study, I’ll walk you through a project where we worked on improving the User Experience Design for teleoperators. These are the people who remotely control autonomous shuttle buses. Our goal was to help them stay aware of everything happening with the buses, so they could quickly spot and solve any problems. We faced some challenges along the way, but in the end, we came up with some cool design ideas that really made a difference.
Project Overview
Project Overview
1
What We Wanted to Achieve
We aimed to create a User Interface that makes it easier for teleoperators to keep an eye on multiple autonomous buses. The idea was to ensure that they could quickly detect issues, especially in critical situations where fast action is needed.
1
What We Wanted to Achieve
We aimed to create a User Interface that makes it easier for teleoperators to keep an eye on multiple autonomous buses. The idea was to ensure that they could quickly detect issues, especially in critical situations where fast action is needed.
1
What We Wanted to Achieve
We aimed to create a User Interface that makes it easier for teleoperators to keep an eye on multiple autonomous buses. The idea was to ensure that they could quickly detect issues, especially in critical situations where fast action is needed.
2
The Challenge
Teleoperators need to stay super aware of what's going on with several buses at once, and they must be able to spot and react to problems quickly and accurately.
2
The Challenge
Teleoperators need to stay super aware of what's going on with several buses at once, and they must be able to spot and react to problems quickly and accurately.
2
The Challenge
Teleoperators need to stay super aware of what's going on with several buses at once, and they must be able to spot and react to problems quickly and accurately.
3
Our Big Question
Which UI design helps teleoperators stay most aware when they have to monitor multiple buses at the same time?
3
Our Big Question
Which UI design helps teleoperators stay most aware when they have to monitor multiple buses at the same time?
3
Our Big Question
Which UI design helps teleoperators stay most aware when they have to monitor multiple buses at the same time?
How we did
How we did
Concept Development
Concept Development
We started by brainstorming different UI designs, focusing on two main styles: Integrated and Segregated views. The Integrated view combined everything into one screen, while the Segregated view split things up. We wanted to see which would help teleoperators do their job better.
We started by brainstorming different UI designs, focusing on two main styles: Integrated and Segregated views. The Integrated view combined everything into one screen, while the Segregated view split things up. We wanted to see which would help teleoperators do their job better.
Prototyping
Prototyping
After deciding on our concepts, we created detailed wireframes and then high-fidelity prototypes. These included color-coded alerts (red for emergencies, yellow for warnings, green for safe conditions) and easy-to-understand icons.
After deciding on our concepts, we created detailed wireframes and then high-fidelity prototypes. These included color-coded alerts (red for emergencies, yellow for warnings, green for safe conditions) and easy-to-understand icons.
User Testing
User Testing
We tested our designs with 20 people. They were divided into two groups, each using one of the UI designs. We tracked how fast they responded to issues, how well they understood what was happening, and where they focused their attention using eye-tracking tools.
We tested our designs with 20 people. They were divided into two groups, each using one of the UI designs. We tracked how fast they responded to issues, how well they understood what was happening, and where they focused their attention using eye-tracking tools.
Collecting Data and Analyzing
Collecting Data and Analyzing
After deciding on our concepts, we created detailed wireframes and then high-fidelity prototypes. These included color-coded alerts (red for emergencies, yellow for warnings, green for safe conditions) and easy-to-understand icons.
After deciding on our concepts, we created detailed wireframes and then high-fidelity prototypes. These included color-coded alerts (red for emergencies, yellow for warnings, green for safe conditions) and easy-to-understand icons.
What we found
What we found
The results were pretty clear: the Integrated UI design came out on top
The results were pretty clear: the Integrated UI design came out on top
Understanding the Situation
Understanding the Situation
Participants understood what was happening with the buses better when using the Integrated UI. On average, they scored 79.16% in situational awareness, compared to 69.44% with the Segregated UI.
Participants understood what was happening with the buses better when using the Integrated UI. On average, they scored 79.16% in situational awareness, compared to 69.44% with the Segregated UI.
Response Time
Response Time
The Integrated UI helped participants respond faster to issues—on average, 1.7 seconds quicker than those using the Segregated UI.
The Integrated UI helped participants respond faster to issues—on average, 1.7 seconds quicker than those using the Segregated UI.
Attention Focus
Attention Focus
Eye-tracking data showed that people using the Integrated UI were better at focusing on important alerts, which reduced the need for them to constantly shift their gaze.
Eye-tracking data showed that people using the Integrated UI were better at focusing on important alerts, which reduced the need for them to constantly shift their gaze.
Design Suggestions
Design Suggestions
Based on our findings, here’s what we recommend for designing better UIs for teleoperators
Based on our findings, here’s what we recommend for designing better UIs for teleoperators
Centralized Alert Display
Centralized Alert Display
We suggest having a central area on the screen where all alerts are shown, complete with icons, short descriptions, and more detailed information if needed.
We suggest having a central area on the screen where all alerts are shown, complete with icons, short descriptions, and more detailed information if needed.
Color-Coded Alerts
Color-Coded Alerts
Use a color system -green for safe, yellow for warnings, and red for emergencies- to make it easy for teleoperators to see what’s going on at a glance.
Use a color system -green for safe, yellow for warnings, and red for emergencies- to make it easy for teleoperators to see what’s going on at a glance.
Consistent Monitoring States
Consistent Monitoring States
Keep the UI visually consistent, especially in how it shows monitoring states. This helps teleoperators stay focused.
Keep the UI visually consistent, especially in how it shows monitoring states. This helps teleoperators stay focused.
Feedback Mechanisms
Feedback Mechanisms
Combine visual and audio alerts, with different levels of urgency, to make sure teleoperators respond quickly when needed.
Combine visual and audio alerts, with different levels of urgency, to make sure teleoperators respond quickly when needed.
Wrapping It Up
Wrapping It Up
In the end, the Integrated UI design really improved how teleoperators worked. It helped them stay more aware, respond faster, and overall, it just made the job easier and less stressful. This project showed us how important it is to have a well-thought-out UI, especially in situations where every second counts.
In the end, the Integrated UI design really improved how teleoperators worked. It helped them stay more aware, respond faster, and overall, it just made the job easier and less stressful. This project showed us how important it is to have a well-thought-out UI, especially in situations where every second counts.
See full PDF presentation
