You work for the self-driving bus company as an expert in the area of computer vision and machine learning. You have served as part of the technical team that designed and implemented the algorithms that detect objects in the environment, including other vehicles, pedestrians, bicyclists, and immovable items such as concrete barriers or curbs. The fleet has been designed in such a way that lane markings and traffic signal information necessary for the vehicle to “make decisions” does not require computer vision (sensors in the roads will communicate that information to the buses instead).
You have been asked by your company to join the stakeholder process, answer questions that arise about the technology, and “reassure people” (a phrase used in a note from your boss about the event) that the self-driving bus fleet is a safe and viable transportation option.
As the company’s computer vision specialist, your main points of prioritization include:
- Describing the state of computer vision and its ability to detect other vehicles as well as pedestrians, bikers, and others not in vehicles
- Explaining the effect that different weather conditions can have on the reliability of computer vision
- Delineating other factors that can interfere with the reliability of computer vision (e.g., if people tamper with street signs)
- Describing strategies that can increase the reliability of computer vision
Supplemental readings
- Dickerson, B. (2018, September 17). The challenges of teaching driverless cars to see the world. https://bdtechtalks.com/2018/09/17/self-driving-cars-ai-computer-vision/
- Gandhi, T., & Trivedi, M. M. (2006). Pedestrian collision avoidance systems: a survey of computer vision based recent studies. 2006 IEEE Intelligent Transportation Systems Conference. doi: 10.1109/itsc.2006.1706871. https://ieeexplore.ieee.org/abstract/document/1706871
- Lai, A. (2018, December 15). How do Self-Driving Cars See? Retrieved from https://towardsdatascience.com/how-do-self-driving-cars-see-13054aee2503
- Zaveri, M. (2019, March 5). Prosecutors Don’t Plan to Charge Uber in Self-Driving Car’s Fatal Accident. The New York Times. https://www.nytimes.com/2019/03/05/technology/uber-self-driving-car-arizona.html