I've worked on highly safety related (classification ASIL D) automotive systems. There are rules about how to think about the driver.
The driver is not considered a reliable component of such a system, and must not be used to guide decisions.
Yes, the driver clearly was a fool, but system design should not have taken his decision into account, and come to its own conclusion for a safe reaction (e.g., stopping the car).
The driver is not considered a reliable component of such a system, and must not be used to guide decisions.
Yes, the driver clearly was a fool, but system design should not have taken his decision into account, and come to its own conclusion for a safe reaction (e.g., stopping the car).