It's not that hard to drive a car! Unfortunately, physics motivates us to have unreasonable expectations of our drivers, like "doesn't drive off the road at 100km/h ever", and "avoids all obstacles all of the time". That's the hard part.