As long as humans continue to progress and innovate and create cool things, somebody, somewhere, will find a way to ruin it for everybody.
Most recently, it was a company selling a product called Autopilot Buddy that interfered with Tesla's warning system when a driver chose to use the company's semiautonomous highway driving system. NHTSA ordered the company to stop selling the device, considering it unsafe to intentionally circumvent the system's safety mechanism.
Of course, the makers of Autopilot Buddy didn't break ground in discovering how to trick Tesla's system — they were just, presumably, the first to commercialize it. Tesla owners quickly discovered how they can achieve the same outcome with the help of, um, a piece of fruit.
So, it's tough to ascertain how much blame Tesla should bear for another company's product.
From the days when the first caveman decided that a rock used for breaking other rocks could be repurposed as a lethal weapon, humanoids have found ways to tinker, tailor and rejigger the tools we have created. This is especially true for cars, where the tuner culture that's existed since the auto industry's early days is now being adopted by coders who want to mess around with vehicle operating systems.
This is not inherently a bad thing. If you buy something, especially something as expensive as a car, you should be able to do what you want with it. But, not to let Tesla off the hook, car designers in the autonomous age should factor end users' machinations into their planning, especially when road safety is an issue.
Design for the lowest, dumbest denominator, and you might save some lives in the process.
— Shiraz Ahmed