Disabled fail-safe at issue in Uber crash
Skip to main content
Sister Publication Links
  • Automotive News Canada
  • Automotive News Europe
  • Automotive News Mexico
  • Automotive News China
  • Automobilwoche
AN-LOGO-BLUE
Subscribe
  • Subscribe
  • Account
  • login
  • HOME
  • NEWS
    • Dealers
    • Automakers & Suppliers
    • News by Brand
    • Cars & Concepts
    • China
    • Shift
    • Mobility Report
    • Special Reports
    • Digital Edition Archive
    • This Week's Issue
    • Chinese, western consumers divided on electric, self-driving cars, survey finds
      Decline in ride hailing dents car sales, report says
      Nio launches another crossover
      Polestar
      Polestar 2 trial production begins at Geely plant
    • Four technologies that could take the world beyond lithium ion
      Many lessons learned -- and some underway -- on battery safety
      Leave room for lead?
      The 3 main types of lithium ion battery cells
    • Uber
      Uber reports 3,000 sexual assault claims last year in its safety review
      Toyota leads $50 million funding round for May Mobility
      Ford halts medical shuttle to test with AVs instead
      MB robotaxi web.jpg
      Daimler starts pilot testing of self-driving Mercedes taxis in the U.S.
    • Automotive News special report: Retail Realities
      2019 UAW-Detroit 3 negotiations: The path forward
      Dealerships owned by ex-NFL stars face collapse, litigation
      Want a luxury car? Try a Kia
    • Executives from some of the largest U.S. auto lenders debate the viability of 84-month car loans. From left, Ian Anderson of Westlake Financial Services, GM Financial’s Kyle Birch, Charles Bradley of Consumer Portfolio Services and Huntington Auto Finance’s Rich Porrello.
      Lenders differ on 84-month loans
      New to the U.S. landscape, a Mazda supplier commits large
      Kyle Shaules’ Civic rolled five times after he hit a puddle and hydroplaned.
      Honda shares crash survival stories
      Porsche aims to pair speedy Taycan with fast charging
    • Access F&I
    • Fixed Ops Journal
    • Marketing
    • Used Cars
    • Sales
    • Best Practices
    • Dealership Buy/Sell
    • NADA
    • NADA Show
    • Automakers
    • Manufacturing
    • Suppliers
    • Regulations & Safety
    • Executives
    • Leading Women Network
    • Guide to Economic Development
    • PACE Awards
    • Management Briefing Seminars
    • World Congress
    • Aston Martin
    • BMW
      • Mini
      • Rolls-Royce
    • Daimler
      • Mercedes Benz
      • Smart
    • Fiat Chrysler
      • Alfa Romeo
      • Chrysler
      • Dodge
      • Ferrari
      • Fiat
      • Jeep
      • Maserati
      • Ram
    • Ford
      • Lincoln
    • General Motors
      • Buick
      • Cadillac
      • Chevrolet
      • GMC
      • Holden
    • Honda
      • Acura
    • Hyundai
      • Genesis
      • Kia
    • Mazda
    • McLaren
    • Mitsubishi
    • Nissan
      • Infiniti
    • PSA
      • Citroen
      • Opel
      • Peugeot
    • Renault
    • Subaru
    • Suzuki
    • Tata
      • Jaguar
      • Land Rover
    • Tesla
    • Toyota
      • Lexus
    • Volkswagen
      • Audi
      • Bentley
      • Bugatti
      • Lamborghini
      • Porsche
      • Seat
      • Skoda
    • Volvo
    • (Discontinued Brands)
    • Auto Shows
      • Detroit Auto Show
      • New York Auto Show
      • Los Angeles Auto Show
      • Chicago Auto Show
      • Geneva Auto Show
      • Paris Auto Show
      • Frankfurt Auto Show
      • Toronto Auto Show
      • Tokyo Auto Show
      • Shanghai Auto Show
      • Beijing Auto Show
    • Future Product Pipeline
    • Photo Galleries
    • Car Cutaways
    • Design
  • OPINION
    • Blogs
    • Cartoons
    • Keith Crain
    • Automotive Views with Jason Stein
    • Columnists
    • China Commentary
    • Editorials
    • Letters to the Editor
    • Send us a Letter
    • Alfa-Romeo-Stelvio- web.jpg
      Alfa Romeo could be Tavares' toughest turnaround
      Iacobelli
      Alphons Iacobelli: The bad penny that keeps turning up
      With Mach-E, Ford ensures Mustang badge will live on
      Autonomous
      A call for clarity on self-driving terminology
    • view gallery
      1 photos
      Polarizing Design
      view gallery
      1 photos
      Charging Ahead
      Roger Penske buys the Indianapolis Motor Speedway and IndyCar
      view gallery
      1 photos
      Pace Truck
      FCA-PSA
      view gallery
      1 photos
      Merger Of Equals: Pt 2
    • Shifting gears away from the stick shift
      SEMA still a wonderful circus
      Penske still has plenty of races to win
      Ford's turn in the hot seat
    • December 6, 2019 | All Stars will leave an imprint on the industry’s future
      November 29, 2019 | Plenty to be thankful for in the automotive industry
      November 22, 2019 | GM’s lawsuit against FCA is all about payback
      November 15, 2019 | Will anyone buy EVs?
    • German car jobs boom comes to screeching halt
      John Pye
      AV testing needs clear NHTSA guidelines
      Hackett's remedy for sticker shock
      Amit Rosenzweig
      AV industry needs teleoperation laws
    • EV taxis
      Beijing, unrelenting, steps up push for EV output
      Buick in China
      Global automakers raise bet on gasoline crossovers, SUVs in search of growth opportunities
      American brands, losing ground, face new challenges in China
      PSA, FCA must confront excess China capacity under merger
    • Uber case should prompt tighter AV controls
      Plan to clean up UAW corruption is a good start
      Shared benefits make FCA-PSA union worth risk
      GM, UAW should get credit for working out deal
    • Trabant has been reliable, mostly
      Cadillac needs to get its priorities straight
      Dealers can find out how to follow ADA
      Indeed, Penske did have another win
  • DATA CENTER
  • VIDEO
    • AutoNews Now
    • First Shift
    • Special Video Reports
    • Weekend Drive
    • AutoNews Now: Uber discloses 3,000 claims of sexual assault in 2018
      AutoNews Now: UAW names Rory Gamble president
      AutoNews Now: UAW-FCA deal enhances profit sharing, health care
      AutoNews Now: PSA, FCA leaders discuss merger, friendship
    • First Shift: Tesla's China-made cars qualify for subsidies
      First Shift: LG Chem says it will build batteries with GM in Ohio
      First Shift: U.S. attorney wants 'more cooperation' from UAW in probe
      First Shift: VW faces more diesel litigation
    • Ford's Jim Hackett on Wall Street, the Mustang Mach-E and tech opportunities for dealers
      watch video
      9:13
      Women service staffers defy perceptions, boost customer satisfaction
      Tenn. dealer preaches profits, fixed ops longevity, workplace empathy
      Family, flexibility, fun crush employee turnover at No. 1 dealership
    • Why Carlos Tavares wants to merge PSA and FCA  
      Lincoln aims to 'paint a new picture' for shoppers
      VW's Scott Keogh on bringing 'cool' EVs to the masses
      How Toyota found its 'niche' in Mexico
  • EVENTS & AWARDS
    • Events
    • Awards
    • World Congress
    • Retail Forum: NADA
    • Canada Congress
    • Marketing 360: L.A.
    • Europe Congress
    • Retail Forum: Chicago
    • Leading Women Conference Detroit
    • Retail Forum: Toronto
    • Fixed Ops Journal Forum
    • 100 Leading Women
      • Submit a nomination for 2020
    • 40 Under 40 Retail
    • All-Stars
    • Best Dealership To Work For
    • PACE Awards
    • PACEpilot
    • Rising Stars
    • Europe Rising Stars
  • JOBS
  • +MORE
    • Leading Women Network
    • Podcasts
    • Webinars
    • Publishing Partners
    • Classifieds
    • People on the Move
    • Newsletters
    • Contact Us
    • Media Kit
    • RSS Feeds
    • Shift: A Podcast About Mobility
    • Special Reports Podcasts
    • Weekend Drive Podcasts
    • Ally: Do It Right
    • DealerSocket
    • Deloitte: Cyber everywhere: Preparing for automotive safety in the face of cyber threats
    • Facebook: The road to a zero-friction future
    • Guide To Economic Development
    • PayPal Credit: How consumer financing helps drive sales for online auto parts retailers
MENU
Breadcrumb
  1. Home
  2. Mobility Report
November 18, 2019 12:00 AM

Disabled fail-safe at issue in Uber crash

Pete Bigelow
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print
    Elaine Herzberg died in March of last year after being struck by a self-driving Uber test vehicle.

    Fresh questions have emerged about Uber's self-driving technology and safety practices on the eve of a federal meeting at which the probable cause of a landmark crash likely will be determined.

    Two people with firsthand knowledge of the company's self-driving system say company officials removed a key fail-safe from test vehicles months before one of them struck and killed a pedestrian in Tempe, Ariz.

    The fail-safe, an internally developed feature called Reflex, was shelved because some members of Uber's Advanced Technologies Group, or ATG, thought it triggered too many braking events at a time when the program was under pressure to show progress in developing software, said the sources, who asked not to be identified because they are not authorized to speak on the matter.

    Reflex provided an independent cross-check on the main self-driving systems by using short-range radar signals to sense imminent hazards directly in the path of vehicles. The sources, who had roles within ATG, believe that had it been enabled in Uber's Volvo XC90 fleet, Reflex would have mitigated the collision that killed Elaine Herzberg — and possibly prevented it.

    "It was designed to prevent exactly this sort of crash," one source said.

    The existence of Reflex has not been disclosed publicly, nor is it referenced in any of the 43 documents and 439 pages of information the National Transportation Safety Board has released in its public docket on the March 18, 2018, incident, the first fatal crash in history involving a self-driving vehicle.

    Asked about Reflex, a spokesperson for Uber said Friday, Nov. 15, the company could not comment pending the ongoing NTSB investigation.

    With NTSB investigators set to meet Tuesday, the two sources, plus a third person who also held a role within ATG, spoke to Automotive News because they were concerned that investigators did not yet have a comprehensive picture of Uber's safety capabilities and culture. Further, they worried that lessons learned from the crash have gone unheeded.

    Lots of effort, little payoff

    The three people described a culture intent on keeping pace with rival Waymo, which regularly makes public pronouncements about the number of cars in its fleet and the number of miles it drives. Even though many in ATG found little value in pursuing a similar course, leaders deemed it necessary to put a large number of cars on the road because those were metrics they believed investors valued.

    When Uber named Dara Khosrowshahi CEO in August 2017, pressure to show progress intensified — not because pressure was directly applied by the CEO. In meetings before and after the crash, two of the sources say, Khosrowshahi showed tepid enthusiasm for Uber's self-driving ambitions. In turn, ATG leaders ramped up efforts to show progress.

    That included eliminating Reflex, because it caused frequent braking events that could make rides uncomfortable or jarring.

    Smooth rides weren't yet an objective of engineers. But at Uber and elsewhere, smooth rides give the appearance of progress to those unfamiliar with self-driving development, and it became important to demonstrate for Khosrowshahi and potential investors the ability to provide smooth rides. In every sense, the three people said, this was a matter of Uber choosing comfort over safety.

    Suppression vs. caution

    Earlier in development of the system, there was concern that harsh braking events, a frequent occurrence when AVs are being tested, could lead to human drivers rear-ending test vehicles. To reduce that likelihood, Uber installed a function called action suppression, sometimes internally called plan suppression, that would delay hard braking by one second to account for the possibility these frequent braking events were false positives — braking for hazards that didn't exist.

    This worked but at the cost of delaying reaction to real problems — a scenario that would play out in the Tempe crash. Recognizing that potential pitfall, Uber engineers designed Reflex as a rudimentary backstop to the main self-driving system and as a counterbalance to action suppression. But it was removed in the months before the crash. The three sources could not provide a specific date that Reflex was removed.

    The action-suppression efforts are described in the NTSB docket, and the suppression system delayed a braking response when a collision with Herzberg was imminent. Since then, Uber has changed its system so hard braking is initiated immediately when a collision is imminent.

    There was another system available that held the potential to apply emergency braking. Volvo's City Safety driver-assist system came factory-installed on the XC90s that Uber used for testing. But it was deactivated because Volvo and Uber engineers said radar signals from the systems interfered with each other. The three sources dispute that.

    ‘Problematic'

    All three sources viewed the deactivations of Reflex and City Safety as links in the broader set of circumstances that contributed to Herzberg's death. Other circumstances include a human safety driver who watched a TV show on her phone instead of the road, software that could not properly classify Herzberg as a pedestrian for 5.6 seconds before impact, the culture of Uber's self-driving program and even the roadway infrastructure.

    As the NTSB prepares to meet, the three people all caution that, while Uber deserves its share of blame, recommendations for improved safety and revised public-testing procedures should be given to the entire industry.

    "We had unrealistic timelines and internally driven pressure," one of the sources said. "That's not unique to Uber. The way we develop and test as an industry is problematic."

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    Digital Edition
    THIS WEEK'S EDITION
    See our archive
    Fixed Ops Journal
    Fixed Ops Journal - 10-21-19
    Read the issue
    See our archive
    Sign up for free newsletters
    EMAIL ADDRESS

    Please enter a valid email address.

    Please enter your email address.

    Please select at least one newsletter to subscribe.

    You can unsubscribe at any time through links in these emails. For more information, see our Privacy Policy.

    Get Free Newsletters

    Sign up and get the best of Automotive News delivered straight to your email inbox, free of charge. Choose your news – we will deliver.

    Subscribe Now

    Get 24/7 access to in-depth, authoritative coverage of the auto industry from a global team of reporters and editors covering the news that’s vital to your business.

    Subscribe Now
    Connect With Us
    • Facebook
    • Instagram
    • LinkedIn
    • Twitter

    Our mission

    The Automotive News mission is to be the primary source of industry news, data and understanding for the industry's decision-makers interested in North America.

    AN-LOGO-BLUE
    Contact Us

    1155 Gratiot Avenue
    Detroit, Michigan
    48207-2997

    (877) 812-1584

    Email us

    Automotive News
    ISSN 0005-1551 (print)
    ISSN 1557-7686 (online)

    Fixed Ops Journal
    ISSN 2576-1064 (print)
    ISSN 2576-1072 (online)

    Resources
    • About us
    • Contact Us
    • Media Kit
    • Subscribe
    • Manage your account
    • Reprints
    • Ad Choices Ad Choices
    • Sitemap
    Legal
    • Terms and Conditions
    • Privacy Policy
    Automotive News
    Copyright © 1996-2019. Crain Communications, Inc. All Rights Reserved.
    • HOME
    • NEWS
      • Dealers
        • Access F&I
        • Fixed Ops Journal
        • Marketing
        • Used Cars
        • Sales
        • Best Practices
        • Dealership Buy/Sell
        • NADA
        • NADA Show
      • Automakers & Suppliers
        • Automakers
        • Manufacturing
        • Suppliers
        • Regulations & Safety
        • Executives
        • Leading Women Network
        • Guide to Economic Development
        • PACE Awards
        • Management Briefing Seminars
        • World Congress
      • News by Brand
        • Aston Martin
        • BMW
          • Mini
          • Rolls-Royce
        • Daimler
          • Mercedes Benz
          • Smart
        • Fiat Chrysler
          • Alfa Romeo
          • Chrysler
          • Dodge
          • Ferrari
          • Fiat
          • Jeep
          • Maserati
          • Ram
        • Ford
          • Lincoln
        • General Motors
          • Buick
          • Cadillac
          • Chevrolet
          • GMC
          • Holden
        • Honda
          • Acura
        • Hyundai
          • Genesis
          • Kia
        • Mazda
        • McLaren
        • Mitsubishi
        • Nissan
          • Infiniti
        • PSA
          • Citroen
          • Opel
          • Peugeot
        • Renault
        • Subaru
        • Suzuki
        • Tata
          • Jaguar
          • Land Rover
        • Tesla
        • Toyota
          • Lexus
        • Volkswagen
          • Audi
          • Bentley
          • Bugatti
          • Lamborghini
          • Porsche
          • Seat
          • Skoda
        • Volvo
        • (Discontinued Brands)
      • Cars & Concepts
        • Auto Shows
          • Detroit Auto Show
          • New York Auto Show
          • Los Angeles Auto Show
          • Chicago Auto Show
          • Geneva Auto Show
          • Paris Auto Show
          • Frankfurt Auto Show
          • Toronto Auto Show
          • Tokyo Auto Show
          • Shanghai Auto Show
          • Beijing Auto Show
        • Future Product Pipeline
        • Photo Galleries
        • Car Cutaways
        • Design
      • China
      • Shift
      • Mobility Report
      • Special Reports
      • Digital Edition Archive
      • This Week's Issue
    • OPINION
      • Blogs
      • Cartoons
      • Keith Crain
      • Automotive Views with Jason Stein
      • Columnists
      • China Commentary
      • Editorials
      • Letters to the Editor
      • Send us a Letter
    • DATA CENTER
    • VIDEO
      • AutoNews Now
      • First Shift
      • Special Video Reports
      • Weekend Drive
    • EVENTS & AWARDS
      • Events
        • World Congress
        • Retail Forum: NADA
        • Canada Congress
        • Marketing 360: L.A.
        • Europe Congress
        • Retail Forum: Chicago
        • Leading Women Conference Detroit
        • Retail Forum: Toronto
        • Fixed Ops Journal Forum
      • Awards
        • 100 Leading Women
          • Submit a nomination for 2020
        • 40 Under 40 Retail
        • All-Stars
        • Best Dealership To Work For
        • PACE Awards
        • PACEpilot
        • Rising Stars
        • Europe Rising Stars
    • JOBS
    • +MORE
      • Leading Women Network
      • Podcasts
        • Shift: A Podcast About Mobility
        • Special Reports Podcasts
        • Weekend Drive Podcasts
      • Webinars
      • Publishing Partners
        • Ally: Do It Right
        • DealerSocket
        • Deloitte: Cyber everywhere: Preparing for automotive safety in the face of cyber threats
        • Facebook: The road to a zero-friction future
        • Guide To Economic Development
        • PayPal Credit: How consumer financing helps drive sales for online auto parts retailers
      • Classifieds
      • People on the Move
      • Newsletters
      • Contact Us
      • Media Kit
      • RSS Feeds