Cars hear you, but when will they get you?
Skip to main content
Sister Publication Links
  • Automotive News Canada
  • Automotive News Europe
  • Automotive News China
  • Automobilwoche
AN-LOGO-BLUE
Subscribe
  • Subscribe
  • Account
  • login
  • HOME
  • NEWS
    • Dealers
    • Automakers & Suppliers
    • News by Brand
    • Cars & Concepts
    • Coronavirus Coverage
    • China
    • Shift
    • Mobility Report
    • Special Reports
    • Digital Edition Archive
    • This Week's Issue
    • COVID-19 vaccines reaching auto plants, but challenges remain
      Working online to book COVID shots, office manager Billie Jean Pellet “typed so fast smoke came off the keyboard,” said dealer Earl Stewart.
      Dealership team hunts for vaccine
      Hope stalls for rebound in European auto sales
      Dana net income falls 53% in Q4
    • Chinese tech companies are turning their sights on EVs
      Telecom firm ZTE preparing electric vehicle product line
      Changan
      Huawei, battered by U.S. sanctions, plans foray into EVs, report says
      VW China
      Top VW China exec said to eye joining Renault as local CEO
      Geely to create separate EV business unit
    • As EV output explodes in China, e-axle drive assembly automates
      Plus to roll big rigs on a ‘continuum' toward self-driving future
      Lidar moves beyond vehicles to underpin a reimagined logistics chain
      Factories embrace Industry 4.0
    • The Cruise AV autonomous vehicle, based on the Chevy Bolt
      GM-backed Cruise is in talks to buy startup Voyage, report says
      Fisker's next wave: A premium people's car
      A worker fixes a power line in Austin, Texas, last month.
      Bidirectional EVs could lend a hand in power crisis
      Toyota banks on plug-ins as rivals push BEVs
    • Elon Musk interview
      Tesla’s Model Y, on sale since March, is a showcase of EV technologies competitors will benchmark.
      Technologies of Electrification
      Cadillac’s Lyriq EV will be unveiled Aug. 6.
      Future Product Pipeline
      A CALL TO ACTION
    • COVID-19 vaccines reaching auto plants, but challenges remain
      In SPACs, dealers see viable option to go public
      New-school solution for recruiting auto techs
      Is your dealership a great place to work?
    • Access F&I
    • Fixed Ops Journal
    • Marketing
    • Used Cars
    • Retail Technology
    • Sales
    • Best Practices
    • Dealership Buy/Sell
    • NADA
    • NADA Show
    • Automakers
    • Manufacturing
    • Suppliers
    • Regulations & Safety
    • Executives
    • Talk From The Top
    • Leading Women Network
    • Guide to Economic Development
    • PACE Awards
    • Management Briefing Seminars
    • World Congress
    • Aston Martin
    • BMW
      • Mini
      • Rolls-Royce
    • Daimler
      • Mercedes Benz
      • Smart
    • Ford
      • Lincoln
    • General Motors
      • Buick
      • Cadillac
      • Chevrolet
      • GMC
    • Honda
      • Acura
    • Hyundai
      • Genesis
      • Kia
    • Mazda
    • McLaren
    • Mitsubishi
    • Nissan
      • Infiniti
    • Stellantis
      • Alfa Romeo
      • Citroen
      • Chrysler
      • Dodge
      • Ferrari
      • Fiat
      • Jeep
      • Lancia
      • Maserati
      • Opel
      • Peugeot
      • Ram
      • Vauxhall
    • Renault
    • Subaru
    • Suzuki
    • Tata
      • Jaguar
      • Land Rover
    • Tesla
    • Toyota
      • Lexus
    • Volkswagen
      • Audi
      • Bentley
      • Bugatti
      • Lamborghini
      • Porsche
      • Seat
      • Skoda
    • Volvo
    • (Discontinued Brands)
    • Virtual reveals (Sponsored)
      • MITSUBISHI: 2022 Outlander
      • NISSAN: 2022 Pathfinder and 2022 Frontier
      • GENESIS: 2021 GV80
      • KIA: 2021 K5
      • LEXUS: 2021 IS
      • NISSAN: 2021 Rogue
      • TOYOTA: 2021 Venza and 2021 Sienna
    • Auto Shows
    • Future Product Pipeline
    • Photo Galleries
    • Car Cutaways
    • Design
  • OPINION
    • Blogs
    • Cartoons
    • Keith Crain
    • Automotive Views with Jason Stein
    • Columnists
    • China Commentary
    • Editorials
    • Letters to the Editor
    • Send us a Letter
    • Fisker gets a rare second chance to build his own car company
      The new Stellantis pickup: Schrödinger's Dakota
      Gerry McGovern is right man to steer Jaguar reinvention
      Forget the Ford GT; Moray Callum's biggest hit is the aluminum F-150
    • Jaguar is about to undergo its fourth reinvention in five decades as owner Tata Group takes a second crack at shaking up a brand whose glorious past has rarely translated into a profitable present or sustainable future.
      Jaguar Redo, Part IV
      view gallery
      1 photos
      Chip Shortage
      Jaguar is about to undergo its fourth reinvention in five decades as owner Tata Group takes a second crack at shaking up a brand whose glorious past has rarely translated into a profitable present or sustainable future.
      view gallery
      9 photos
      Leo Michael Cartoons - Q1 2021
      Dealers hiring from hospitality sector
      view gallery
      1 photos
      Hospitality Hires
    • Shifting gears away from the stick shift
      SEMA still a wonderful circus
      Penske still has plenty of races to win
      Ford's turn in the hot seat
    • March 2, 2021 | Will EV bets pay off?
      February 23, 2021 | Reliability continues to soar
      February 16, 2021 | Apple looks to take bite out of automotive
      February 9, 2021 | ‘Super’ opportunity for automakers
    • Jamie Butters
      EV plans and some damn lies
      Mark Paul
      What dealers can do if D.C. power shift affects recalls
      Reinvention of Jaguar is a tall task for McGovern
      Are we in the midst of a fourth industrial revolution?
    • Shanghai hints at how Chinese cities will pursue electrification
      How Tesla, GM transformed EV market in 2020
      Is sales recovery nearing an end?
      Beijing's uphill battle to boost EV sales
    • U.S. Dealership lot
      Lean lots won't last without new dealer discipline
      Taiwan Semicon microchips BB web.jpg
      Chip shortage shows need for new thinking
      Digital demands squeeze smaller auto retailers
      President Joe Biden’s move to electrify all government vehicles could push forward charging infrastructure development.
      Dealers aren't wrong to be wary of EV hype
    • New look at Nissan a positive sign
      Embrace EV ideas at our doorstep
      Buying EV without dealer is just easier
      Dealers are right to worry about EVs
  • DATA CENTER
  • VIDEO
    • AutoNews Now
    • First Shift
    • Special Video Reports
    • Weekend Drive
    • AutoNews Now: Toyota, Mazda, Subaru, Hyundai, Kia slide in Feb.; Volvo, Genesis rise
      AutoNews Now: Toyota RAV4 probed for fire risk
      AutoNews Now: Nissan 'breakthrough' could lower emissions
      AutoNews Now: Most buyers still undecided on EVs, J.D. Power finds
    • First Shift: Stellantis aims for higher profit margins in 2021
      First Shift: Volvo's electric push includes online-only sales
      First Shift: U.S. dealership profits surge 48% to record high
      First Shift: Tesla output in Calif. resumes after 2-day shutdown
    • Bert Ogden Auto Group
      Back to basics: How a Texas group is cutting costs, saving millions 
      COVID, chips and checks: Sales headwinds and tailwinds for 2021
      N.J. dealer helps position peers for ‘electric revolution’
      DCH Millburn Audi
      'Finding the diamond in the rough': How 2020's No. 1 dealership retains talent
    • Why the pickup is the auto industry's 'battleground'
      Carlos Ghosn's quest to restore his reputation
      Why Ford must execute to avoid 'deep trouble'
      Why Honda is 'locked and loaded' for 2020
  • EVENTS & AWARDS
    • Events
    • Awards
    • Congress Conversations
    • Retail Forum: NADA
    • Canada Congress
    • Europe Congress Conversations
    • Leading Women Conference
    • Fixed Ops Journal Forum
    • ANE Shift
    • Shift: Mobility at a Crossroads
    • Shift: The Future of Mobility (CES)
    • 100 Leading Women
    • 40 Under 40 Retail
    • All-Stars
    • Best Dealerships To Work For
    • PACE Program
    • Rising Stars
    • Europe Rising Stars
  • JOBS
  • AN Solutions
  • +MORE
    • Leading Women Network
    • Podcasts
    • Webinars
    • In the Driver's Seat
    • Publishing Partners
    • Classifieds
    • Companies on the Move
    • People on the Move
    • Newsletters
    • Contact Us
    • Media Kit
    • RSS Feeds
    • Shift: A Podcast About Mobility
    • Special Reports Podcasts
    • Daily Drive Podcasts
    • AAM
    • Gentex
    • Reputation.com
    • Ricardo
    • Ricardo
    • Allstate: Want more from your F&I?
    • Ally: Navigating the future of automotive retailing
    • Amazon Web Services: Any place, any time, any channel
    • Amazon Web Services: The power of the cloud
    • Amazon Web Services: Universal translator: Harnessing sensor data to build better automotive software
    • Epic Games: Transforming the auto industry with digital assets
    • FTI Consulting: Crisis as a catalyst for change
    • Google: 5 trends shaping the auto industry's approach to a new normal
    • IHS Markit: Automotive loyalty in the wake of the COVID-19 recession
    • IHS Markit: Autonomous vehicles: Automotive and transportation disruption
    • IHS Markit: COVID-19: The future mobility delusion
    • Level5: 2020 Automotive E-Commerce Report
    • Naked Lime: Bring social reputation together as part of big-picture marketing
    • Wells Fargo Auto: Switching gears from LIBOR to SOFR
    • Ally: Do It Right
    • DealerSocket
    • Deloitte: Cyber everywhere: Preparing for automotive safety in the face of cyber threats
    • Facebook: The road to a zero-friction future
    • Guide To Economic Development
    • PayPal Credit: How consumer financing helps drive sales for online auto parts retailers
MENU
Breadcrumb
  1. Home
  2. Technology
March 23, 2015 01:00 AM

Cars hear you, but when will they get you?

Voice-recognition tech moves toward artificial intelligence and natural language

Julie Halpert
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print

    Almost all vehicles sold in America today are programmed to respond to a driver's voice commands. But still on the frontiers of automotive research are vehicles that can determine what a driver really wants -- and respond intelligently.

    Getting to that point is a profound engineering challenge that is leading researchers beyond voice recognition and into the realm of artificial intelligence. It will require auto companies, suppliers and their technology partners to delve into the building blocks of language and to teach computers to understand humans as well as humans understand one another.

    It's one of the "hardest, long-standing challenges in artificial intelligence," says Tim Tuttle, CEO of Expect Labs, a San Francisco company that works on refining voice-recognition technology.

    For Expect Labs, context is everything. Its MindMeld platform helps app developers and device makers integrate voice commands with other inputs to make more sense of the directions. For instance, if a driver is in the car at 8 a.m. and asks the navigation system to find a coffee shop, the car can surmise that the driver is likely on the way to work and can identify a coffee shop along the usual route. The idea is that these voice-powered interfaces should be able to process more than the simple command and respond the way a human would.

    A competing platform from a company called api.ai would allow a car's system to respond to less specific commands: for example, navigating to the nearest grocery store, even if all the driver says is, "I'd like to do some shopping and buy eggs and carrots."

    One key objective for technology companies is to simplify the language itself, allowing humans to interact with a car's computers in a natural, more conversational way, rather than through prescribed commands or a stilted syntax.

    Gint Puskorius, manager of voice signal processing at Ford's Research and Advanced Engineering division, explains that if a driver issues a command to set the temperature at 70 degrees and then says, "Make it a little cooler," the car's system should remember the temperature was at 70 and set it to 69.

    "The memory of what we were in a dialogue about" needs to be part of "future-generation systems that are more natural and more interactive," he said.

    Ilya GelfenbeynCEO of api.ai

    "The main challenge is that all people speak differently, not just in terms of accents, but they also formulate their thoughts in different ways. We have to teach the system to understand different ways of saying the same thing."

    Onboard vs. cloud

    That level of memory and comprehension requires huge leaps in the onboard computing power of a car.

    Most cars today have a limited vocabulary, which can be matched to a limited set of words and doesn't require much computing horsepower, says Danny Shapiro, senior director of automotive at chipmaker Nvidia, which has mobile processors in 7.5 million cars, including Tesla's Model S.

    "But if you want to be able to understand anything the driver says, you have to match what's coming out of their mouth to the entire dictionary or beyond," Shapiro says. That requires a system that operates like a human brain, making connections to different sounds and forming the words and then sentences or phrases.

    Typically to access this type of information, the onboard computer would need to connect with a data center in the cloud to process the request and return it to the car. Nvidia, instead, has developed an energy-efficient chip for the car that's powerful enough to perform the natural-language processing on board.

    Puskorius says such embedded systems are becoming more powerful, allowing for use of a large vocabulary and continuous speech-recognition systems without the driver having to experience any delay.

    Nuance, a voice-recognition technology company whose automotive clients include Ford, Hyundai and Fiat Chrysler, is working on a hybrid system in which some of the processing is offloaded to the cloud. The car can analyze a driver's utterance and query, send it to the cloud, compare the results from the cloud with those of the embedded processor and use the better answer. The answers may be a bit slower to arrive but will be more accurate than those from the embedded system alone, says Arnd Weil, Naunce's vice president of automotive.

    Even so, "The main challenge is that all people speak differently, not just in terms of accents, but they also formulate their thoughts in different ways," said Ilya Gelfenbeyn, CEO of api.ai. "We have to teach the system to understand different ways of saying the same thing."

    Tuning out noise

    Beyond that, just being in a car makes things more complicated. Puskorius of Ford says voice-recognition experiences "have been substantially less pleasing for our customers than we would like them to be," largely due to the vehicle's "harsh acoustic environment."

    If the car's fan is on high, for example, it impinges on the microphone.

    David Pop, engineering manager of core technologies for General Motors, says people move around in the vehicle, and they're often not near microphones. "We're trying to get the voice captured at the highest level of quality so the speech-recognition engine can determine what it needs to do."

    At Baidu, a Chinese tech company that's working on teaching human speech to machines, researchers are factoring in the background noise. They're feeding 100,000 hours of spoken audio, and the corresponding transcripts, into supercomputers that can compile the two inputs into a robust voice dictionary.

    Andrew Ng, Baidu's chief scientist, who formerly led the Google Brain project, says his team spent time driving with the windows rolled down, playing loud music and having passengers speak loudly in the back seat, then fed data to the supercomputer.

    Amer Aijaz, director of strategy and concepts for Volvo's electrical r&d, says autonomous driving combined with more natural voice recognition creates an environment for more interaction between car and driver -- if that's what people want.

    For example, Aijaz said, if an email arrives with a calendar appointment, the car could ask, "Shall I route the car to your destination?" or "It's your anniversary today. Would you like to pick up some flowers?"

    He added: "We don't want to be too intrusive" if a driver or passenger would prefer to just relax. "So the future is not just voice command. It's a combination of modalities in human machine interface with the car."

    For starters, Volvo has worked on having a more human-sounding voice. The voice should be friendly rather than instructive and cold, Aijaz said.

    Tuttle expects recent technological breakthroughs will solve most of the problems people experience with speech recognition today. "With the best systems," he said, "you'll be more likely to have your device be able to understand what somebody said better than you can understand it."

    RECOMMENDED FOR YOU
    Top U.S. utilities collaborate to build electric vehicle charging stations
    Letter
    to the
    Editor

     

     

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    Top U.S. utilities collaborate to build electric vehicle charging stations
    Top U.S. utilities collaborate to build electric vehicle charging stations
    Next-gen trucks bring USPS into 20th century
    Next-gen trucks bring USPS into 20th century
    Nissan claims breakthrough in engine CO2 emissions
    Nissan claims breakthrough in engine CO2 emissions
    Sponsored Content: What Is OTA Testing, And Why Is It Increasingly Important For 5G?
    Sign up for free newsletters
    EMAIL ADDRESS

    Please enter a valid email address.

    Please enter your email address.

    Please verify captcha.

    Please select at least one newsletter to subscribe.

    See more newsletter options at autonews.com/newsletters.

    You can unsubscribe at any time through links in these emails. For more information, see our Privacy Policy.

    Digital Edition
    Automotive News 3-1-21
    THIS WEEK'S EDITION
    See our archive
    Fixed Ops Journal
    Fixed Ops Journal 2-8-21
    Read the issue
    See our archive
    MOBILITY REPORT NEWSLETTER: Sign up for our Thursday afternoon Mobility Report newsletter, your one-stop shop for the latest developments at the intersection of transportation and technology.
    DAILY NEWSLETTER: Sign up to get the top stories of the day in your inbox every business weekday afternoon.
    Get Free Newsletters

    Sign up and get the best of Automotive News delivered straight to your email inbox, free of charge. Choose your news – we will deliver.

    Subscribe Today

    Get 24/7 access to in-depth, authoritative coverage of the auto industry from a global team of reporters and editors covering the news that’s vital to your business.

    Subscribe Now
    Connect With Us
    • Facebook
    • Instagram
    • LinkedIn
    • Twitter

    Our mission

    The Automotive News mission is to be the primary source of industry news, data and understanding for the industry's decision-makers interested in North America.

    AN-LOGO-BLUE
    Contact Us

    1155 Gratiot Avenue
    Detroit, Michigan
    48207-2997

    (877) 812-1584

    Email us

    Automotive News
    ISSN 0005-1551 (print)
    ISSN 1557-7686 (online)

    Fixed Ops Journal
    ISSN 2576-1064 (print)
    ISSN 2576-1072 (online)

    Resources
    • About us
    • Contact Us
    • Media Kit
    • Subscribe
    • Manage your account
    • Reprints
    • Ad Choices Ad Choices
    • Sitemap
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Automotive News
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • HOME
    • NEWS
      • Dealers
        • Access F&I
        • Fixed Ops Journal
        • Marketing
        • Used Cars
        • Retail Technology
        • Sales
        • Best Practices
        • Dealership Buy/Sell
        • NADA
        • NADA Show
      • Automakers & Suppliers
        • Automakers
        • Manufacturing
        • Suppliers
        • Regulations & Safety
        • Executives
        • Talk From The Top
        • Leading Women Network
        • Guide to Economic Development
        • PACE Awards
        • Management Briefing Seminars
        • World Congress
      • News by Brand
        • Aston Martin
        • BMW
          • Mini
          • Rolls-Royce
        • Daimler
          • Mercedes Benz
          • Smart
        • Ford
          • Lincoln
        • General Motors
          • Buick
          • Cadillac
          • Chevrolet
          • GMC
        • Honda
          • Acura
        • Hyundai
          • Genesis
          • Kia
        • Mazda
        • McLaren
        • Mitsubishi
        • Nissan
          • Infiniti
        • Stellantis
          • Alfa Romeo
          • Citroen
          • Chrysler
          • Dodge
          • Ferrari
          • Fiat
          • Jeep
          • Lancia
          • Maserati
          • Opel
          • Peugeot
          • Ram
          • Vauxhall
        • Renault
        • Subaru
        • Suzuki
        • Tata
          • Jaguar
          • Land Rover
        • Tesla
        • Toyota
          • Lexus
        • Volkswagen
          • Audi
          • Bentley
          • Bugatti
          • Lamborghini
          • Porsche
          • Seat
          • Skoda
        • Volvo
        • (Discontinued Brands)
      • Cars & Concepts
        • Virtual reveals (Sponsored)
          • MITSUBISHI: 2022 Outlander
          • NISSAN: 2022 Pathfinder and 2022 Frontier
          • GENESIS: 2021 GV80
          • KIA: 2021 K5
          • LEXUS: 2021 IS
          • NISSAN: 2021 Rogue
          • TOYOTA: 2021 Venza and 2021 Sienna
        • Auto Shows
        • Future Product Pipeline
        • Photo Galleries
        • Car Cutaways
        • Design
      • Coronavirus Coverage
      • China
      • Shift
      • Mobility Report
      • Special Reports
      • Digital Edition Archive
      • This Week's Issue
    • OPINION
      • Blogs
      • Cartoons
      • Keith Crain
      • Automotive Views with Jason Stein
      • Columnists
      • China Commentary
      • Editorials
      • Letters to the Editor
      • Send us a Letter
    • DATA CENTER
    • VIDEO
      • AutoNews Now
      • First Shift
      • Special Video Reports
      • Weekend Drive
    • EVENTS & AWARDS
      • Events
        • Congress Conversations
        • Retail Forum: NADA
        • Canada Congress
        • Europe Congress Conversations
        • Leading Women Conference
        • Fixed Ops Journal Forum
        • ANE Shift
        • Shift: Mobility at a Crossroads
        • Shift: The Future of Mobility (CES)
      • Awards
        • 100 Leading Women
        • 40 Under 40 Retail
        • All-Stars
        • Best Dealerships To Work For
        • PACE Program
        • Rising Stars
        • Europe Rising Stars
    • JOBS
    • AN Solutions
    • +MORE
      • Leading Women Network
      • Podcasts
        • Shift: A Podcast About Mobility
        • Special Reports Podcasts
        • Daily Drive Podcasts
      • Webinars
      • In the Driver's Seat
        • AAM
        • Gentex
        • Reputation.com
        • Ricardo
        • Ricardo
      • Publishing Partners
        • Allstate: Want more from your F&I?
        • Ally: Navigating the future of automotive retailing
        • Amazon Web Services: Any place, any time, any channel
        • Amazon Web Services: The power of the cloud
        • Amazon Web Services: Universal translator: Harnessing sensor data to build better automotive software
        • Epic Games: Transforming the auto industry with digital assets
        • FTI Consulting: Crisis as a catalyst for change
        • Google: 5 trends shaping the auto industry's approach to a new normal
        • IHS Markit: Automotive loyalty in the wake of the COVID-19 recession
        • IHS Markit: Autonomous vehicles: Automotive and transportation disruption
        • IHS Markit: COVID-19: The future mobility delusion
        • Level5: 2020 Automotive E-Commerce Report
        • Naked Lime: Bring social reputation together as part of big-picture marketing
        • Wells Fargo Auto: Switching gears from LIBOR to SOFR
        • Ally: Do It Right
        • DealerSocket
        • Deloitte: Cyber everywhere: Preparing for automotive safety in the face of cyber threats
        • Facebook: The road to a zero-friction future
        • Guide To Economic Development
        • PayPal Credit: How consumer financing helps drive sales for online auto parts retailers
      • Classifieds
      • Companies on the Move
      • People on the Move
      • Newsletters
      • Contact Us
      • Media Kit
      • RSS Feeds