Keep in mind that the movement of this data happens in a complicated, crowded space.
Huge data sets form an increasingly sprawling landscape—from endpoints like AV cameras to the cloud. Most data amasses at two locations—the multicloud and the edge. Far-flung and close-by alike, data is experiencing unprecedented growth. This year alone, enterprise data is growing at the average annual rate of 42% globally. Only 32% of data available to enterprises is put to use. IDC found that the more data enterprises take advantage of measures like data operations in order to leverage their data, the higher their revenues and customer satisfaction. Massive data means massive opportunity.
To take advantage of this opportunity, data collections must migrate quickly to where data can be securely put to best use, in proximity to applications.
In the case of research vehicles used by car manufacturers to fine-tune the road-readiness of future solutions, data makes or breaks everything. An average research vehicle often records 30 to 50TB of data, but can record up to 150TB. At the end of the day, a fleet of 10 to 20 advanced driver-assistance system (ADAS) research vehicles can gather up around 1.5PB. The data will need to be sent to where it can be processed, often with AL/ML tools, in a public cloud. But how do we get it there?
According to the recent Mass Data on the Go report, bandwidth alone is too constricted and slow to move tons of data. That 1.5PB of data that research vehicles delivered to the garage at the end of the day? It can take up to 150 days to transfer it over an enterprise-class connection.
To banish latency headaches, companies are increasingly turning to a much faster, reliable solution: data shuttles and arrays. Research vehicles save the data on drives in the trunk that later easily detach and travel by cargo air to the cloud where insights are extracted.
The road ahead is clear: how companies will enable the secure movement of their data will determine the quality of the ride.
Jeff Fochtman is a Senior Vice President of Business and Marketing at Seagate Technology.