The impact of storage on semantic segmentation

  • Technical White Paper
  • PDF 2024 KB

Overview

Learn about the impact HPC storage has on semantic segmentation in helping autonomous vehicles recognise the objects in their environments and how semantic segmentation can be used to create training datasets for them. The benchmark results in this paper show how the WekaFS flash-optimised high performance parallel file system can reduce time to results by over 100 hours in ...

Learn about the impact HPC storage has on semantic segmentation in helping autonomous vehicles recognise the objects in their environments and how semantic segmentation can be used to create training datasets for them. The benchmark results in this paper show how the WekaFS flash-optimised high performance parallel file system can reduce time to results by over 100 hours in a day for a data annotation workload compared to an NFS file system. These results show how HPE creates effective AI solutions working with its partners, NVIDIA, Mellanox and WekaIO.

This document draws on decades of HPE experience to provide tuning guidelines for deep learning frameworks based on NVIDIA GPU Cloud (NGC) containers with either Docker or Singularity runtime environments on HPE Apollo 6500 Gen10 Systems.

Introduction .......................................................................................................................................................................................................................... 3

Intended audience ......................................................................................................................................................................................................... 3

About CNNs and semantic segmentation .............................................................................................................................................. 3

The role of semantic segmentation .............................................................................................................................................................. 3

Image annotation .............................................................................................................................................................................................................4

Using CNNs for annotation ....................................................................................................................................................................................4

About WekaFS ................................................................................................................................................................................................................... 5

Goals of performance testing – test architecture ............................................................................................................................. 5

Test infrastructure: HPE Apollo 6500 and NVIDIA Tesla V100 GPUs ........................................................................ 5

Compute: HPE Apollo 6500 Gen10 System .......................................................................................................................................... 5

GPU: NVIDIA Tesla V100 GPU ........................................................................................................................................................................... 6

Networking: Mellanox 100 Gb EDR InfiniBand ................................................................................................................................... 6

Cityscapes Dataset on WekaFS ............................................................................................................................................................................9

Scalability and throughput ..................................................................................................................................................................................... 9

Benchmark results .........................................................................................................................................................................................................10

Conclusion: The importance of data storage for autonomous vehicles .....................................................................11

Resources ..............................................................................................................................................................................................................................12