GPU inference

GPUs offer more efficient parallelized ASR inference than CPUs. This additional processing efficiency allows accuracy, throughput and speed improvements. This section explains how to utilise our GPU based inference server containers in conjunction with our standard CPU based transcriber containers.

• GPU inference container
• GPU inference performance
• GPU reference implementation
• Linking to a GPU inference container