Snapdragon On Device Realtime Translation Demo using Snapdragon 8 Gen 2 #qualcomm #snapdragon8gen2

Snapdragon On Device Realtime Translation Demo using Snapdragon 8 Gen 2 #qualcomm #snapdragon8gen2

At Snapdragon Summit 2022, Qualcomm announced the Snapdragon 8 Gen 2. AI developments and innovations on this product are many, but here’s a fun demonstration of Real-Time Translation, given by Ziad Asghar, Vice President, Product Management, Snapdragon Technologies & Roadmap.

This demo, with 3 language models based on transformer networks, shows real-time translation running solely on-device. In this case, the Hexagon processor is at work on multi language translation, translating English into Chinese and Spanish at the same time. Given the large Snapdragon mobile ecosystem, Qualcomm have seen an increasing number of applications that are adopting transformer networks. In the design for Snapdragon 8 Gen 2, Qualcomm have put an added emphasis on state-of-the-art Transformer models on Snapdragon 8 Gen 2.

With Micro Tile Inferencing, Qualcomm can reduce the number of reshaping operators in the neural networks to lower the computation overhead and enable state of the art quantization that help guide with picking the right data formats by layer while not compromising on accuracy.