Sree Ganesan, AI Software Product Management at Habana Labs
Maxime Bergeron, Director of Research & Development at Riskfuel
Habana® Gaudi® is the industry’s first AI training processor to natively integrate ten 100-Gigabit Ethernet RoCE ports on-chip, enabling flexibility of scaling up and scaling out using industry standard interfaces. Gaudi’s compute efficiency and integration brings new levels of price-performance to both Cloud and data-center customers. Riskfuel, a fintech startup, is pioneering the use of deep neural networks to learn the complex pricing functions used to value over-the-counter derivatives.
At re:Invent 2020, AWS announced that “the new AWS Gaudi-based EC2 instances will leverage up to 8 Gaudi accelerators and deliver up to 40% better price/performance than current GPU-based EC2 instances for training DL models.” The significant cost-performance advantage makes Habana Gaudi a compelling addition to RiskFuel’s AI compute infrastructure. Habana’s SynapseAI software stack is integrated with TensorFlow and PyTorch frameworks, and it takes a few lines of code to get started with Gaudi. In this talk, we will share our learnings in migrating deep learning models to Habana Gaudi to reap the cost-performance benefits.