From Spark to Ray: An Exabyte-Scale Production Migration Case Study

This case study revisits the key milestones that allowed Amazon to successfully transition core exabyte-scale data catalog management jobs from Spark to Ray. We'll review the challenges encountered, concessions made, and future vision to more deeply incorporate Ray into critical batch and streaming business intelligence pipelines at Amazon. Topics covered include techniques for developing large-scale serverless Ray job management infrastructure, build and deploy management, risk mitigation strategies leveraged to ease the migration to Ray, and operational excellence methods employed to ensure a smooth rollout to production.

Find the slide deck here:

About Anyscale
---
Anyscale is the AI Application Platform for developing, running, and scaling AI.

If you're interested in a managed Ray service, check out:

About Ray
---
Ray is the most popular open source framework for scaling and productionizing AI workloads. From Generative AI and LLMs to computer vision, Ray powers the world’s most ambitious AI workloads.

#llm#machinelearning#ray#deeplearning#distributedsystems#python#genai