AWS re:Invent 2023 - Scale interactive data analysis with Step Functions Distributed Map (API310)

Scaling data processing workloads is a significant challenge for many organizations. However, it can be simplified with AWS Step Functions Distributed Map state. During this session, learn how to build a data processing or other automation once and readily scale it to thousands of parallel processes with serverless technologies. Explore how this approach simplifies development and error handling while improving speed and lowering cost. Hear from an AWS customer that refactored an existing machine learning application to use Distributed Map and the lessons they learned along the way.

Subscribe:

ABOUT AWS
Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.

AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

#AWSreInvent #AWSreInvent2023

[gradientO]

Distributed Mapping is like SQS with batching and max concurrency in Lambdas, but without writing another Lambda to seed the queue