🆕 Step functions Distributed map - Run 10k parallel serverless executions!

The new distributed map state allows you to write Step Functions to coordinate large-scale parallel workloads within your serverless applications. You can now iterate over millions of objects such as logs, images, or .csv files stored in Amazon S3. The new distributed map state can launch up to ten thousand parallel workflows to process data.

In this video I show it to you!

#foobar #serverless

☆☆ FOLLOW ME ONLINE ☆☆

📷 Instagram: foobar_codes

☆☆ ABOUT FOOBAR ☆☆
In this channel, you can find mostly coding tutorials related to cloud and serverless.
In addition, I like also talking about architecture, software design, motivation, and leadership.
There is a new video every Tuesday, so stay tuned :)

[parrou]

Hi, how to implement and enable distance-aware searches in aws ? how to find the nearest location around a position ?

[aelxxs]

Is there a way to get real time map run status? Need to show it client side but if I spam describe map run it throttles

[Mrsalonangel]

+1 for Step Functions in CDK with distributed map

[andresdigi]

Amazing as always. Content could be data pipelines working with apis and background workers?

[kiyan]

thanks for video, do you know if you can set the concurrency limit dynamically?

[rohinich]

is it the same way for passing paraquet file from s3 to step function. I would like to use distributed map state which distributes the contents of the parquet file successfully to its child states. can you provide sources or example

[manadaladhamathuwithpavith]

Thanks a lot Dear. It resolved my issue.

[sachinbhalerao]

@hello
FooBar Serverless can you make video on when file uploded in s3 get trigger lambda and this processing that file this lambda invoke step machine and inside stepfucntion have parellel state to run parellel i want get 10 lambda to perofrome operation like one lambda take that file perform only 10 record and dump that file in s3 output folder same this all lambda do can you make this workflow plaese

[alejandrombc]

Which is better, to use a map parallel execution or to use something like sns/sqs?

[torresetm]

Thanks For the videos. I want to know how excecute many lambada ando put the answer together.

Gracias de nuevo

[PrmalZer]

Do you post the code you show on github or somewhere else? That would be awesome to look at more closely.

[kvs]

I need improve my skill I need gain real-time project knowledge can you help me
Your videos are good
Reausting Do project awscicd Jenkins eks and eks deployed ment

[maymontalvan]

Please don't forget the spanish speakers!!! All the documentation is already in english.