AWS Step Functions to orchestrate Lambda functions - Step by Step Example

If you know how to set up a single AWS Lambda function, you should learn how to orchestrate these Lambda functions into one logical workflow which works as a serverless solution in the cloud. For this purpose we will use the AWS Step functions. The main idea is to connect multiple Lambda functions so that they work as one unit once the first function will be triggered by input of some value.

In this example, I demonstrate how to connect three Lambda functions which expect to get some input and provide some output separately, and then set up input/output transferring between these functions. This is how three independent Lambda functions are connected with data bridges between them. This is easily illustrated with a graph in an AWS Step service page, and allows you to build your Step functions pipelines just by drag and drop elements directly into the interactive chart. You will see it in this video tutorial.

All AWS Lambda functions were written in Python 3.8 in this tutorial. Good to know that AWS Step functions supports not only AWS Lambda functions for orchestration, but other services also, such as AWS Blazing Text, AWS ECS, AWS DynamoDB and much more. Feel free to experiment with these with a very low cost.

Check the links below to read more official information about AWS Step Function:

The content of the video:
0:00 - Intro
4:03 - Hands-on AWS Step Functions
13:45 - Debug and Edit AWS Step Functions

During this session, I wrongly selected the initial payload to the first Lambda function in the workflow, so you can benefit from that to see how to debug AWS Pipelines, and run your Step Functions workflow with dynamic input. You can freely experiment with your custom function, and play with different input scenarios. As a result, you will get a JSON format result file which describes your final workflow output.

AWS Step function is very important to test systems, workflows and basically, it is a big player in the domain of MLOps (Machine Learning Operations).

I am sure this tutorial will be not for AWS beginners only, but for advanced users also. Personally for me, this would really help in the AWS Machine Learning Specialty certification exam.

Enjoy!

#stepfunction #aws #lambdafunction

[DataScienceGarage]

Thank you for watching this tutorial, hoping it is useful! While the next part is preparing, here is the link to the part 1 where I introduced to AWS Lambda functions with a very simple example, link is here:

[xphn]

Thank you so much! This is the most enlightening tutorial I have watched on this topic so far.

[alperari]

The way you explained with a practical example helped me a lot. Thank you for your work.

[TheCaptainknave]

This is really a great tutorial, can you please make a video with iterator? Same lambda function that runs sequentially with different input.

[shibadhamija]

Truly Appreciate your work, can u pls make video describing more about stepfunction dependent services.Thank you :)

[gezas]

Is akcento supratau, kad lietuvis, gerai varai seni!