How to Import External Libraries for AWS Lambda + CDK Projects (Python)

In this video, I walk you through the steps to use external packages in your Lambda + CDK based project. You can use this approach to bring in any python library including popular ones like Pandas, TensorFlow, Selenium, Apache Spark, and more.

📚 My Courses 📚

🎉SUPPORT BE A BETTER DEV🎉

📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚

🎙 MY RECORDING EQUIPMENT 🎙

💻 MY DESKTOP EQUIPMENT 💻

🌎 Find me here:

#AWS
#Lambda
#Serverless

[yashmodi]

Please create more videos on projects using CDK with Step functions, lambda and eventbridge.

[MrElectrototo]

I have also seen solutions that create a new lambda layer with the dependencies required. But this is great!

[philipmasie]

Congratulations 🎉 on 100k subscribers and thanks for bringing us the great content!

[TariqASheikh]

Congrats on 100K . Amazing content and stuff !!!

[yjwvdud]

Thank you very much for your tutorial!

[Johnathanaa]

I know there was some benefit for using layers in regard to cold starts, would doing something like this have an impact on performace?

[TruptiRajankar]

Hi I tried this in my system getting this while cdk synth error : raise RuntimeError(resp.error) from JavaScriptError(resp.stack)
RuntimeError: spawnSync docker ENOENT Could you please help here

[leebarrett]

Great video and very helpful. What does the template file look like for running this? Can you run this locally using sam local invoke? I've been trying this out and can't seem to get it to work. Thanks.

[rolucic]

this is really helpfull. Thank you.
Congratulations on reaching 100k subscribers, indeed!

[ShokatAliYT]

so only having requirements.txt in lambda folder is what we need? I don't see any additional step you did to install these extra dependencies for lambda?

[SuperSam]

Great video. I have attempted to give this a try. However it is looking for docker in my build? Also I see in the pypi site when looking up 'aws_lambda_python_alpha' that docker needs to be installed. Is this a change since you did the video? How would this be done? Again thanks for the great videos.

[shaneatvt]

As usual, extremely valuable content that opened up a lot of options. I'm pretty sure you are one of the few sources explaining how to bring external packages in and work with them in a Lambda and CDK in python. The events sam -e option is great too. Thanks so much.
I'm wondering if there is a way to have vscode see the packages in your lambda folder requirements.txt (request and bs4 in your example) without having to install them system wide. The CDK local option is great, but I ask for a friend who is overly reliant on vscode debug mode with stop points etc. Appologies if I'm missing it.

[andresmontoya]

I have a little question not related at all to this video, what would you prefer to create only-serverless applications? Frameworks like Serverless Framework or AWS SAM, or you'd prefer something like AWS CDK? I think If you want to make an app like this, with serverless framework or sam, would that be enough right?

[ridhwwww]

Hi, great video. Does this mean that we can get around the 250MB hard limit for lambda layers?