Lambda function to access Amazon RDS(MySQL) using mysql-connector-python

In this video I'm going to show you how to connect your Lambda function to an AWS RDS MySQL instance.

Prerequisite:
---------------------------
AWS RDS( Demo) -How to Launch Oracle RDS database & connect with Talend for Data Ingestion
AWS Lambda Layers Python | Snowflake-lambda-layer

Lambda Layer Creation Code:
-------------------------------------------------------
sudo apt-get update
sudo apt install python3-virtualenv
virtualenv mysql_test
source mysql_test/bin/activate
python3 --version
sudo apt install python3-pip
python3 -m pip install --upgrade pip
mkdir -p lambda_layers/python/lib/python3.8/site-packages
cd lambda_layers/python/lib/python3.8/site-packages

pip install mysql-connector-python -t .
cd ~/lambda_layers
sudo apt install zip

sudo apt install awscli
aws configure

MySQL Queries are posted in the comment section.

Python Code:
----------------------
import json

def lambda_handler(event, context):
# TODO implement
host='',port=3306,
database='');
for i in extracted_data:
print(i)

return {
'statusCode': 200,
}

Check this playlist for more AWS Projects in Big Data domain:

[KnowledgeAmplifier]

SQL Queries:

CREATE SCHEMA sattu_schema;
CREATE TABLE sattu_schema.Persons (
PersonID int,
FullName varchar(255),
City varchar(255),
PRIMARY KEY (PersonID)
);
INSERT INTO sattu_schema.Persons VALUES (0, 'Herman Zimmerman', 'Oklahoma City');
INSERT INTO sattu_schema.Persons VALUES (1, 'Lisa Ray', 'Columbus');
INSERT INTO sattu_schema.Persons VALUES (2, 'Terrell Reeves', 'Jacksonville');
INSERT INTO sattu_schema.Persons VALUES (3, 'Steve Goodwin', 'Charlotte');
INSERT INTO sattu_schema.Persons VALUES (4, 'Leah Tran', 'Detroit');
INSERT INTO sattu_schema.Persons VALUES (5, 'Wilbert Holmes', 'Washington');
INSERT INTO sattu_schema.Persons VALUES (6, 'Mindy George', 'Los Angeles');
INSERT INTO sattu_schema.Persons VALUES (7, 'Rosa Huff', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (8, 'Clayton Jennings', 'Denver');
INSERT INTO sattu_schema.Persons VALUES (9, 'Darla Hayes', 'Charlotte');
INSERT INTO sattu_schema.Persons VALUES (10, 'Jack Hicks', 'Houston');
INSERT INTO sattu_schema.Persons VALUES (11, 'Francis Davidson', 'Austin');
INSERT INTO sattu_schema.Persons VALUES (12, 'Jerome Padilla', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (13, 'Mamie Duncan', 'Houston');
INSERT INTO sattu_schema.Persons VALUES (14, 'Julia Cain', 'San Jose');
INSERT INTO sattu_schema.Persons VALUES (15, 'Leslie Klein', 'Seattle');
INSERT INTO sattu_schema.Persons VALUES (16, 'Isaac Bridges', 'Philadelphia');
INSERT INTO sattu_schema.Persons VALUES (17, 'Martin Adkins', 'Chicago');
INSERT INTO sattu_schema.Persons VALUES (18, 'Vincent Perry', 'Detroit');
INSERT INTO sattu_schema.Persons VALUES (19, 'William Porter', 'Fort Worth');
INSERT INTO sattu_schema.Persons VALUES (20, 'Domingo Byrd', 'Charlotte');
INSERT INTO sattu_schema.Persons VALUES (21, 'Leslie Torres', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (22, 'Wanda Morrison', 'El Paso');
INSERT INTO sattu_schema.Persons VALUES (23, 'Gwen Caldwell', 'Indianapolis');
INSERT INTO sattu_schema.Persons VALUES (24, 'Tammy Daniels', 'Indianapolis');
INSERT INTO sattu_schema.Persons VALUES (25, 'Claude Gilbert', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (26, 'Monique Bowers', 'Seattle');
INSERT INTO sattu_schema.Persons VALUES (27, 'Virginia Phillips', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (28, 'Norman Graham', 'Columbus');
INSERT INTO sattu_schema.Persons VALUES (29, 'Gerard Fleming', 'San Jose');
INSERT INTO sattu_schema.Persons VALUES (30, 'Miranda Conner', 'Washington');
INSERT INTO sattu_schema.Persons VALUES (31, 'Alicia Mcdaniel', 'Indianapolis');
INSERT INTO sattu_schema.Persons VALUES (32, 'Miriam Erickson', 'Dallas');
INSERT INTO sattu_schema.Persons VALUES (33, 'Tyrone Hughes', 'Houston');
INSERT INTO sattu_schema.Persons VALUES (34, 'Peter Terry', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (35, 'Julie Boone', 'Jacksonville');
INSERT INTO sattu_schema.Persons VALUES (36, 'Josephine Sherman', 'Boston');
INSERT INTO sattu_schema.Persons VALUES (37, 'Bridget Stevenson', 'Dallas');
INSERT INTO sattu_schema.Persons VALUES (38, 'Dave Thomas', 'San Antonio');
INSERT INTO sattu_schema.Persons VALUES (39, 'Francisco Holland', 'Indianapolis');
INSERT INTO sattu_schema.Persons VALUES (40, 'Garrett Hogan', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (41, 'Verna Abbott', 'El Paso');
INSERT INTO sattu_schema.Persons VALUES (42, 'Mona Rios', 'Portland');
INSERT INTO sattu_schema.Persons VALUES (43, 'Tara Glover', 'Dallas');
INSERT INTO sattu_schema.Persons VALUES (44, 'Levi Arnold', 'Denver');
INSERT INTO sattu_schema.Persons VALUES (45, 'Jasmine Gutierrez', 'San Jose');
INSERT INTO sattu_schema.Persons VALUES (46, 'Abraham Ortega', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (47, 'Heidi Ellis', 'Columbus');
INSERT INTO sattu_schema.Persons VALUES (48, 'Nathaniel Morales', 'Washington');
INSERT INTO sattu_schema.Persons VALUES (49, 'Stephen Harvey', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (50, 'Kimberly Jordan', 'El Paso');
INSERT INTO sattu_schema.Persons VALUES (51, 'Jessie Carson', 'Nashville-Davidson');
INSERT INTO sattu_schema.Persons VALUES (52, 'Juan West', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (53, 'Ernestine Cummings', 'Columbus');
INSERT INTO sattu_schema.Persons VALUES (54, 'Oscar Wolfe', 'San Antonio');
INSERT INTO sattu_schema.Persons VALUES (55, 'Evan Smith', 'San Antonio');
INSERT INTO sattu_schema.Persons VALUES (56, 'Regina Garrett', 'Seattle');
INSERT INTO sattu_schema.Persons VALUES (57, 'Daisy Dixon', 'Detroit');
INSERT INTO sattu_schema.Persons VALUES (58, 'Warren Cross', 'Jacksonville');
INSERT INTO sattu_schema.Persons VALUES (59, 'Inez Mcgee', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (60, 'Ellis Pena', 'Philadelphia');
INSERT INTO sattu_schema.Persons VALUES (61, 'Lois Parker', 'Fort Worth');
INSERT INTO sattu_schema.Persons VALUES (62, 'Charlene King', 'Portland');
INSERT INTO sattu_schema.Persons VALUES (63, 'Olga Luna', 'Oklahoma City');
INSERT INTO sattu_schema.Persons VALUES (64, 'Maria Jenkins', 'Nashville-Davidson');
INSERT INTO sattu_schema.Persons VALUES (65, 'Phyllis Scott', 'Washington');
INSERT INTO sattu_schema.Persons VALUES (66, 'Sean Palmer', 'Detroit');
INSERT INTO sattu_schema.Persons VALUES (67, 'Carroll Weber', 'Oklahoma City');
INSERT INTO sattu_schema.Persons VALUES (68, 'Dorothy Hudson', 'Nashville-Davidson');
INSERT INTO sattu_schema.Persons VALUES (69, 'Maurice Chandler', 'Boston');
INSERT INTO sattu_schema.Persons VALUES (70, 'Lloyd Cruz', 'Seattle');
INSERT INTO sattu_schema.Persons VALUES (71, 'Christian Stanley', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (72, 'Emma Carter', 'San Diego');
INSERT INTO sattu_schema.Persons VALUES (73, 'Oliver Figueroa', 'Austin');
INSERT INTO sattu_schema.Persons VALUES (74, 'Bessie Kelly', 'Philadelphia');
INSERT INTO sattu_schema.Persons VALUES (75, 'Malcolm Nelson', 'Boston');
INSERT INTO sattu_schema.Persons VALUES (76, 'Rick Gibson', 'Houston');
INSERT INTO sattu_schema.Persons VALUES (77, 'Geraldine Mendez', 'Jacksonville');
INSERT INTO sattu_schema.Persons VALUES (78, 'Sharon Weaver', 'Denver');
INSERT INTO sattu_schema.Persons VALUES (79, 'Jerry Cox', 'Indianapolis');
INSERT INTO sattu_schema.Persons VALUES (80, 'Ray Bowman', 'Philadelphia');
INSERT INTO sattu_schema.Persons VALUES (81, 'Samantha Myers', 'Austin');
INSERT INTO sattu_schema.Persons VALUES (82, 'Jesus Pierce', 'Oklahoma City');
INSERT INTO sattu_schema.Persons VALUES (83, 'Pearl Jacobs', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (84, 'Clara Barnett', 'Los Angeles');
INSERT INTO sattu_schema.Persons VALUES (85, 'Ronald Shaw', 'Columbus');
INSERT INTO sattu_schema.Persons VALUES (86, 'Christine Quinn', 'Jacksonville');
INSERT INTO sattu_schema.Persons VALUES (87, 'Alton Elliott', 'Philadelphia');
INSERT INTO sattu_schema.Persons VALUES (88, 'Krystal Moreno', 'San Jose');
INSERT INTO sattu_schema.Persons VALUES (89, 'Rhonda Owens', 'Seattle');
INSERT INTO sattu_schema.Persons VALUES (90, 'Katie Robbins', 'Phoenix');
INSERT INTO sattu_schema.Persons VALUES (91, 'Jeremy Chapman', 'Portland');
INSERT INTO sattu_schema.Persons VALUES (92, 'Douglas Young', 'New York');
INSERT INTO sattu_schema.Persons VALUES (93, 'Kate Mcbride', 'Chicago');
INSERT INTO sattu_schema.Persons VALUES (94, 'Jackie Mckenzie', 'Washington');
INSERT INTO sattu_schema.Persons VALUES (95, 'Debbie Keller', 'Jacksonville');
INSERT INTO sattu_schema.Persons VALUES (96, 'Pam Casey', 'Las Vegas');
INSERT INTO sattu_schema.Persons VALUES (97, 'Emily Coleman', 'Portland');
INSERT INTO sattu_schema.Persons VALUES (98, 'Terence Ross', 'Detroit');
INSERT INTO sattu_schema.Persons VALUES (99, 'Lorene Peterson', 'San Francisco');
INSERT INTO sattu_schema.Persons VALUES (100, 'Muhammad Ahnmad', 'New York');

Select * from sattu_schema.Persons where City like "Denver";

[RaulNussbaum]

Great tutorial, my friend. you have a new subscriber! Thank you.

[DE_Kaushal-bqnu]

You missed to mention IAM role related settings.

[Life-Of-Sidd]

the inbound rules at 2.33, it shows only one rule for me (All traffic) without any IPv6 or IPv4. What should I do?

[vnbchronicles]

Bro, I tried the same way. but still it is showing an error like no module found. python installed in ubuntu was 3.10. added the layer also. still it is not working.