Connecting Snowflake with Python Shell Jobs in AWS Glue

Whl file:
--------------

(Alternatively you can get the file from here also --

Prerequisite:
----------------------
How to Use AWS Glue with Snowflake | PySpark-Snowflake Connectivity

Code:
-----------
import sys

user="Satadru",
password="",
warehouse="COMPUTE_WH",
database="RAMU",
schema="PUBLIC",
ROLE="ACCOUNTADMIN"
)

sql_query_table_creation = "CREATE OR REPLACE TABLE RAMU.PUBLIC.test_table123 (col1 integer, col2 string)"
sql_query_data_ingestion="INSERT INTO test_table123(col1, col2) VALUES (123, 'test string1'), (456, 'test string2')"

Check this playlist for more Data Engineering related videos:

[shibup]

thank you so much. very helpful! Highly recommend this video 👍

[laterlname]

Thank you so much for your quick response to my question. This is EXACTLY what I was looking for. Great explanation ad usual 👍🏼

[chamarthisridhar]

Great work you have done and it is very useful. Thank you very much

[ravikreddy]

Was looking for this demo, tysm for this... so if I understood correctly specifying dependencies in spark through external jars and in python through whl files, right? cannot we package our code like we did with lambda and give the path here instead of whl?

also, how to check the libraries that come with glue console by default?

[faisalp]

This is really helpfull. Thank you for your work.

[muniraja]

HI Mukarjee - I am getting below error ERROR: snowflake-connector-python 2.3.8 has requirement certifi<2021.0.0, but you'll have certifi 2022.9.24 which is incompatible. Can you please help me with the correct wheel file

[AYR]

Hello thank you very much or this, could please do the same for oracle dababase with JDBC or cx_Oracle? thank very much

[megharajgs]

Hi Thank you for the video, it worked but when i am trying copy into snowflake table command in code, it's not happening, it's showing botocore is not compatible can you please suggest me why this is coming