GitHub / yosh0555 / airflow_with_mysql_and_snowflake

This is a small project where I used Airflow DAG program to create table in MySQL database and insert values into it. I also created a pipeline using spark to fetch data from MySQL database and process it and store the processed data into Snowflake data warehouse, I used Apache Airflow to automate this process

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yosh0555%2Fairflow_with_mysql_and_snowflake

Topics: airflow, airflow-dags, apache, linux, mysql, mysql-database, shell-script, snowflake, snowflakedb, spark, spark-streaming

Files

No dependencies found