GitHub / qwshen 2 Repositories
qwshen/spark-etl-framework
A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml
Language: Scala - Size: 890 KB - Last synced at: 6 months ago - Pushed at: 7 months ago - Stars: 11 - Forks: 9
qwshen/spark-flight-connector
A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
Language: Java - Size: 163 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 19 - Forks: 3