GitHub topics: datax
alldatacenter/alldata
🔥🔥 AllData可定义数据中台,以数据平台为底座,以数据中台为桥梁,以机器学习平台为工厂,以大模型应用为上游产品,提供全链路数字化解决方案。产品正式演示体验、社群咨询、商务采购:https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo
Language: Java - Size: 1.55 GB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 2,835 - Forks: 922

Lindamuri/bifrost
Web服务器配置文件(Nginx config等)解析工具,提供配置文件展示和修改接口 bifrost, nginx, nginx-conf, nginx-conf-parser, nginx-config, nginx-configuration
Language: Go - Size: 305 KB - Last synced at: 4 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

datavane/tis
Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI
Language: Java - Size: 30.5 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 1,178 - Forks: 254

hexnn/Stark
基于Spark+SparkMLlib+Debezium+Deequ打造的简单易用、超高性能大数据治理引擎。适用于批流一体的数据集成和数据分析,支持CDC实时数据采集、机器学习算法模型、数据质量校验、数据标注、敏感数据识别、数据建模、算法建模和OLAP数据分析
Language: Scala - Size: 7.29 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 36 - Forks: 1

brokercap/Bifrost
Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件
Language: Go - Size: 4.2 MB - Last synced at: 24 days ago - Pushed at: 27 days ago - Stars: 2,043 - Forks: 341

codingmiao/datax-simple
一个datax的简化工具,帮助您轻量级的完成datax的二次开发和同步任务
Language: Java - Size: 282 KB - Last synced at: 3 days ago - Pushed at: almost 3 years ago - Stars: 21 - Forks: 8

CMant/DataR
极限性能,资源占用,功耗均碾压阿里的DataX,且支持动态调整迁移速度。DataX的诞生,是为了上班,DataR的诞生,是为了干死DataX
Language: C - Size: 50.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

dyrnq/docker-canal
docker-canal
Language: Shell - Size: 139 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

xiongshengxiao/CloudEon
CloudEon 使用 Kubernetes 安装和部署开源大数据组件,使开源大数据平台的容器化运行成为可能。这允许您减少对底层资源管理和维护的关注。
Language: FreeMarker - Size: 80.4 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 1

TianLangStudio/DataXServer
为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用(ThriftServer,HttpServer) 分布式运行(DataX on YARN) 功能
Language: Scala - Size: 1.1 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 144 - Forks: 72

birdLark/LarkMidTable
LarkMidTable 是一站式开源的数据中台,实现中台的 基础建设,数据治理,数据开发,监控告警,数据服务,数据的可视化,实现高效赋能数据前台并提供数据服务的产品。
Language: Java - Size: 81.7 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 1,930 - Forks: 593

JheyBerry/cinepick
Web App for Movie Recommendations
Language: TypeScript - Size: 71.3 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

WeBankFinTech/Exchangis
Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources
Language: Java - Size: 41.3 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 447 - Forks: 207

xinchengzezhi/springboot-datax
datax的spring-web客户端版本
Language: Java - Size: 1.48 MB - Last synced at: 4 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

duhanmin/datax-on-yarn
实现yarn客户端,datax-on-yarn可以让datax在yarn master上运行
Language: Java - Size: 13.4 MB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 17 - Forks: 12

makemyownlife/shardingsphere-jdbc-demo
shardingsphere jdbc 分库分表的实战例子 ,体系化实现 分片 + 扩缩容 , 涉及到 shardingsphere、canal、datax、id生成器等知识点。您的 ⭐️ ⭐️⭐️Star⭐️⭐️ ⭐️,是我的动力!如果您觉得还不错,请点上一颗小星星
Language: Java - Size: 763 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 147 - Forks: 66

yasyx/datax-job-runner
Generate and run jobs of alibaba DataX3.0
Language: Shell - Size: 41 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

metaphysical-road/spring-cloud-alibaba-practice
Spring Cloud Alibaba微服务架构实战派,微服务架构最强实战案例分析
Language: Java - Size: 3.35 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 33 - Forks: 13

Mrkuhuo/bigdata_learning
大数据组件学习代码
Language: Java - Size: 36.7 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 22 - Forks: 7

VincentSleepless/datax_rediswriter
dataX redis writer plugin
Language: Java - Size: 5.5 MB - Last synced at: over 1 year ago - Pushed at: about 8 years ago - Stars: 12 - Forks: 12

duhanmin/bigdata-sql-parser Fork of 0xqq/bigdata-sql-parser
数据血缘,支持spark sql,hive sql,pg sql,presto sql,mysql sql,tidb sql, flink sql, datax血缘,spark/flink jar 运行命令的血缘解析;支持with语法
Language: Java - Size: 1.95 MB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 3

Arvin-Mark/datax-bin
DataX 是异构数据广泛使用的离线数据同步工具/平台,实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。
Language: Python - Size: 207 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 9

Arvin-Mark/DataX-src
DataX 是异构数据广泛使用的离线数据同步工具/平台,实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。
Language: Java - Size: 7.22 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 23 - Forks: 22

Kestrong/datax-elasticsearch
datax数据同步elasticsearch的reader和writer插件,支持一对多的扁平数据转换成es的嵌套对象,也支持嵌套对象的读取和ognl表达式过滤,理论上可以无限嵌套。
Language: Java - Size: 70.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 77 - Forks: 39

fx67ll/fx67llBigData
Everything About BigData
Language: Java - Size: 1.76 MB - Last synced at: 5 months ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 1

duanshuaimin/datax-web Fork of zipingdong/datax-web
datax web
Language: Java - Size: 466 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

jancajthaml-devops/cassandra-docker
Language: Shell - Size: 33.2 KB - Last synced at: about 2 years ago - Pushed at: over 8 years ago - Stars: 0 - Forks: 0

peiliping/meepo 📦
异构存储数据迁移
Language: Java - Size: 986 KB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 30 - Forks: 22

thestyleofme/datax-admin
DataX分布式集群与负载均衡、任务执行/统计,基于DataX的通用数据同步微服务,一个Restful接口搞定所有通用数据同步
Language: Java - Size: 320 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 26 - Forks: 12

wzqwtt/BigData
小白大数据学习笔记 :star:
Language: Java - Size: 128 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 16 - Forks: 2

thestyleofme/DataX Fork of alibaba/DataX
DataX分布式集群化、自定义DataX插件、源码修改任务监控以及脏数据存表Hook
Language: Java - Size: 13.4 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 21 - Forks: 11

crabo/datax-incremental-load
Improve datax 3.0 for "continurous" running in a incremental mode
Language: Java - Size: 39.1 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

AZHELLRGX/Big_Data_Study_Notes
大数据学习笔记(:zap:不断完善中:zap:)
Language: Java - Size: 20.3 MB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 1

TwoThreeWang/DataX_Python3
DataX 修改为 Python3
Language: Python - Size: 12.7 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 12 - Forks: 8

thestyleofme/common-datax
基于DataX的通用数据同步微服务,一个Restful接口搞定所有通用数据同步
Language: Java - Size: 217 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 51 - Forks: 18

uptonking/datapoppin
data etl tool based on datax. forked from alibaba/DataX.
Language: Java - Size: 11.1 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

xuanbo/DataX Fork of alibaba/DataX
DataX自定义插件
Language: Java - Size: 11.3 MB - Last synced at: over 2 years ago - Pushed at: about 6 years ago - Stars: 2 - Forks: 1

HanseyLee/DataX Fork of alibaba/DataX
Add mongodbreader mongodbwriter ssl supports to alibaba Datax
Language: Java - Size: 11.5 MB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

ah-hui/project-dev
spring-boot
Language: Java - Size: 1.66 MB - Last synced at: over 2 years ago - Pushed at: almost 7 years ago - Stars: 1 - Forks: 0
