aliyun/aliyun-maxcompute-data-collectors

Language: Java - Size: 93.5 MB - Last synced: about 1 hour ago - Pushed: about 2 hours ago - Stars: 114 - Forks: 61

apache/logging-flume

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

Language: Java - Size: 43 MB - Last synced: about 11 hours ago - Pushed: 3 days ago - Stars: 2,503 - Forks: 1,568

apache/logging-flume-hadoop

Apache Flume Hadoop provides various Flume components for the Hadoop ecosystem

Language: Java - Size: 6.52 MB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 0 - Forks: 1

OBenner/data-engineering-interview-questions

More than 2000+ Data engineer interview questions.

Size: 977 KB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 807 - Forks: 290

zicat/tributary

tributary

Language: Java - Size: 2.15 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 5 - Forks: 1

chrisjpatty/flume

Extract logic from your apps with a user-friendly node editor powered by React.

Language: TypeScript - Size: 8.03 MB - Last synced: 6 days ago - Pushed: 7 months ago - Stars: 1,345 - Forks: 141

apache/logging-flume-legacy

Apache Flume Legacy provides the legacy Avro and Thrift Source for Apache Flume

Language: Java - Size: 37.1 KB - Last synced: 6 days ago - Pushed: 16 days ago - Stars: 0 - Forks: 0

apache/logging-flume-spring-boot

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

Language: Java - Size: 37.1 KB - Last synced: 6 days ago - Pushed: 17 days ago - Stars: 4 - Forks: 4

apache/logging-flume-kafka

Apache Flume Kafka contains the Flume components that interact with Kafka.

Language: Java - Size: 90.8 KB - Last synced: 6 days ago - Pushed: 18 days ago - Stars: 1 - Forks: 4

whiteCcinn/stream-ng

Distributed stream computing service

Size: 1000 Bytes - Last synced: 22 days ago - Pushed: almost 5 years ago - Stars: 1 - Forks: 0

97arushisharma/MyNews-Summarization-DesktopApp

Deloitte TechnoUtsav Project

Language: Python - Size: 20.3 MB - Last synced: 23 days ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0

edwinvdpol/com.flume

Flume for Homey

Language: JavaScript - Size: 1.25 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 0 - Forks: 1

yingzhuo/logback-flume-appender

logback appender for apache-flume

Language: Java - Size: 37.1 KB - Last synced: about 1 month ago - Pushed: over 3 years ago - Stars: 2 - Forks: 0

cosmo0920/flume-ng-fluentd-sink

Flume NG Sink plugin for Fluentd.

Language: Java - Size: 89.8 KB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 2 - Forks: 2

vspiewak/flume-extensions

Flume extentions

Language: Java - Size: 141 KB - Last synced: about 1 month ago - Pushed: almost 10 years ago - Stars: 0 - Forks: 0

pkeropen/BigData-News

基于Spark2.2新闻网大数据实时系统项目

Language: Scala - Size: 187 KB - Last synced: about 1 month ago - Pushed: about 5 years ago - Stars: 55 - Forks: 21

leonlee/flume-ng-mongodb-sink

Flume NG MongoDB source.

Language: Java - Size: 9.79 MB - Last synced: about 1 month ago - Pushed: about 1 year ago - Stars: 71 - Forks: 62

MehdiTAZI/BigData-Platform

End to end big data project, that aims to show how to implement different big data layers, from the infrastructure layer to the end user one. [HADOOP][Spark][Kafka][Cassandra][Ansible][Jupyter][Docker]

Language: Jupyter Notebook - Size: 85 KB - Last synced: about 2 months ago - Pushed: 4 months ago - Stars: 6 - Forks: 6

juju-solutions/bundle-realtime-syslog-analytics 📦

Bundle for analyzing syslog data with Apache Spark and Apache Hadoop

Language: Python - Size: 40 KB - Last synced: 24 days ago - Pushed: almost 6 years ago - Stars: 3 - Forks: 6

adriel1997/Twitter-Sentiment-Analysis

Twitter based sentiment analysis using JAVA and Hadoop. In this project we are doing the sentiment analysis on twitter data to analyse whether the tweets posted by people are positive or negative or neutral by checking the tweets with the AFFIN dictionary which has a set of 2500 words along with the value of each word ranging from -5 to +5 denoting whether tweets are positive or negative.

Language: Java - Size: 340 KB - Last synced: 2 months ago - Pushed: about 6 years ago - Stars: 9 - Forks: 2

apache/logging-flume-morphline

Apache Flume Morphline provides the Morphline Solr Sink for Apache Flume

Language: Java - Size: 1.48 MB - Last synced: 6 days ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

apache/logging-flume-jdbc

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of event data

Language: Java - Size: 50.8 KB - Last synced: 6 days ago - Pushed: 6 months ago - Stars: 1 - Forks: 2

apache/logging-flume-twitter

Apache Flume Twitter provides the Twitter Source for Apache Flume

Language: Java - Size: 22.5 KB - Last synced: 6 days ago - Pushed: about 1 year ago - Stars: 0 - Forks: 2

apache/logging-flume-search

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of event data

Language: Java - Size: 48.8 KB - Last synced: 6 days ago - Pushed: 7 months ago - Stars: 0 - Forks: 4

MoRan1607/BigDataGuide

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Language: Java - Size: 124 MB - Last synced: 3 months ago - Pushed: 5 months ago - Stars: 2,431 - Forks: 829

wangzhiwubigdata/God-Of-BigData

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Size: 66.3 MB - Last synced: 3 months ago - Pushed: 9 months ago - Stars: 9,077 - Forks: 3,031

heibaiying/BigData-Notes

大数据入门指南 :star:

Language: Java - Size: 22.9 MB - Last synced: 3 months ago - Pushed: 4 months ago - Stars: 14,989 - Forks: 4,134

233zzh/TitanDataOperationSystem

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

Language: JavaScript - Size: 105 MB - Last synced: 2 months ago - Pushed: over 2 years ago - Stars: 93 - Forks: 44

congxin1992/coastal-profile-extraction

It is avaliable for the labrotary experiment, especially for the flume experiment.

Language: MATLAB - Size: 122 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

soniclavier/bigdata-notebook

Language: Scala - Size: 102 MB - Last synced: 29 days ago - Pushed: over 4 years ago - Stars: 105 - Forks: 86

worst001/note_bigdata

收录了大数据相关各类资料、笔记、手册

Language: Java - Size: 174 MB - Last synced: 8 days ago - Pushed: 5 months ago - Stars: 1 - Forks: 0

v5tech/cloud

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Language: Shell - Size: 31.7 MB - Last synced: 3 months ago - Pushed: about 7 years ago - Stars: 53 - Forks: 43

conch-stack/conch-bigdata

Big Data

Language: HTML - Size: 14.2 MB - Last synced: 5 months ago - Pushed: 11 months ago - Stars: 10 - Forks: 3

peiliping/logwatch

日志采集工具

Language: Lua - Size: 1.92 MB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 21 - Forks: 4

liyifeng/flumeUserGuideCnDoc

Flume用户手册中文翻译版

Language: Python - Size: 399 KB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 11 - Forks: 3

tlhhup/litemall-dw

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Language: Java - Size: 9.98 MB - Last synced: 6 months ago - Pushed: almost 2 years ago - Stars: 82 - Forks: 43

aabouzaid/telegraf-flume-plugin

Telegraf plugin to collect Apache Flume metrics

Language: Go - Size: 10.7 KB - Last synced: 7 months ago - Pushed: almost 6 years ago - Stars: 1 - Forks: 0

sunnyandgood/BigData

💎🔥大数据学习笔记

Language: Java - Size: 316 MB - Last synced: 6 months ago - Pushed: about 5 years ago - Stars: 647 - Forks: 222

shubhamgosain/twitter-Sentiment-Analysis-using-hadoop

A Project where one can fetch and read tweets and show the analysis like who is most influential

Language: Shell - Size: 69.3 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 26 - Forks: 12

xiaoxigua13437/MysqlSink

基于Flume自定义SinkSource

Language: Java - Size: 25.4 KB - Last synced: 7 months ago - Pushed: over 3 years ago - Stars: 3 - Forks: 0

Navnith/OCLC

HDFS Flume Source for Data Ingestion.

Language: Java - Size: 267 KB - Last synced: 7 months ago - Pushed: almost 7 years ago - Stars: 0 - Forks: 2

xiyuan-fengyu/FlumeNettySourceAndSink

Language: Java - Size: 31.3 KB - Last synced: 7 months ago - Pushed: over 6 years ago - Stars: 1 - Forks: 1

eiroca/eFlumePlugin

Language: Java - Size: 331 KB - Last synced: 7 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 1

debadrita1517/Bicycle-Sharing-Demand

Project based on Data Streaming and Model Deployment using pySpark and Flume.

Language: Jupyter Notebook - Size: 498 KB - Last synced: 8 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

wangj1106/recommendMoteur

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

Language: Scala - Size: 10.4 MB - Last synced: 7 months ago - Pushed: almost 6 years ago - Stars: 106 - Forks: 37

cq-cdy/it-words

基于Hadoop与Flume的IT词汇Android平台

Language: Java - Size: 16.5 MB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 4 - Forks: 0

dormstd/dockerflume

Self-contained Docker image containing Java and Apache Flume 1.8 based on probablyfine/flume

Language: Shell - Size: 4.88 KB - Last synced: 8 months ago - Pushed: about 6 years ago - Stars: 1 - Forks: 0

gameflow-tv/flume_mobile

Gameflow's own design system, Flume. Implemented in Dart with a Flutter UI library and adapters for Material.

Language: Dart - Size: 10.9 MB - Last synced: 13 days ago - Pushed: 7 months ago - Stars: 4 - Forks: 1

szaharici/FlumeElasticsearchRestSink

Flume elasticsearch REST sink

Language: Java - Size: 10.8 MB - Last synced: 8 months ago - Pushed: about 6 years ago - Stars: 6 - Forks: 4

szaharici/Flume-InfluxDB-Sink

Flume sink compatible with recent InfluxDB versions

Language: Java - Size: 10.5 MB - Last synced: 8 months ago - Pushed: almost 6 years ago - Stars: 5 - Forks: 3

dsandeep0138/SparkTwitterAnalysis

Real-time data analytics on COVID-19 over a Twitter Stream using Big Data Technologies of Hadoop Ecosystem such as Flume, Kafka and Spark Streaming. Flask is used to display dashboards.

Language: Python - Size: 25.9 MB - Last synced: 8 months ago - Pushed: about 1 year ago - Stars: 3 - Forks: 1

vivek2319/Learn-Hadoop-and-Spark

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

Language: Python - Size: 211 MB - Last synced: 6 months ago - Pushed: almost 6 years ago - Stars: 46 - Forks: 39

wanpg/FlumeSink2DB

利用 Flume Sink 使用一个jar包写入多张表

Language: Java - Size: 55.7 KB - Last synced: 9 months ago - Pushed: over 5 years ago - Stars: 0 - Forks: 1

JSJeong-me/KOSA_BIGDATA_DEEPLEARNING

KOSA Bigdata DeepLearning Analysis

Language: Jupyter Notebook - Size: 49.4 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0

pausanchezv/Bases-de-dades-II-Big-Data

Assignatura Bases de Dades Avançades d'Enginyeria Informàtica (Universitatd de Barcelona)

Language: Java - Size: 106 MB - Last synced: 9 months ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

juanbono/flume-demo

Demostración de Apache Flume, para la asignatura Implementación de Bases de Datos NoSQL

Language: Makefile - Size: 24.7 MB - Last synced: 9 months ago - Pushed: almost 6 years ago - Stars: 1 - Forks: 0

jcustenborder/flume-ng-rabbitmq

Flume plugin for RabbitMQ

Language: Java - Size: 34.2 KB - Last synced: about 1 month ago - Pushed: 5 months ago - Stars: 59 - Forks: 46

HaElMe/BigDataTrainings

Big Data for All Levels

Size: 103 KB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0

ZGG2016/flume

Language: Java - Size: 1010 KB - Last synced: 9 months ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

keedio/Flume-ng-source-VFS 📦

Flume-ng-source-VFS is a custom Apache Flume source component for processing files under supported file sytems by Apache-Commons-Vfs2™

Language: Scala - Size: 665 KB - Last synced: 9 months ago - Pushed: almost 6 years ago - Stars: 3 - Forks: 2

aabouzaid/flume-formula

SaltStack formula for Apache Flume.

Language: HTML - Size: 11.7 KB - Last synced: 7 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 2

trendyol-data-eng-summer-intern-2019/recom-engine-docker

Docker files of the project that has configuration to up Kafka, Zookeeper, Flume, Spark, MongoDB and Spring Boot.

Language: Dockerfile - Size: 34.2 MB - Last synced: 9 months ago - Pushed: over 4 years ago - Stars: 4 - Forks: 1

e455a81e-d3ba-41a2-bc6d-7aafb1d9a5cd/BLD_Exercise

Exercise Solution for the course big and linked data(BLD)

Language: Python - Size: 59.6 KB - Last synced: 10 months ago - Pushed: almost 6 years ago - Stars: 0 - Forks: 0

kennarddh/javascript-visual-scripting

Javascript visual scripting using flume

Language: JavaScript - Size: 2.35 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 2 - Forks: 0

alokawi/spark-cassandra-poc

Use Spark to load data and run SQL to store result into Cassandra

Language: Java - Size: 321 KB - Last synced: 10 months ago - Pushed: about 7 years ago - Stars: 1 - Forks: 0

Psingh12354/Internship_Notes_Cog

Language: Scala - Size: 737 KB - Last synced: 10 months ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 0

jancajthaml-devops/flume-docker

dockerized apache flume

Language: Makefile - Size: 1.95 KB - Last synced: 10 months ago - Pushed: about 7 years ago - Stars: 0 - Forks: 0

Stono/bigdata-fun

A complete (distributed) BigData stack, running in containers

Language: Shell - Size: 519 KB - Last synced: 10 months ago - Pushed: about 7 years ago - Stars: 15 - Forks: 10

thedatasociety/lab-hadoop

Language: PLpgSQL - Size: 4.6 MB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 3 - Forks: 7

Stackfolio11/Your-Future-Portfolio

My Bonafide Work Experience and Externship Projects I have undertaken

Size: 33.2 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 0 - Forks: 0

ahpuchend/agdata

农产品数据分析系统

Language: JavaScript - Size: 9.4 MB - Last synced: 7 days ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

HWYWL/bigdata

大数据学习代码Spark、Hive、Storm、HBase

Language: Java - Size: 765 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 1

mohanhh/MonitoringPipelineDesign

Monitoring Data Pipeline Design Example

Size: 235 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

concealedtea/tooltest

Integrated Practice Work with Kafka,Log4j2,Flume,Java,HDFS,Hive, and Web Dev

Language: Java - Size: 40 KB - Last synced: about 1 year ago - Pushed: almost 7 years ago - Stars: 0 - Forks: 0

jiachuanH/Notes

Mainly about JAVA and big data study notes

Language: Jupyter Notebook - Size: 509 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 1 - Forks: 0

technetbytes/Flume

Apache Flume configuration file

Size: 0 Bytes - Last synced: about 1 year ago - Pushed: over 8 years ago - Stars: 0 - Forks: 0

zdkzdk/aaocp

一个对用户行为日志进行分析的大数据项目

Language: PLpgSQL - Size: 74.8 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 56 - Forks: 20

nicshub/tap

Slides, Code, Images and Meme related to the course Technologies for Advanced Programming

Language: Python - Size: 164 MB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 17 - Forks: 9

bitilandu/flume-ng-elasticsearch-sink

Flume-NG 1.9 Sink for Elasticsarch 7.7.0

Language: Java - Size: 48.8 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 6 - Forks: 6

alokjani/bigdata-vagrant-devlab

Hadoop Software Development sandbox

Language: Shell - Size: 206 KB - Last synced: 10 months ago - Pushed: almost 4 years ago - Stars: 1 - Forks: 1

rollno748/JMeter-flume-sampler

Jmeter plugin to push messages or data to flume to help Hadoop/Bigdata testing

Language: Java - Size: 648 KB - Last synced: 9 days ago - Pushed: over 2 years ago - Stars: 2 - Forks: 0

aitting/strainer-pipe

基于Abp Vnext数据采集框架,灵感来源于apache/flume

Language: C# - Size: 108 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 3 - Forks: 0

BestBurning/myworld 📦

These are some code that I've studied and coded,like spark,storm,hadoop,kafka,redis,java...

Language: Java - Size: 5.19 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 8 - Forks: 6

xander-wang/logvision

分布式实时日志分析与入侵检测系统

Language: JavaScript - Size: 28.4 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 92 - Forks: 27

mrugankray/Big-Data-Cluster

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.

Language: Shell - Size: 118 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 6 - Forks: 1

milindjagre/HDPCD

This repository contains all the documents related to HDPCD certification.

Language: PigLatin - Size: 42 KB - Last synced: about 1 year ago - Pushed: over 6 years ago - Stars: 8 - Forks: 10

hugo53/awesome-logging

Logging is hard, then awesome-logging comes.

Size: 216 KB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 9 - Forks: 0

Wanfengyueluo/BookRecommenderSystem

基于大数据的图书推荐系统

Size: 24.3 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 36 - Forks: 4

maniram-yadav/Big_DataHadoop_Projects

Big data projects implemented by Maniram yadav

Language: PigLatin - Size: 2.79 MB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 33 - Forks: 33

AliceO2Group/MonitoringCustomComponents 📦

Monitoring custom components such as Kafka consumers and processing components...

Language: Java - Size: 213 KB - Last synced: about 2 months ago - Pushed: over 4 years ago - Stars: 1 - Forks: 2

dyingbleed/Akita 📦

Akita 秋田犬：Canal 到 Apache Kafka 和 Apache Flume 流数据集成服务

Language: Scala - Size: 43 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 4 - Forks: 1

alvarofpp/4linux-hadoop 📦

Scipts usados durante o curso Big Data Analytics com Hadoop oferecido pela 4Linux

Language: PigLatin - Size: 1.03 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 2 - Forks: 0

ruochao/flume-source-winlog

Flume source support windows event log

Language: Java - Size: 22.5 KB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 2 - Forks: 1

imperio-wxm/flume-multiple-taildir-source

Flume taildirsource source code extension, supports dynamic subdirectory recognition and regular filtering.

Language: Java - Size: 21.5 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 3 - Forks: 0

san089/Cloudera_Material

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

Size: 9.02 MB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 23 - Forks: 20

wzqwtt/BigData

小白大数据学习笔记 :star:

Language: Java - Size: 128 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 16 - Forks: 2

tim-chow/log-parser

一个基于Python和Flume的日志收集和解析系统

Language: Python - Size: 10.7 KB - Last synced: about 1 year ago - Pushed: over 6 years ago - Stars: 19 - Forks: 12

metio/thats-interesting.java

strongly typed logging framework

Language: Java - Size: 278 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

karamolegkos/Twitter_Data_Analyzer

Language: Java - Size: 388 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 5 - Forks: 0

29DCH/Real-time-log-analysis-system

:penguin:基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

Language: Java - Size: 357 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 31 - Forks: 32