flume | Topic | Ecosyste.ms: Repos

Topic: "flume"

heibaiying/BigData-Notes

大数据入门指南 :star:

Language: Java - Size: 22.9 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 16,422 - Forks: 4,279

wangzhiwubigdata/God-Of-BigData

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Size: 66.3 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 10,106 - Forks: 3,212

MoRan1607/BigDataGuide

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Size: 154 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2,958 - Forks: 903

apache/logging-flume

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

Language: Java - Size: 43 MB - Last synced at: 3 days ago - Pushed at: 11 months ago - Stars: 2,557 - Forks: 1,565

chrisjpatty/flume

Extract logic from your apps with a user-friendly node editor powered by React.

Language: TypeScript - Size: 8.12 MB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 1,569 - Forks: 155

OBenner/data-engineering-interview-questions

More than 2000+ Data engineer interview questions.

Size: 938 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1,341 - Forks: 477

sunnyandgood/BigData

💎🔥大数据学习笔记

Language: Java - Size: 316 MB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 647 - Forks: 222

xander-wang/logvision

分布式实时日志分析与入侵检测系统

Language: JavaScript - Size: 28.7 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 221 - Forks: 48

aliyun/aliyun-maxcompute-data-collectors

Language: Java - Size: 93.7 MB - Last synced at: 8 days ago - Pushed at: 9 days ago - Stars: 132 - Forks: 64

233zzh/TitanDataOperationSystem

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

Language: JavaScript - Size: 105 MB - Last synced at: 5 months ago - Pushed at: almost 4 years ago - Stars: 125 - Forks: 49

wangj1106/recommendMoteur

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

Language: Scala - Size: 10.4 MB - Last synced at: almost 2 years ago - Pushed at: about 7 years ago - Stars: 106 - Forks: 37

soniclavier/bigdata-notebook

Language: Scala - Size: 102 MB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 105 - Forks: 86

tlhhup/litemall-dw

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Language: Java - Size: 9.98 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 82 - Forks: 43

leonlee/flume-ng-mongodb-sink

Flume NG MongoDB source.

Language: Java - Size: 9.79 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 71 - Forks: 62

jcustenborder/flume-ng-rabbitmq

Flume plugin for RabbitMQ

Language: Java - Size: 34.2 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 58 - Forks: 47

lackhurt/flume-canal-source

Flume NG Canal source

Language: Java - Size: 39.1 KB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 57 - Forks: 29

zdkzdk/aaocp

一个对用户行为日志进行分析的大数据项目

Language: PLpgSQL - Size: 74.8 MB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 56 - Forks: 20

pkeropen/BigData-News

基于Spark2.2新闻网大数据实时系统项目

Language: Scala - Size: 187 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 55 - Forks: 21

v5tech/cloud

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Language: Shell - Size: 31.7 MB - Last synced at: 4 months ago - Pushed at: over 8 years ago - Stars: 55 - Forks: 43

vivek2319/Learn-Hadoop-and-Spark

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

Language: Python - Size: 211 MB - Last synced at: almost 2 years ago - Pushed at: about 7 years ago - Stars: 46 - Forks: 39

mrugankray/Big-Data-Cluster

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.

Language: Shell - Size: 118 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 41 - Forks: 15

cognitree/flume-elasticsearch-sink

Flume sink plugin for Elasticsearch

Language: Java - Size: 27.8 MB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 39 - Forks: 33

29DCH/Real-time-log-analysis-system

:penguin:基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

Language: Java - Size: 357 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 37 - Forks: 34

san089/Cloudera_Material

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

Size: 9.02 MB - Last synced at: 5 months ago - Pushed at: over 5 years ago - Stars: 37 - Forks: 30

Wanfengyueluo/BookRecommenderSystem

基于大数据的图书推荐系统

Size: 24.3 MB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 36 - Forks: 4

maniram-yadav/Big_DataHadoop_Projects

Big data projects implemented by Maniram yadav

Language: PigLatin - Size: 2.79 MB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 33 - Forks: 33

OrangeDrk/JavaNotes

Java后端学习笔记。包括Linux、maven、git、互联网架构、大数据体系等

Size: 149 MB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 29 - Forks: 9

shubhamgosain/twitter-Sentiment-Analysis-using-hadoop

A Project where one can fetch and read tweets and show the analysis like who is most influential

Language: Shell - Size: 69.3 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 26 - Forks: 12

fluent/fluent-plugin-flume

Flume input and output plugin for Fluentd

Language: Ruby - Size: 43.9 KB - Last synced at: 24 days ago - Pushed at: about 8 years ago - Stars: 24 - Forks: 13

windwant/bigdata-service

hadoop flume hbase kafka storm；读取kafka数据=》storm实时处理（分割字符，统计字符）=》写入hdfs

Language: Java - Size: 132 KB - Last synced at: over 2 years ago - Pushed at: almost 7 years ago - Stars: 21 - Forks: 13

peiliping/logwatch

日志采集工具

Language: Lua - Size: 1.92 MB - Last synced at: over 1 year ago - Pushed at: about 8 years ago - Stars: 21 - Forks: 4

damaohongtu/full-bigdata-docker Fork of ruoyu-chen/hadoop-docker

docker搭建大数据平台(我的第一本书)

Language: Shell - Size: 4.41 MB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 19 - Forks: 19

zenoyang/web-click-flow

网站点击流离线日志分析

Language: Java - Size: 2.98 MB - Last synced at: 2 months ago - Pushed at: almost 7 years ago - Stars: 19 - Forks: 11

tim-chow/log-parser

一个基于Python和Flume的日志收集和解析系统

Language: Python - Size: 10.7 KB - Last synced at: over 2 years ago - Pushed at: almost 8 years ago - Stars: 19 - Forks: 12

Captain-SpongeBob/MovieRecommendSystem

电影推荐系统，包括基于ALS、LFM的离线推荐、实时推荐，基于Spark

Language: Scala - Size: 237 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 18 - Forks: 7

nicshub/tap

Slides, Code, Images and Meme related to the course Technologies for Advanced Programming

Language: Python - Size: 164 MB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 17 - Forks: 9

wzqwtt/BigData

小白大数据学习笔记 :star:

Language: Java - Size: 128 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 16 - Forks: 2

Rakesh-Nagaraju/Twitter-Data-Analysis-on-COVID19-using-Hadoop-Flume-Hive-and-Spark.

This project aims to use the Hadoop framework to analyze unstructured data that we obtain from Twitter and perform sentiment and trend analysis using Hive on MapReduce and Spark on keyword “COVID19”. We then compare the Hive and Spark approaches to determine the best performance.

Language: Python - Size: 39.8 MB - Last synced at: 4 months ago - Pushed at: over 5 years ago - Stars: 16 - Forks: 4

Stono/bigdata-fun

A complete (distributed) BigData stack, running in containers

Language: Shell - Size: 519 KB - Last synced at: 6 days ago - Pushed at: over 8 years ago - Stars: 15 - Forks: 11

liyifeng/flumeUserGuideCnDoc

Flume用户手册中文翻译版

Language: Python - Size: 399 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 11 - Forks: 3

lovnishverma/bigdataecosystem

Complete Big Data Ecosystem on Docker Desktop

Language: Shell - Size: 409 KB - Last synced at: 7 days ago - Pushed at: 4 months ago - Stars: 10 - Forks: 1

conch-stack/conch-bigdata

Big Data

Language: HTML - Size: 14.2 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 10 - Forks: 3

yzxie/easy-log

分布式日志分析与性能监控服务，集成flume，kafka，netty，websocket，dubbo，redis，hbase等

Language: Java - Size: 138 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 10 - Forks: 8

Sathiyarajan/big-data-pipeline

Big Data

Language: Java - Size: 705 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 9 - Forks: 6

adriel1997/Twitter-Sentiment-Analysis

Twitter based sentiment analysis using JAVA and Hadoop. In this project we are doing the sentiment analysis on twitter data to analyse whether the tweets posted by people are positive or negative or neutral by checking the tweets with the AFFIN dictionary which has a set of 2500 words along with the value of each word ranging from -5 to +5 denoting whether tweets are positive or negative.

Language: Java - Size: 340 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 9 - Forks: 2

hugo53/awesome-logging

Logging is hard, then awesome-logging comes.

Size: 216 KB - Last synced at: 5 days ago - Pushed at: almost 8 years ago - Stars: 9 - Forks: 0

jodth07/hadoop-installation

Instructions on setting up Hadoop, HDFS, java, sbt, kafka, scala, spark and flume on Ubuntu 18.04

Language: Shell - Size: 61.5 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 8 - Forks: 15

BestBurning/myworld 📦

These are some code that I've studied and coded,like spark,storm,hadoop,kafka,redis,java...

Language: Java - Size: 5.19 MB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 8 - Forks: 6

hachreak/stepflow

Streaming Engine that implements Flume patterns.

Language: Erlang - Size: 94.7 KB - Last synced at: 28 days ago - Pushed at: over 7 years ago - Stars: 8 - Forks: 1

milindjagre/HDPCD

This repository contains all the documents related to HDPCD certification.

Language: PigLatin - Size: 42 KB - Last synced at: over 2 years ago - Pushed at: almost 8 years ago - Stars: 8 - Forks: 10

MehdiTAZI/BigData-Platform

End to end big data project, that aims to show how to implement different big data layers, from the infrastructure layer to the end user one. [HADOOP][Spark][Kafka][Cassandra][Ansible][Jupyter][Docker]

Language: Jupyter Notebook - Size: 85 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 6

bitilandu/flume-ng-elasticsearch-sink

Flume-NG 1.9 Sink for Elasticsarch 7.7.0

Language: Java - Size: 48.8 KB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 6

eyeem/scala-flume-client

A tiny Scala library to send events and entities to Apache Flume.

Language: Scala - Size: 42 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 6 - Forks: 1

gluplu/FlumeElasticsearchRestSink

Flume elasticsearch REST sink

Language: Java - Size: 10.8 MB - Last synced at: 11 months ago - Pushed at: over 7 years ago - Stars: 6 - Forks: 4

zicat/tributary

tributary

Language: Java - Size: 2.6 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 5 - Forks: 1

apache/logging-flume-spring-boot

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

Language: Java - Size: 37.1 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 4

apache/logging-flume-kafka

Apache Flume Kafka contains the Flume components that interact with Kafka.

Language: Java - Size: 90.8 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 3

gameflow-tv/flume_mobile 📦

Gameflow's own design system, Flume. Implemented in Dart with a Flutter UI library and adapters for Material.

Language: Dart - Size: 10.9 MB - Last synced at: 5 months ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 1

karamolegkos/Twitter_Data_Analyzer

Language: Java - Size: 388 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 5 - Forks: 0

gluplu/Flume-InfluxDB-Sink

Flume sink compatible with recent InfluxDB versions

Language: Java - Size: 10.5 MB - Last synced at: 3 months ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 3

SaravananJaichandar/Big-Data

A Hadoop repository to portray the use-cases of different hadoop components with real-time projects and their workings explained in detail.

Size: 13 MB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 4

cerndb/hadoop-metrics-http-sink

Hadoop Metrics 2 plugin to push metrics to a HTTP end point (e.g. Elastic, Flume).

Language: Java - Size: 24.4 KB - Last synced at: over 1 year ago - Pushed at: about 8 years ago - Stars: 5 - Forks: 1

kennarddh/javascript-visual-scripting

Javascript visual scripting using flume

Language: JavaScript - Size: 2.33 MB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

cq-cdy/it-words

基于Hadoop与Flume的IT词汇Android平台

Language: Java - Size: 16.5 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 0

trendyol-data-eng-summer-intern-2019/recom-engine-docker

Docker files of the project that has configuration to up Kafka, Zookeeper, Flume, Spark, MongoDB and Spring Boot.

Language: Dockerfile - Size: 34.2 MB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 4 - Forks: 1

DimensionSoftware/Flume

Flume Music - React Native Example

Language: HTML - Size: 4.45 MB - Last synced at: 5 months ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 3

dyingbleed/Akita 📦

Akita 秋田犬：Canal 到 Apache Kafka 和 Apache Flume 流数据集成服务

Language: Scala - Size: 43 KB - Last synced at: over 2 years ago - Pushed at: almost 7 years ago - Stars: 4 - Forks: 1

aitting/strainer-pipe

基于Abp Vnext数据采集框架,灵感来源于apache/flume

Language: C# - Size: 108 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

thedatasociety/lab-hadoop

Language: PLpgSQL - Size: 4.6 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 7

dsandeep0138/SparkTwitterAnalysis

Real-time data analytics on COVID-19 over a Twitter Stream using Big Data Technologies of Hadoop Ecosystem such as Flume, Kafka and Spark Streaming. Flask is used to display dashboards.

Language: Python - Size: 25.9 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 1

JuanCasado/Hadoop-Docker

Hadoop deployment on docker and Docker Swarm

Language: TSQL - Size: 88.8 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 1

matrixzoo/flume-restful-driver

An RESTful driver for Apache Flume

Language: Java - Size: 50.8 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0

xiaows08/app-logs

bigdata-用户访问行为分析

Language: JavaScript - Size: 226 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 0

imperio-wxm/flume-multiple-taildir-source

Flume taildirsource source code extension, supports dynamic subdirectory recognition and regular filtering.

Language: Java - Size: 21.5 KB - Last synced at: 24 days ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

xiaoxigua13437/MysqlSink

基于Flume自定义SinkSource

Language: Java - Size: 25.4 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

lazy-apple/BigData_Long

爬虫+大数据项目

Language: Java - Size: 183 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 0

lazy-apple/BigData

大数据电商项目

Language: Java - Size: 205 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 0

keedio/Flume-ng-source-VFS 📦

Flume-ng-source-VFS is a custom Apache Flume source component for processing files under supported file sytems by Apache-Commons-Vfs2™

Language: Scala - Size: 665 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 3 - Forks: 2

juju-solutions/bundle-realtime-syslog-analytics 📦

Bundle for analyzing syslog data with Apache Spark and Apache Hadoop

Language: Python - Size: 40 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 3 - Forks: 6

MohammedRayyanAli/Twitter-Data-Analysis-using-Hadoop-Framework

Twitter data analysis using hadoop (hdfs), flume, map-reduce and hive. Sentiment Analysis is also done using affin dictionary for tweets related to Indian election.

Language: Java - Size: 12.7 MB - Last synced at: 28 days ago - Pushed at: about 7 years ago - Stars: 3 - Forks: 3

mplachter/ansible-role-flume 📦

Ansible role for installing and configuring Apache Flume, always the use of multiple sinks and sources as well as sink groups.

Language: Python - Size: 15.6 KB - Last synced at: about 2 months ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 1

huangyueranbbc/FlumeDemo

Flume Custom Development Flume自定义开发 JAVA

Language: Java - Size: 64.5 KB - Last synced at: over 2 years ago - Pushed at: almost 8 years ago - Stars: 3 - Forks: 0

DoraALin/flume-nsq-sink

flume sink to send event to nsq

Language: Java - Size: 8.79 KB - Last synced at: 3 months ago - Pushed at: over 8 years ago - Stars: 3 - Forks: 1

JunLuo/flume-netty-http-source

A flume source with netty

Language: Java - Size: 15.6 KB - Last synced at: over 2 years ago - Pushed at: over 8 years ago - Stars: 3 - Forks: 6

rollno748/JMeter-flume-sampler

Jmeter plugin to push messages or data to flume to help Hadoop/Bigdata testing

Language: Java - Size: 648 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 0

alvarofpp/4linux-hadoop 📦

Scipts usados durante o curso Big Data Analytics com Hadoop oferecido pela 4Linux

Language: PigLatin - Size: 1.03 MB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 2 - Forks: 0