An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: real-time-data-processing

quixio/quix-streams

Python Streaming DataFrames for Kafka

Language: Python - Size: 8.58 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1,371 - Forks: 76

emqx/mqtt-to-kafka

Streaming IoT data into Confluent/Kafka using MQTT and EMQX | MQTT Kafka Integration

Language: Makefile - Size: 114 KB - Last synced at: about 5 hours ago - Pushed at: almost 2 years ago - Stars: 13 - Forks: 2

alireza-heidarii/Real-Time-Data-Cleaning-Pipeline-for-Medical-and-Healthcare-Data

A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.

Language: Python - Size: 11.7 KB - Last synced at: 25 days ago - Pushed at: about 2 months ago - Stars: 11 - Forks: 0

mrsamsonn/ADAS-lane-detection

Deep learning-based lane detection system using convolutional neural networks (CNN) to detect lanes in road videos. The model processes video input, performs lane detection, and outputs a video with detected lane markings overlaid.

Language: Python - Size: 22.5 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

hawa1222/real-time-data-processing

Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated with Docker. This pipeline fetches, processes, stores, and visualises stock data.

Language: Python - Size: 65.4 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

venkat-0706/EmotionXpert-PyTorch

Facial Expression Recognition using Deep Learning. Keywords: Python, CNN, Image Classification, Keras, TensorFlow, Emotion Detection.

Language: Jupyter Notebook - Size: 310 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 0

stereosky/community-highlights Fork of quixio/community-highlights

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

Language: Python - Size: 2.14 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

nessmahm/SparkKafka-Real-Time-Brand-Trend-Analysis

A real-time data processing project for analyzing e-commerce sales data. It integrates Apache Kafka 📡 and Apache Spark ⚡ to extract brand information and calculate the top N brands. Results are stored in HBase and displayed in real-time ⏱️. This project enables seamless integration with visualization tools 📊, offering insights into brand trends.

Language: Java - Size: 10.7 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

codeterrayt/StreamGuard

StreamGuard is a high-performance data management script using Kafka and MongoDB to efficiently handle and process real-time data streams. Ideal for scenarios like live GPS tracking, it features real-time data processing, reduced database load, and bulk data insertion.

Language: JavaScript - Size: 24.4 KB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

night-fury-me/real-time-vehicle-data-processing

A repository that contains implementation of a Real-Time Vehicle Data Processing Pipeline that efficiently manages and analyzes vehicle data through a cohesive system.

Language: Python - Size: 664 KB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

AndyZzzZzzZzz/ScholarSerpent

A Python-based academic performance management app with a dynamic UI using Tkinter and ttkbootstrap. Features include secure SQLite storage, user authentication, real-time course info via SFU API, and Docker deployment for cross-platform compatibility.

Language: Python - Size: 1.5 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

quixio/community-highlights

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

Language: Python - Size: 2.14 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

MichalBures-OG/RIoT-IS

Bachelor thesis project of Michal Bureš made at BUT FIT.

Language: Go - Size: 1.24 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

SalmaHisham/KafKa-Hadoop-Spark-cluster-for-Analytics Fork of nourhansowar/E-commerce-Customer-Behavior-Analysis

This project offers a dual approach to understanding e-commerce customer behavior through: Batch data analysis and Real-time data processing.

Language: HTML - Size: 10.1 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Related Keywords
real-time-data-processing 14 python 7 kafka 6 data-engineering 4 event-driven-architecture 4 stream-processing 4 apache-spark 3 apache-kafka 3 stream-processor 3 data-streaming 3 data-intensive-applications 3 computer-vision 2 natural-language-processing 2 data-pipeline 2 etl 2 kafka-consumer 2 kafka-producer 2 kafka-producer-consumer 2 kafka-python 2 python-kafka 2 real-time-data-pipeline 2 realtime-data 2 realtime-etl 2 streaming-etl 2 streaming-pipeline 2 api-integration 2 machine-learning 2 iot 2 flink 1 cpp 1 bigquery 1 zookeeper 1 system-design-project 1 system-design 1 scalability 1 performance-optimization 1 nodejs-kafkajs 1 nodejs 1 mongodb 1 microservices 1 high-velocity-data 1 data-management 1 bulk-insert-query-optimization 1 grafana 1 postgresql 1 hadoop-cluster 1 e-commerce-customer-behavior 1 batch-data-analysis 1 typescript 1 react 1 proof-of-concept 1 iot-platform 1 information-system 1 high-performance 1 go 1 full-stack 1 cloud 1 sqlite-database 1 python-app 1 dynamic-ui 1 cross-platform-development 1 grpc 1 financial-data 1 docker 1 data-visualisation 1 data-pipelines 1 data-preprocessing 1 neural-network 1 lane-detection 1 deep-learning 1 convolutional-neural-networks 1 healthcare-datasets 1 ai-for-automotive 1 spark-streaming 1 spark-nlp 1 pyspark 1 parquet 1 medical-data-analysis 1 data-science 1 hbase-integration 1 data-analysis 1 streaming-data 1 streaming-data-pipelines 1 streaming-data-processing 1 time-series-data 1 emqx 1 emqx-data-integration 1 iov 1 mqtt-kafka 1 mqtt-kafka-integration 1 streaming-integration 1 data-cleaning 1 sentimental-analysis 1 cloud-computing 1 mysql 1