An open API service providing repository metadata for many open source software ecosystems.

Topic: "real-time-data-processing"

quixio/quix-streams

Python Streaming DataFrames for Kafka

Language: Python - Size: 9.54 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 1,474 - Forks: 91

emqx/mqtt-to-kafka

Streaming IoT data into Confluent/Kafka using MQTT and EMQX | MQTT Kafka Integration

Language: Makefile - Size: 114 KB - Last synced at: 29 days ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 4

alireza-heidarii/Real-Time-Data-Cleaning-Pipeline-for-Medical-and-Healthcare-Data

A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.

Language: Python - Size: 11.7 KB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 11 - Forks: 0

venkat-0706/EmotionXpert-PyTorch

Facial Expression Recognition using Deep Learning. Keywords: Python, CNN, Image Classification, Keras, TensorFlow, Emotion Detection.

Language: Jupyter Notebook - Size: 310 KB - Last synced at: 8 months ago - Pushed at: 10 months ago - Stars: 7 - Forks: 0

codeterrayt/StreamGuard

StreamGuard is a high-performance data management script using Kafka and MongoDB to efficiently handle and process real-time data streams. Ideal for scenarios like live GPS tracking, it features real-time data processing, reduced database load, and bulk data insertion.

Language: JavaScript - Size: 24.4 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

hawa1222/real-time-data-processing

Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated with Docker. This pipeline fetches, processes, stores, and visualises stock data.

Language: Python - Size: 65.4 KB - Last synced at: 8 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

Willie-Conway/Meta-Database-Engineer-Portfolio

"🌟 Portfolio showcasing projects and skills acquired through the Meta Database Engineer Professional Certificate program🎓, including data modeling 📊, SQL analysis 📝, and data visualization 📈."

Language: Python - Size: 598 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

quixio/community-highlights

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

Language: Python - Size: 2.14 MB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

YashBoda/AInvest

AInvest is an AI-powered agent that analyzes stock performance using real-time data and news. It leverages LLMs with tools like yFinance, Tavily, and Google News to autonomously plan, fetch, and interpret financial insights—offering intelligent investment guidance based on market trends, returns, volatility, and sentiment.

Language: Jupyter Notebook - Size: 32.2 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

mrsamsonn/ADAS-lane-detection

Deep learning-based lane detection system using convolutional neural networks (CNN) to detect lanes in road videos. The model processes video input, performs lane detection, and outputs a video with detected lane markings overlaid.

Language: Python - Size: 22.5 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

stereosky/community-highlights Fork of quixio/community-highlights

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

Language: Python - Size: 2.14 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

nessmahm/SparkKafka-Real-Time-Brand-Trend-Analysis

A real-time data processing project for analyzing e-commerce sales data. It integrates Apache Kafka 📡 and Apache Spark ⚡ to extract brand information and calculate the top N brands. Results are stored in HBase and displayed in real-time ⏱️. This project enables seamless integration with visualization tools 📊, offering insights into brand trends.

Language: Java - Size: 10.7 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

night-fury-me/real-time-vehicle-data-processing

A repository that contains implementation of a Real-Time Vehicle Data Processing Pipeline that efficiently manages and analyzes vehicle data through a cohesive system.

Language: Python - Size: 664 KB - Last synced at: 8 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

AndyZzzZzzZzz/ScholarSerpent

A Python-based academic performance management app with a dynamic UI using Tkinter and ttkbootstrap. Features include secure SQLite storage, user authentication, real-time course info via SFU API, and Docker deployment for cross-platform compatibility.

Language: Python - Size: 1.5 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

MichalBures-OG/RIoT-IS

Bachelor thesis project of Michal Bureš made at BUT FIT.

Language: Go - Size: 1.24 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

SalmaHisham/KafKa-Hadoop-Spark-cluster-for-Analytics Fork of nourhansowar/E-commerce-Customer-Behavior-Analysis

This project offers a dual approach to understanding e-commerce customer behavior through: Batch data analysis and Real-time data processing.

Language: HTML - Size: 10.1 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Related Topics
python 7 kafka 6 data-engineering 4 stream-processing 4 event-driven-architecture 4 stream-processor 3 data-streaming 3 apache-kafka 3 apache-spark 3 data-intensive-applications 3 realtime-etl 2 realtime-data 2 computer-vision 2 iot 2 real-time-data-pipeline 2 machine-learning 2 python-kafka 2 kafka-python 2 natural-language-processing 2 kafka-producer-consumer 2 kafka-producer 2 kafka-consumer 2 data-pipeline 2 etl 2 streaming-etl 2 streaming-pipeline 2 api-integration 2 database-design 1 ai-for-automotive 1 convolutional-neural-networks 1 deep-learning 1 database-backup-and-recovery-strategies 1 lane-detection 1 neural-network 1 big-data-technology 1 business-intelligence-tools 1 cloud-database-solutions 1 data-governance-and-compliance 1 data-integrity-and-constraints 1 data-modeling 1 data-normalization-and-denormalization 1 data-visualization-techniques 1 data-warehousing 1 data-science 1 streaming-data 1 streaming-data-pipelines 1 streaming-data-processing 1 time-series-data 1 bulk-insert-query-optimization 1 data-management 1 high-velocity-data 1 microservices 1 mongodb 1 nodejs 1 nodejs-kafkajs 1 performance-optimization 1 scalability 1 system-design 1 system-design-project 1 zookeeper 1 database-security-best-practices 1 extract-transform-load 1 indexing-and-query-optimization 1 nosql-databases 1 performance-tuning 1 relational-database-management-system 1 scripting-for-database-automation 1 sql-querying 1 data-cleaning 1 data-pipelines 1 data-preprocessing 1 healthcare-datasets 1 medical-data-analysis 1 parquet 1 pyspark 1 spark-nlp 1 spark-streaming 1 docker 1 data-visualisation 1 typescript 1 react 1 proof-of-concept 1 iot-platform 1 information-system 1 high-performance 1 go 1 full-stack 1 cloud 1 grpc 1 flink 1 cpp 1 bigquery 1 hbase-integration 1 data-analysis 1 sqlite-database 1 python-app 1 dynamic-ui 1 cross-platform-development 1 postgresql 1 hadoop-cluster 1