GitHub topics: apache-avro

Repositories

marcosschroh/dataclasses-avroschema

Generate avro schemas from python dataclasses, Pydantic models and Faust Records. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas.

Language: Python - Size: 8.1 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 230 - Forks: 71

astrolabsoftware/fink-alert-simulator

Simulate alert streams for the Fink broker

Language: Python - Size: 21.5 MB - Last synced at: 19 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 1

only-cliches/NoProto

Flexible, Fast & Compact Serialization with RPC

Language: Rust - Size: 41.9 MB - Last synced at: 2 days ago - Pushed at: almost 2 years ago - Stars: 374 - Forks: 13

Tirth27/Real-time-analytics-with-spark-streaming

This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for real-time sentiment predictions.

Language: Jupyter Notebook - Size: 16.5 MB - Last synced at: 17 days ago - Pushed at: almost 4 years ago - Stars: 13 - Forks: 3

ynqa/pandavro

Apache Avro <-> pandas DataFrame

Language: Python - Size: 102 KB - Last synced at: 13 days ago - Pushed at: 9 months ago - Stars: 137 - Forks: 33

hiejulia/HotelBooking

Hotel Booking project

Language: Vue - Size: 874 KB - Last synced at: 22 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 5

[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Language: Scala - Size: 393 KB - Last synced at: 6 days ago - Pushed at: about 3 years ago - Stars: 725 - Forks: 329

aiven/thingum-industries 📦

Imaginary manufacturing company event-driven application examples

Language: HTML - Size: 231 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 4

cbdq-io/docker-avro-tools

Make avro-tools available via a Docker container.

Language: Python - Size: 46.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

chriniko13/avro-simple-example

Language: Java - Size: 6.84 KB - Last synced at: about 2 months ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

seanpm2001/Bliss_Browser_ApacheAvro

🌳️🌐️#️⃣️ The Bliss Browser Apache Avro language support module, allowing Apache Avro programs to be written in and ran within the browser.

Language: HTML - Size: 1.74 MB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

lyes-sefiane/multi-element-relationally-interconnected-topology

The Microservices NextGen 🇩🇿 🇨🇦

Language: Java - Size: 778 KB - Last synced at: 27 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

thekvs/cpp-serializers

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Language: C++ - Size: 530 KB - Last synced at: 9 months ago - Pushed at: about 5 years ago - Stars: 717 - Forks: 111

leocalm/avro_validator

A pure python avro schema validator

Language: Python - Size: 109 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 27 - Forks: 16

alivcor/torque

Serialize your Spark Dataframes to and from Avro

Language: Scala - Size: 23.4 KB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

gauravrmazra/gauravbytes

Examples for gaurav.cc

Language: Java - Size: 10.4 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 59 - Forks: 143

com-nilportugues/eventbus-kafka-avro

An Event Bus implementation using Apache Kafka and Apache Avro

Language: Java - Size: 48.8 KB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

seanpm2001/SNU_2D_ProgrammingTools_IDE_ApacheAvro

⌨️ The Apache Avro programming language IDE submodule for SNU Programming Tools (2D Mode)

Language: HTML - Size: 1.03 MB - Last synced at: 2 days ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

seanpm2001/Learn-ApacheAvro

📚️ A repository for showcasing my knowledge of the Apache Avro programming language, and continuing to learn the language.

Language: HTML - Size: 1.02 MB - Last synced at: 2 days ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

seanpm2001/AI2001_Category-Source_Code-SC-Apache-Avro

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️💾️📜️ The sourceCode:Apache-Avro category for AI2001, containing Apache Avro programming language datasets

Language: R - Size: 2.42 MB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

esakik/data-engineering-essentials

Samples related to data engineering, e.g. spark, embulk, airflow, etc.

Language: Python - Size: 413 KB - Last synced at: 18 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

holixon/axon-avro-serializer 📦

Provide support for axon event serialization via apache avro.

Language: Kotlin - Size: 3.1 MB - Last synced at: 8 months ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 1

woile/avdl-rs

Apache Avro AVDL parser

Language: Rust - Size: 85.9 KB - Last synced at: 2 days ago - Pushed at: about 2 years ago - Stars: 7 - Forks: 1

fillmore-labs/kafka-sensors

Kafka Serialization Playground

Language: Java - Size: 2.13 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 4 - Forks: 2

Vishal1297/vehicle-manager

A Vehicle Manager Project Using Java + Kotlin

Language: Kotlin - Size: 146 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 2

etorres/notifications-engine

Notifications Engine

Language: Scala - Size: 137 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

big-data-europe/pilot-sc4-kafka-producer Fork of luigiselmi/kafka-clients

Producer and consumer of traffic data for Apache Kafka

Language: Java - Size: 151 KB - Last synced at: 12 months ago - Pushed at: about 7 years ago - Stars: 4 - Forks: 2

tspannhw/nifi-attributecleaner-processor

Clean up attribute names for Apache NiFi to send to Apache Avro

Language: Java - Size: 829 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 10 - Forks: 2

reddy-s/kafka-avro-consumer

Kafka consumer application which reads messages from Kafka and based on the schema registered in a schema registry and enriches the data. This is just a prototype on how we can efficiently evolve a schema and read messages with BACKWARD compatibility with out breaking the consumers. This application can be used as a base for a stateless stream processing application which would involve processing one event at a time or filtering though a stream of events.

Language: Java - Size: 145 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 4 - Forks: 3

AbdullahMu/Data-Streaming-Nanodegree-Project_01-Optimizing-Public-Transportation

Construct a streaming event pipeline around Apache Kafka and its ecosystem. Using public data from the Chicago Transit Authority, we will construct an event pipeline around Kafka that allows us to simulate and display the status of train lines in real time.

Language: Python - Size: 512 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 1