Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: avro-schema

JocelynVelarde/EmbracePlus-Visualizer

Visualize your raw data from .avro files for the EmbracePlus device from Empatica

Language: Python - Size: 33.2 MB - Last synced: about 1 hour ago - Pushed: 1 day ago - Stars: 0 - Forks: 0

fillmore-labs/avro-demo

Introduction to Apache Avro

Language: Java - Size: 429 KB - Last synced: about 14 hours ago - Pushed: 1 day ago - Stars: 0 - Forks: 0

clemensv/avrotize

Avrotize is a command-line tool for converting data structure definitions between different schema formats, using Apache Avro Schema as the integration schema model.

Language: Python - Size: 736 KB - Last synced: about 16 hours ago - Pushed: 1 day ago - Stars: 38 - Forks: 1

mikaello/avrodoc-plus Fork of leosilvadev/avrodoc-plus

Documentation tool for Avro schemas

Language: Less - Size: 1.3 MB - Last synced: about 20 hours ago - Pushed: 2 days ago - Stars: 9 - Forks: 3

fillmore-labs/avro-logical-type-conversion

Avro LogicalType Conversion

Language: Java - Size: 230 KB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 0 - Forks: 0

piotr-yuxuan/dove

Infer specs from SpecificRecord Java classes of any Avro named type (record, fixed, or enum)

Language: Clojure - Size: 1000 KB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 27 - Forks: 1

erikerlandson/coulomb

coulomb: unit analysis for Scala

Language: Scala - Size: 4.22 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 140 - Forks: 9

avro-kotlin/avro4k

Avro support for kotlinx.serialization

Language: Kotlin - Size: 1.28 MB - Last synced: 4 days ago - Pushed: 5 days ago - Stars: 185 - Forks: 36

sngular/kloadgen

KLoadGen is kafka load generator plugin for jmeter designed to work with AVRO, JSON and PROTOL-BUFFERS schema Registries.

Language: Java - Size: 13 MB - Last synced: 1 day ago - Pushed: 12 days ago - Stars: 200 - Forks: 42

beam-community/avro_ex

An Avro Library that emphasizes testability and ease of use.

Language: Elixir - Size: 222 KB - Last synced: 3 days ago - Pushed: about 1 month ago - Stars: 65 - Forks: 26

confluentinc/schema-registry

Confluent Schema Registry for Kafka

Language: Java - Size: 112 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 2,139 - Forks: 1,101

kivanval/gradle-avrohugger

A Gradle plugin that compiles Apache Avro files (*.avpr, *.avsc, *.avdl) into the corresponding Scala files in your project using the Avrohugger.

Language: Groovy - Size: 285 KB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 4 - Forks: 0

ashutoshsahoo/gs-spring-boot-kafka

Spring Boot Kafka Schema Registry

Language: Java - Size: 32.2 KB - Last synced: 7 days ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

zhenik/kafka-apis-example

Presentation of different kafka apis

Language: Java - Size: 10.8 MB - Last synced: 7 days ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0

tommket/avdl2avsc-maven-plugin

Maven plugin to produce AVRO JSON schemas (AVSC - less human readable format) from IDL schema files (AVDL - more human readable)

Language: Java - Size: 182 KB - Last synced: 8 days ago - Pushed: 8 days ago - Stars: 0 - Forks: 0

rudikone/avroschema-wizard-plugin

Streamline Avro schema registration and compatibility checks in Kafka with the avroschema-wizard-plugin, simplifying testing and integration with ease!

Language: Kotlin - Size: 106 KB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 1 - Forks: 0

asyncapi/avro-schema-parser

An AsyncAPI schema parser for Avro 1.x schemas.

Language: TypeScript - Size: 1.16 MB - Last synced: about 17 hours ago - Pushed: 9 days ago - Stars: 29 - Forks: 18

robinhosz/kafka-avro-springboot

A simple example using Kafka Avro with Spring Boot

Language: Java - Size: 0 Bytes - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 0 - Forks: 0

nlopes/avro-schema-registry

Avro Schema Registry (mostly) compatible with salsify/avro-schema-registry

Language: Rust - Size: 1.07 MB - Last synced: 12 days ago - Pushed: 13 days ago - Stars: 17 - Forks: 5

sourcemeta/json-size-benchmark

An automated and extensible space-efficiency benchmark of JSON-compatible serialization specifications

Language: Python - Size: 824 KB - Last synced: 12 days ago - Pushed: 12 days ago - Stars: 3 - Forks: 0

lxghtless/schema-registry

A CP-like Schema Registry that doesn't use Kafka for storage.

Language: TypeScript - Size: 158 KB - Last synced: 13 days ago - Pushed: over 3 years ago - Stars: 3 - Forks: 0

AbsaOSS/ABRiS

Avro SerDe for Apache Spark structured APIs.

Language: Scala - Size: 965 KB - Last synced: 14 days ago - Pushed: 15 days ago - Stars: 222 - Forks: 73

uber/marmaray 📦

Generic Data Ingestion & Dispersal Library for Hadoop

Language: Java - Size: 1.61 MB - Last synced: 6 days ago - Pushed: about 1 year ago - Stars: 472 - Forks: 110

imrafaelmerino/json-values

Persistent Json in Java

Language: Java - Size: 166 MB - Last synced: 17 days ago - Pushed: 18 days ago - Stars: 20 - Forks: 0

hifly81/kafka-examples

Practical examples with Apache Kafka®

Language: Java - Size: 119 MB - Last synced: 20 days ago - Pushed: 20 days ago - Stars: 49 - Forks: 8

flix-tech/schema-registry-php-client

A PHP 8+ API client for the Confluent Schema Registry REST API based on Guzzle 7 - http://docs.confluent.io/current/schema-registry/docs/index.html

Language: PHP - Size: 276 KB - Last synced: 14 days ago - Pushed: 4 months ago - Stars: 44 - Forks: 22

opwvhk/avro-schema-support

Extend IntelliJ, PyCharm and other JetBrains IDEs to more easily work with Avro schemata and protocols in both IDL and JSON format.

Language: Java - Size: 4.11 MB - Last synced: 22 days ago - Pushed: 23 days ago - Stars: 15 - Forks: 2

geekcell/kafka-symfony-bundle

An opinionated Symfony bundle for a painless integration of Apache Kafka.

Language: PHP - Size: 76.2 KB - Last synced: 23 days ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

cbismuth/spark-utils 📦

Apache Spark 2+ lightweight utilities with MiniDFSCluster support

Language: Java - Size: 50.8 KB - Last synced: 24 days ago - Pushed: about 7 years ago - Stars: 0 - Forks: 0

javaHelper/Kafka-Streams-with-Spring-Cloud-Stream

Oreilly - Kafka Streams with Spring Cloud Stream

Language: Java - Size: 210 KB - Last synced: 28 days ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

oalles/avro-schema-from-bq-table

Get Avro Schema from Google Cloud Big Query table

Language: Java - Size: 60.5 KB - Last synced: 28 days ago - Pushed: 8 months ago - Stars: 1 - Forks: 0

DRIVER-EU/avro-schemas

A repository to maintain AVRO schema's for use in the test-bed.

Language: TypeScript - Size: 255 KB - Last synced: 2 days ago - Pushed: 2 months ago - Stars: 7 - Forks: 1

jeffbr13/avdoc

CLI tool to generate HTML documentation for an Apache Avro schema

Language: Python - Size: 710 KB - Last synced: 29 days ago - Pushed: 3 months ago - Stars: 1 - Forks: 0

sksamuel/avro4s

Avro schema generation and serialization / deserialization for Scala

Language: Scala - Size: 2.64 MB - Last synced: 13 days ago - Pushed: 25 days ago - Stars: 716 - Forks: 235

Strech/avrora

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

Language: Elixir - Size: 691 KB - Last synced: 12 days ago - Pushed: 19 days ago - Stars: 89 - Forks: 33

flix-tech/avro-serde-php

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Language: PHP - Size: 171 KB - Last synced: 3 days ago - Pushed: 4 months ago - Stars: 57 - Forks: 35

fluent-plugins-nursery/fluent-plugin-parser-avro

Avro parser plugin for Fluentd.

Language: Ruby - Size: 42 KB - Last synced: about 2 months ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1

imrafaelmerino/avro-spec

The library offers a set of builders and utilities to construct Avro schemas from specs and provides serializers and deserializers tailored to these schemas to transmit the immutable and persistent JSON from json-values.

Language: Java - Size: 235 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

rmb938/franz-schema-registry

Kafka Schema Registry that is API compatible with Confluent Schema Registry

Language: Go - Size: 225 KB - Last synced: 28 days ago - Pushed: about 1 year ago - Stars: 1 - Forks: 1

ticean/awesome-kafka-in-clojure

Awesome information for using Kafka and Confluent Platform in Clojure.

Size: 10.7 KB - Last synced: 1 day ago - Pushed: almost 5 years ago - Stars: 28 - Forks: 4

leocalm/avro_validator

A pure python avro schema validator

Language: Python - Size: 109 KB - Last synced: about 2 months ago - Pushed: 8 months ago - Stars: 27 - Forks: 16

ashutoshsahoo/distributed-transactions-kafka

Distributed Transactions in Microservices with Kafka Streams and Spring Boot

Language: Java - Size: 229 KB - Last synced: 7 days ago - Pushed: 5 months ago - Stars: 6 - Forks: 4

pannoi/kafka-schema-operator

Operator to provide Kafka Schema in declarative way using KubernetesCustomResources

Language: Go - Size: 74.2 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 4 - Forks: 1

Happy-Kunal/pydantic2avro

Generate Apache Avro schemas for Pydantic data models.

Language: Python - Size: 29.3 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

lensesio/schema-registry 📦

A CLI and Go client for Kafka Schema Registry. This repository is deprecated and no longer maintained.

Language: Go - Size: 84 KB - Last synced: 7 days ago - Pushed: over 3 years ago - Stars: 116 - Forks: 34

bashish2711/embedded-projects

Learn from many embedded projects, develop and contribute for the open source repository

Size: 1.95 KB - Last synced: 2 months ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0

godatadriven/pydantic-avro

This library can convert a pydantic class to a avro schema or generate python code from a avro schema.

Language: Python - Size: 217 KB - Last synced: 24 days ago - Pushed: 3 months ago - Stars: 46 - Forks: 25

artur-tamazian/avro-schema-generator

Library for generating avro schema files (.avsc) based on DB tables structure

Language: Java - Size: 71.3 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 46 - Forks: 27

agile-lab-dev/darwin

Avro Schema Evolution made easy

Language: Scala - Size: 2.67 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 32 - Forks: 10

KRISHNASAIRAJ/Kafka-Driven-Logistics-Data-Ingestion-into-MongoDB

The project showcases a data pipeline integrating Kafka messaging and MongoDB for efficient logistics data ingestion. It uses Python for Kafka producer/consumer operations and MongoDB for data storage.

Language: Python - Size: 787 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

joewood/avro-typescript

TypeScript Code Generator for Apache Avro Schema Types

Language: TypeScript - Size: 303 KB - Last synced: 5 days ago - Pushed: over 1 year ago - Stars: 36 - Forks: 28

xdmytrox/avro2jsonschema

Converts avro schema to json schema

Language: JavaScript - Size: 163 KB - Last synced: 20 days ago - Pushed: over 1 year ago - Stars: 2 - Forks: 0

ouzi-dev/avro-kedavro

Go library to magically turn json in json-avro

Language: Go - Size: 1.27 MB - Last synced: 4 months ago - Pushed: about 1 year ago - Stars: 5 - Forks: 1

pennsignals/aptos 📦

:sunny: A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Language: Python - Size: 72.3 KB - Last synced: 29 days ago - Pushed: over 3 years ago - Stars: 150 - Forks: 24

Eainde/eainde-kafka

This is kafka producer and consumer POC. I am using avro serializer for serialization and deserialization of kafka messages.

Language: Java - Size: 19.5 KB - Last synced: 5 months ago - Pushed: about 1 year ago - Stars: 2 - Forks: 0

josgilmo/avrostry

Kafka messages encoded and decoded for Avro Registry as Domain Events.

Language: Go - Size: 3.46 MB - Last synced: 2 months ago - Pushed: over 5 years ago - Stars: 2 - Forks: 2

hackolade/Avro

Hackolade plugin for Avro schema

Language: JavaScript - Size: 3.67 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 0 - Forks: 15

bolcom/avro-schema-viewer

Visualizer for Avro Schemas (.avsc) - Try it yourself at:

Language: TypeScript - Size: 2.8 MB - Last synced: 3 months ago - Pushed: about 1 year ago - Stars: 26 - Forks: 5

autrefois/SAD

SAD is the project accompanying my MSc Dissertation Thesis (Real-Time Anomaly Detection on Streaming Data) at Babeș-Bolyai University; MSc in High Performance Computing and Big Data Analytics.

Language: Jupyter Notebook - Size: 3.36 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

MostafijurJ/apache-kafka-avro

Apache Avro with Schema registry

Language: Java - Size: 87.9 KB - Last synced: 7 days ago - Pushed: 5 months ago - Stars: 1 - Forks: 0

RADAR-base/RADAR-Schemas

Catalog of the schemas for RADAR-base

Language: Kotlin - Size: 2.41 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 14 - Forks: 24

lerouxrgd/rsgen-avro

Command line and library for generating Rust types from Avro schemas

Language: Rust - Size: 398 KB - Last synced: 20 days ago - Pushed: about 2 months ago - Stars: 33 - Forks: 24

TeraHelix/apps-xsd-avdl

This template project demonstrates how TeraHelix Spear can be used to generate Avro / AVDL bindings from a set of input XML Schema (XSD) inputs.

Language: Java - Size: 75.2 KB - Last synced: 6 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

buvnswrn/droneinspection

Repository for Drone Inspection Digital Twin

Size: 2.61 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 2 - Forks: 0

LeoFuso/argo

A Gradle plugin aimed to help working with Apache Avro. It supports code generation for JSON schema declaration files(.avsc), JSON protocol declaration files(.avpr), and Avro IDL files. In the future, it should support Schema Registry integration, as well.

Language: Kotlin - Size: 572 KB - Last synced: 7 days ago - Pushed: 12 months ago - Stars: 6 - Forks: 0

LearningJournal/Kafka-Streams-Real-time-Stream-Processing

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

Language: Java - Size: 5.25 MB - Last synced: 6 months ago - Pushed: almost 4 years ago - Stars: 147 - Forks: 147

mattkds/avro-tools

⚙️ Repository to manage avro schema and tools for kafka streaming application

Language: Java - Size: 13.7 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

arminhaghi/avro-docs-2.0

Language: TypeScript - Size: 3.86 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 4 - Forks: 0

zolyfarkas/avro-schema-examples

Repository with avro schema examples

Size: 148 KB - Last synced: 13 days ago - Pushed: almost 3 years ago - Stars: 8 - Forks: 1

kameshsampath/kafka-avro-demo

A Quarkus microservice to demonstration with Confluent Cloud Kafka and Schema Registry

Language: Java - Size: 4.04 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

php-kafka/php-avro-schema-generator

PHP avro subschema merger and experimental PHP Class avro schema generator

Language: PHP - Size: 109 KB - Last synced: 19 days ago - Pushed: 6 months ago - Stars: 5 - Forks: 5

farmdawgnation/registryless-avro-converter

An avro converter for Kafka Connect without a Schema Registry

Language: Java - Size: 145 KB - Last synced: about 1 month ago - Pushed: almost 4 years ago - Stars: 53 - Forks: 20

amousavigourabi/easy-avro

Simplify dynamic Avro schema generation and usage using POJOs.

Language: Java - Size: 112 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

MaxWenzel/spring-kafka-messaging

Example for Spring Cloud Streaming with Kafka - together with Avro, Confluent Schema Registry and more

Language: Java - Size: 60.5 KB - Last synced: 8 months ago - Pushed: almost 4 years ago - Stars: 0 - Forks: 0

GoodforGod/DummyMapper

IntelliJ IDEA plugin for mapping Java class to JSON/AVRO/GraphQL.

Language: Java - Size: 581 KB - Last synced: 7 days ago - Pushed: about 1 month ago - Stars: 13 - Forks: 2

no0law1/avro-contracts

Learn how to create an Avro to .NET generator using Docker

Language: C# - Size: 9.77 KB - Last synced: 8 months ago - Pushed: about 1 year ago - Stars: 1 - Forks: 0

LeoFuso/record-mapper

RecordMapper provides functionality for reading and writing Avro-compatible Records to or from String JSON equivalent.

Language: Java - Size: 163 KB - Last synced: 7 days ago - Pushed: over 1 year ago - Stars: 2 - Forks: 0

ashok-amsamani/Hive-Schema-Evolution

Detailed about how we can dynamically load columns in HIVE using AVRO.

Language: HiveQL - Size: 13.7 KB - Last synced: 9 months ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

bartkl/metamorph

Metamorph is a Clojure libary that enables the generation of an Avro schema from a given input SHACL model.

Language: Clojure - Size: 1.08 MB - Last synced: 29 days ago - Pushed: 9 months ago - Stars: 2 - Forks: 2

creativcoder/avrow

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

Language: Rust - Size: 397 KB - Last synced: 4 days ago - Pushed: over 1 year ago - Stars: 28 - Forks: 5

jaimedantas/kafka-service

Service based on event-driven

Language: Java - Size: 17.6 KB - Last synced: 9 months ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

amitbansal26/kafka-registry-gradle-plugin

Kafka Schema Registry Avro Schema Download Plugin

Language: Java - Size: 72.3 KB - Last synced: 9 months ago - Pushed: about 6 years ago - Stars: 1 - Forks: 0

glzbcrt/avro

Samples I created during my Avro studies.

Language: Java - Size: 27.3 KB - Last synced: 9 months ago - Pushed: over 6 years ago - Stars: 1 - Forks: 0

kklimexk/avro-reader-example

Language: Java - Size: 10.7 KB - Last synced: 9 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

cgerman7x/bq-ingestion

BigQuery ingestion POC using PubSub messages with different AVRO schemas and Apache Beam

Language: Python - Size: 65.4 KB - Last synced: 10 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

nalindas9/avro-schema-to-csv

Avro schema to CSV converter

Language: Python - Size: 21.5 KB - Last synced: 2 months ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

itfat/POJO2Avro

A simple intellij plugin to generate avro schema from java objects

Language: Java - Size: 71.3 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 1 - Forks: 0

vcholak/kafka-sreams-kotlin

Kafka streams app that joins two streams

Language: Java - Size: 68.4 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0

badboyd/avro-schema-gen

Gen Avro Schema from Golang struct

Language: Go - Size: 22.5 KB - Last synced: 10 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

piotr-kalanski/data-model-generator

Data model generator based on Scala case classes

Language: Scala - Size: 178 KB - Last synced: 11 months ago - Pushed: over 3 years ago - Stars: 25 - Forks: 14

diogofcunha/avro-schema-builder

A robust and feature-rich package for building Avro Schema definitions.

Language: TypeScript - Size: 124 KB - Last synced: 16 days ago - Pushed: 11 months ago - Stars: 0 - Forks: 0

cedardevs/schemas

CEDAR Schemas

Language: Groovy - Size: 458 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 4 - Forks: 1

michalklempa/avro-compose

Utility framework for composing Avro Schemas. From smaller components (types) specified in separate files into large schemas ready to be deployed to schema registry or your application

Language: Java - Size: 63.5 KB - Last synced: 9 months ago - Pushed: over 2 years ago - Stars: 5 - Forks: 2

ThinhPV/real-time-streaming-etl-pipeline-with-kafka

Build a Real-Time Streaming ETL Pipeline with Apache Kafka, Kafka Connect, and ksqlDB

Language: TSQL - Size: 271 KB - Last synced: almost 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

solidninja/schema-registry-sttp-client

Mirror of https://gitlab.com/solidninja/schema-registry-sttp-client

Language: Scala - Size: 31.3 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 1

theodorecurtil/kafka_sales_producer

Small Java application to produce Avro serialized records to Kafka cluster

Language: Java - Size: 15.5 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 3 - Forks: 0

GoodforGod/avro-json-optional-decoder

⚙️ Java AVRO Decoder with JSON optional/default field support.

Language: Java - Size: 185 KB - Last synced: 7 days ago - Pushed: over 2 years ago - Stars: 1 - Forks: 1

GeethanadhP/xml-avro

Convert XSD -> AVSC and XML -> AVRO

Language: Scala - Size: 395 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 32 - Forks: 25

cubny/avro-tools

Painless Avro Tools

Language: Go - Size: 14.6 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

gAmUssA/springboot-kafka-avro

A simple Spring Boot app that talks to Kafka using Avro and Schema Registry

Language: Java - Size: 76.2 KB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 34 - Forks: 36