kids-first/kf-lib-data-ingest

🏭 Kids First Data Ingest Library

Language: Python - Size: 11.2 MB - Last synced at: about 15 hours ago - Pushed at: about 15 hours ago - Stars: 5 - Forks: 0

artefactual-sdps/enduro

A tool to support ingest and automation in digital preservation workflows

Language: Go - Size: 11.8 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 3

newrelic/nri-flex

An application-agnostic, all-in-one New Relic integration integration

Language: Go - Size: 9.1 MB - Last synced at: 8 days ago - Pushed at: 9 days ago - Stars: 114 - Forks: 124

erickrr-bd/WSbeat

Easy data ingestion into ElasticSearch using Python and websockets.

Language: Python - Size: 38.1 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

CloudFormations/CF.Cumulus

A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away the complexity, giving you the power to build, scale, and manage your dataflows with ease, accelerating data delivery.

Language: TSQL - Size: 10.6 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 19 - Forks: 11

YathishGP003/Cyber-Quest-v1

A gamified cybersecurity learning platform with 10 progressive difficulty levels, each teaching a specific security concept.

Language: TypeScript - Size: 2.32 MB - Last synced at: 13 days ago - Pushed at: 14 days ago - Stars: 4 - Forks: 0

nagare-media/ingest

nagare media ingest implements various HTTP based media ingest protocols

Language: Go - Size: 214 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 6 - Forks: 0

Lolle2000la/MangaIngestWithUpscaling

Manage ingesting mangas, placing them in the right places and merging multiple sources together, while also enabling automatic upscaling of said mangas.

Language: C# - Size: 1.27 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0

E-ARK-Software/earkweb

E-ARK Web is a software for the creation and management of archival information packages, and it supports full-text search for individual files contained in them.

Language: JavaScript - Size: 64.8 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 22 - Forks: 6

sammcj/ingest

Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs

Language: Go - Size: 2.69 MB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 199 - Forks: 10

ShreyPurohit/gitingest-vsextension

Seamlessly analyze your Git repositories inside VS Code!

Language: TypeScript - Size: 12.6 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 2 - Forks: 0

rse/vdo-ninja-trampoline

VDO.Ninja Trampoline

Language: HTML - Size: 790 KB - Last synced at: 1 day ago - Pushed at: about 3 years ago - Stars: 27 - Forks: 12

jrcichra/ingestd

HTTP server that easily ingests data into a database

Language: Go - Size: 318 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 1 - Forks: 0

opensemanticsearch/open-semantic-etl

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

Language: Python - Size: 615 KB - Last synced at: 19 days ago - Pushed at: over 2 years ago - Stars: 267 - Forks: 72

josev2046/Watch-Folder-Automation

A simple watch folder prototype for OVPs/OTTs/MAMs/DAMs.

Size: 49.8 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

artefactual-labs/enduro

A tool to support ingest and automation in digital preservation workflows

Language: Go - Size: 3.73 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 13 - Forks: 8

discoverygarden/dgi_migrate

A module to facilitate bulk ingest and migrations into Islandora using the migrate module.

Language: PHP - Size: 802 KB - Last synced at: 20 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 4

lu-pl/rdfingest

A simple tool for ingesting RDF data into a triplestore.

Language: Python - Size: 814 KB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Regionaal-Archief-Zuid-Utrecht/razulibs

Data transformation tools for the creation of RDF for ingest of digital archives.

Language: Python - Size: 271 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 3 - Forks: 1

dd-Splunk/splunk-datalake

How to combine smart store and ingest action for datalake use case

Language: Python - Size: 360 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

alephdata/alephclient

API client for Aleph, supports bulk entity and document upload.

Language: Python - Size: 250 KB - Last synced at: 20 days ago - Pushed at: 6 months ago - Stars: 28 - Forks: 12

speculare-cloud/speculare-server

Receive, store info coming from the client into the database and handle alerts to report incidents based on criteria

Language: Rust - Size: 634 KB - Last synced at: 1 day ago - Pushed at: 7 months ago - Stars: 31 - Forks: 1

stevenlafl/GPTLoader

Ingest an entire codebase into ChatGPT to ask questions about it

Language: TypeScript - Size: 130 KB - Last synced at: 26 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

lizclipse/grohuh

Service definition of grott & custom ingest/dashboard

Language: Rust - Size: 39.1 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

codingchili/ethereum-ingest

JavaFX and commandline application to import events from the Ethereum blockchain into ElasticSearch, MongoDB, Hazelcast, CQEngine and SQLite.

Language: Java - Size: 2.68 MB - Last synced at: 20 days ago - Pushed at: about 6 years ago - Stars: 35 - Forks: 9

prasanthj/culvert

Hive streaming ingest test application

Language: Java - Size: 51.8 KB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 2

tspannhw/GetWebCamera

Apache NiFi 1.23 Custom Processor for WebCams

Language: Java - Size: 2.57 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 4

shitizenlism/goForwarder

用ffmpeg采样File/rtsp/rtmp流，推送到RTMP Server，断开自动重拉，防假死。Use ffmpeg to ingest File/rtsp/rtmp streams, push to RTMP Server, auo re-pull and prevent fake-dead.

Language: Go - Size: 1.55 MB - Last synced at: 10 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

sxudan/lets-watch

This is a watch party video streaming app

Language: C++ - Size: 12.9 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

sxudan/react-native-live-file-publisher

This is a react native package to publish file to RTSP or RTMP server.

Language: TypeScript - Size: 4.16 MB - Last synced at: about 18 hours ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

sxudan/live_file_publisher

This is a flutter package to publish file to RTSP or RTMP server.

Language: Dart - Size: 28.3 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

alongL/srs_ingest_helper

a json controlled web server to help srs doing ingest.

Language: C++ - Size: 291 KB - Last synced at: 11 months ago - Pushed at: about 3 years ago - Stars: 35 - Forks: 11

EFS-OpenSource/superb-data-kraken-ingest

Language: Python - Size: 83 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

AilieOHagan/primm Fork of mohagan9/primm

Pre-Ingest Metadata Modifier

Language: Kotlin - Size: 70.3 KB - Last synced at: 9 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

teknoir/node-red-teknoir-ingest

A set of nodes that lets you ingest data from all your devices.

Language: JavaScript - Size: 55.7 KB - Last synced at: 14 days ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

tmcgrath/cassandra-ingest

DataStax or Cassandra Ingest from Relational Databases with StreamSets

Language: PLSQL - Size: 12.3 MB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 4 - Forks: 13

ovidiugiorgi/csv2opensearch

Import CSV files into OpenSearch

Language: Go - Size: 18.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

data-modelisation/stock-market-ingesting

Market Data Ingestion and BigQuery Integration project

Language: Python - Size: 28.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

lloydmeta/jhhi

Java Heap Histogram Ingest, written in Rust. Sends jmap heap histograms to Elasticsearch.

Language: Rust - Size: 1.28 MB - Last synced at: 6 days ago - Pushed at: over 4 years ago - Stars: 6 - Forks: 1

jnylen/vind 📦

Vind is a importer for EPG Data from various sources

Language: Elixir - Size: 707 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

luludotdev/frameshift 📦

Ingest and Viewing stack for deploying Mixer's FTL streaming protocol.

Language: TypeScript - Size: 427 KB - Last synced at: 12 months ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 2

Themimitoof/cambak

📸 A simple and easy to use tool for derushing digital cameras

Language: Go - Size: 60.5 KB - Last synced at: 16 days ago - Pushed at: about 3 years ago - Stars: 4 - Forks: 1

znatty22/d3b-ingest-packages

Sandbox for setting up new ingest workflow - ingest data portal per PR

Language: Python - Size: 2.18 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

riffl/riffl

Riffl - generic streaming data ingestion framework

Language: Java - Size: 177 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 1

LeidenUniversityLibrary/islandora_prepare_ingest

Islandora Prepare Ingest is a module that helps you build workflows for preparing data for ingest into Islandora.

Language: PHP - Size: 621 KB - Last synced at: 5 months ago - Pushed at: almost 3 years ago - Stars: 2 - Forks: 0

jcoon97/pushshift-ingest-delay

Simple webapp that will show the ingest delay for PushShift Reddit data

Language: TypeScript - Size: 14.6 KB - Last synced at: 14 days ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

tspannhw/ClouderaNow2020

Twitter Ingest to S3, ORC, Slack, Hive Streaming

Size: 22.5 KB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 0

discoverygarden/islandora_paged_content_pdf_batch

Language: PHP - Size: 49.8 KB - Last synced at: 20 days ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 8

tspannhw/clouddatawarehouse

Populating Cloud Data Warehouses with Apache NiFi

Size: 14.4 MB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 2 - Forks: 0

mikejoh/artifactory-elasticsearch-ingest-pipelines

Ingest pipelines to parse Artifactory logs sent to Elasticsearch using Filebeat

Size: 1.95 KB - Last synced at: 24 days ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

Staatsarchiv-Basel-Stadt/PREMIS-Profile-scopeIngest

Language: XSLT - Size: 29.3 KB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

discoverygarden/islandora_ordered_zip_newspaper_batch

Newspaper batch ingest that uses the ordering of a ZIP to dictate sequence.

Language: PHP - Size: 21.5 KB - Last synced at: 17 days ago - Pushed at: over 8 years ago - Stars: 1 - Forks: 1

discoverygarden/limerick_ingest

Language: PHP - Size: 205 KB - Last synced at: 17 days ago - Pushed at: over 9 years ago - Stars: 0 - Forks: 0

discoverygarden/uofm_newspaper_batch

Batch ingest for IArchive format, as provided from UoM.

Language: XSLT - Size: 208 KB - Last synced at: 17 days ago - Pushed at: about 11 years ago - Stars: 0 - Forks: 0

discoverygarden/islandora_importer Fork of Islandora/islandora_importer

A pluggable batch ingester module for Islandora.

Language: XSLT - Size: 773 KB - Last synced at: about 1 year ago - Pushed at: about 11 years ago - Stars: 0 - Forks: 0

discoverygarden/book_batch_rename_script

Renames a folder full of TIFF/XML/MRC files and moves them into the correct folders to prepare for ingest using the Islandora Book Batch module

Language: Shell - Size: 158 KB - Last synced at: 17 days ago - Pushed at: over 11 years ago - Stars: 1 - Forks: 3

tspannhw/kudrone-nifi

Notes, scripts, images, Apache NiFi templates, processors

Size: 7.97 MB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0