pipeline-framework | Topic | Ecosyste.ms: Repos

Topic: "pipeline-framework"

google-ai-edge/mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

Language: C++ - Size: 575 MB - Last synced at: 2 days ago - Pushed at: 4 days ago - Stars: 29,429 - Forks: 5,319

nextflow-io/nextflow

A DSL for data-driven computational pipelines

Language: Groovy - Size: 58 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 2,909 - Forks: 680

yuanxiaosc/Entity-Relation-Extraction

Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取，2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge Extraction, SKE 2019

Language: Python - Size: 5.83 MB - Last synced at: 9 days ago - Pushed at: almost 5 years ago - Stars: 1,230 - Forks: 272

pipeless-ai/pipeless

An open-source computer vision framework to build and deploy apps in minutes

Language: Rust - Size: 142 MB - Last synced at: 7 days ago - Pushed at: 12 months ago - Stars: 749 - Forks: 38

yzhao062/combo

(AAAI' 20) A Python Toolbox for Machine Learning Model Combination

Language: Python - Size: 4.95 MB - Last synced at: 13 days ago - Pushed at: over 2 years ago - Stars: 648 - Forks: 106

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.

Language: Python - Size: 8.17 MB - Last synced at: 13 days ago - Pushed at: almost 2 years ago - Stars: 610 - Forks: 62

minerva-ml/open-solution-home-credit 📦

Open solution to the Home Credit Default Risk challenge :house_with_garden:

Language: Python - Size: 219 KB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 445 - Forks: 170

MegEngine/MegFlow

Efficient ML solution for long-tailed demands.

Language: Rust - Size: 3.26 MB - Last synced at: 3 days ago - Pushed at: almost 2 years ago - Stars: 404 - Forks: 40

CubicZebra/informatics

Framework of fast implementation data processing and operating pipelines

Language: Python - Size: 7.94 MB - Last synced at: 19 minutes ago - Pushed at: about 2 hours ago - Stars: 400 - Forks: 17

neptune-ai/open-solution-mapping-challenge

Open solution to the Mapping Challenge :earth_americas:

Language: Python - Size: 704 KB - Last synced at: 6 days ago - Pushed at: about 4 years ago - Stars: 386 - Forks: 97

thomhurst/ModularPipelines

Write your pipelines in C# !

Language: C# - Size: 28 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 357 - Forks: 12

pipefunc/pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪

Language: Python - Size: 1.99 MB - Last synced at: about 4 hours ago - Pushed at: about 5 hours ago - Stars: 352 - Forks: 14

m3dev/gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.

Language: Python - Size: 1.2 MB - Last synced at: 4 days ago - Pushed at: 15 days ago - Stars: 321 - Forks: 62

s8sg/faas-flow

Function Composition for OpenFaaS

Language: Go - Size: 31.8 MB - Last synced at: 5 days ago - Pushed at: about 2 years ago - Stars: 259 - Forks: 38

analysiscenter/batchflow

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

Language: Python - Size: 145 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 201 - Forks: 45

ivanpaulovich/FluentMediator

:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.

Language: C# - Size: 1.14 MB - Last synced at: 12 days ago - Pushed at: about 5 years ago - Stars: 194 - Forks: 17

datajoint/datajoint-python

Relational data pipelines for the science lab

Language: Python - Size: 19.1 MB - Last synced at: 7 days ago - Pushed at: 20 days ago - Stars: 175 - Forks: 86

whitaker-io/machine

Machine is a workflow/pipeline library for processing data

Language: Go - Size: 1.39 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 157 - Forks: 12

neptune-ai/open-solution-salt-identification 📦

Open solution to the TGS Salt Identification Challenge

Language: Python - Size: 1.63 MB - Last synced at: 6 days ago - Pushed at: about 4 years ago - Stars: 121 - Forks: 43

AustralianSynchrotron/lightflow

A lightweight, distributed workflow system

Language: Python - Size: 920 KB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 108 - Forks: 18

pwwang/pipen

A pipeline framework for python

Language: Python - Size: 6.34 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 104 - Forks: 15

ESIPFed/Geoweaver

boost data pipeline's tangibility, enhance research productivity, reduce work anxiety

Language: JavaScript - Size: 153 MB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 89 - Forks: 49

maxim2266/strit

Package strit introduces a new type of string iterator, along with a number of iterator constructors, wrappers and combinators.

Language: Go - Size: 34.2 KB - Last synced at: about 13 hours ago - Pushed at: over 3 years ago - Stars: 84 - Forks: 0

benfoster/Flo

Lightweight library for composing chain of responsibility pipelines

Language: C# - Size: 68.4 KB - Last synced at: 2 days ago - Pushed at: over 5 years ago - Stars: 83 - Forks: 12

CyberReboot/vent 📦

Vent is a light-weight platform built to automate network collection and analysis pipelines using a flexible set of popular open source tools and technologies. Vent is python-based, extensible, leverages docker containers, and provides both an API and CLI.

Language: Python - Size: 16.8 MB - Last synced at: 5 months ago - Pushed at: over 5 years ago - Stars: 76 - Forks: 35

marsggbo/torchline

Easy to use Pytorch

Language: Python - Size: 190 KB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 70 - Forks: 2

Matts966/alphasql

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

Language: C++ - Size: 284 MB - Last synced at: 7 days ago - Pushed at: almost 3 years ago - Stars: 53 - Forks: 4

bsc-wdc/compss

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

Language: Java - Size: 288 MB - Last synced at: 9 days ago - Pushed at: 17 days ago - Stars: 51 - Forks: 21

Cambricon/CNStream

CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/SolutionSDK/CNStream

Language: C++ - Size: 259 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 49 - Forks: 9

minerva-ml/open-solution-googleai-object-detection 📦

Open solution to the Google AI Object Detection Challenge :maple_leaf:

Language: Python - Size: 252 KB - Last synced at: 11 months ago - Pushed at: almost 3 years ago - Stars: 46 - Forks: 22

cginternals/gloperate

C++ library for defining and controlling modern GPU rendering/processing operations.

Language: C++ - Size: 7.41 MB - Last synced at: 19 days ago - Pushed at: almost 3 years ago - Stars: 43 - Forks: 24

houmo-ai/mediapipe_plus

The purpose of this project is to apply mediapipe to more AI chips.

Language: C++ - Size: 2.51 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 40 - Forks: 17

minerva-ml/open-solution-value-prediction 📦

Open solution to the Santander Value Prediction Challenge :tropical_fish:

Language: Python - Size: 85 KB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 39 - Forks: 20

emanuega/MERlin

MERlin is an extensible analysis pipeline applied to decoding MERFISH data

Language: Python - Size: 16.2 MB - Last synced at: 21 days ago - Pushed at: over 3 years ago - Stars: 35 - Forks: 31

virelay/corelay

CoRelAy is a tool to compose small-scale (single-machine) analysis pipelines.

Language: Python - Size: 1.86 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 28 - Forks: 2

CMU-INF-DIVA/pyturbo

Pyturbo package: A pipeline system for efficient concurrent execution

Language: Python - Size: 1.95 MB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 28 - Forks: 2

saantiaguilera/go-pipeline

Build, execute and represent pipelines (aka workflows / templates) in Go

Language: Go - Size: 327 KB - Last synced at: 2 days ago - Pushed at: almost 3 years ago - Stars: 28 - Forks: 2

38/plumber

The General-Purpose Cross-Language Dataflow Programming

Language: C - Size: 2.6 MB - Last synced at: 17 days ago - Pushed at: about 6 years ago - Stars: 27 - Forks: 2

a2i2/surround

Surround is a framework for building AI driven microservices in Python, https://surround.readthedocs.io/en/latest/

Language: Python - Size: 1.48 MB - Last synced at: 10 days ago - Pushed at: 10 months ago - Stars: 23 - Forks: 29

giacbrd/SmartPipeline

A framework for rapid development of robust data pipelines following a simple design pattern

Language: Python - Size: 393 KB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 22 - Forks: 2

minerva-ml/steppy-toolkit 📦

Curated set of transformers that make your work with steppy faster and more effective :telescope:

Language: Python - Size: 108 KB - Last synced at: about 4 hours ago - Pushed at: over 6 years ago - Stars: 22 - Forks: 9

ominibyte/richflow

A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.

Language: JavaScript - Size: 122 KB - Last synced at: 22 days ago - Pushed at: over 7 years ago - Stars: 22 - Forks: 1

sephib/dagster-graph-project

Repo demonstrating a Dagster pipeline to generate Neo4j Graph

Language: Jupyter Notebook - Size: 12.2 MB - Last synced at: 12 months ago - Pushed at: almost 4 years ago - Stars: 20 - Forks: 4

vtta2008/PLM

This application can be used to build, manage, and optimise film making pipelines

Language: Python - Size: 454 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 20 - Forks: 7

FlyPythons/DAGflow

Module to create DAG Task and Manage Task on SGE

Language: Python - Size: 41 KB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 18 - Forks: 5

nksaraf/lepton-footprint-extraction

Automated building polygon extraction from satellite imagery

Language: Python - Size: 290 KB - Last synced at: 7 days ago - Pushed at: over 5 years ago - Stars: 15 - Forks: 3

open-integration/oi

Compile your pipeline once, run anywhere

Language: Go - Size: 1.64 MB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 14 - Forks: 1

xpl/pipez

Function sequencing reloaded

Language: JavaScript - Size: 53.7 KB - Last synced at: 8 days ago - Pushed at: almost 7 years ago - Stars: 14 - Forks: 2

pwwang/biopipen

A set of processes/pipelines for bioinformatics

Language: R - Size: 42.6 MB - Last synced at: 22 days ago - Pushed at: about 1 month ago - Stars: 13 - Forks: 5

ZosoV/mobia-project

This repository contains a entire process for developing an Automatic License Plate Recognition (ALPR) system using mainly Nvidia TAO Toolkit and Nvidia Deepstream SDK using the Python Bindings.

Language: Jupyter Notebook - Size: 76.7 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 13 - Forks: 1

gtmoose32/pipeline-framework

Pipeline framework allows you to easily construct and execute linear workflows

Language: C# - Size: 235 KB - Last synced at: 11 days ago - Pushed at: about 3 years ago - Stars: 13 - Forks: 7

gambarra/PipelineR

PipelineR - is a simple framework for working with the pattern chain of responsibility

Language: C# - Size: 521 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 8

minerva-ml/open-solution-talking-data 📦

Open solution to the TalkingData AdTracking Fraud Detection Challenge

Language: Jupyter Notebook - Size: 521 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 11 - Forks: 6

NCBI-Hackathons/FlowBio

A fast, easy way to present complex bioinformatics pipelines to biologists

Language: Shell - Size: 210 MB - Last synced at: 6 months ago - Pushed at: over 6 years ago - Stars: 11 - Forks: 6

jsa-aerial/aerobio

Extensible full DAG streaming computation server with services and jobs for RNA-Seq, Tn-Seq, WG-Seq and Term-Seq.

Language: Clojure - Size: 1.09 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 10 - Forks: 1

Fatal1ty/amqpipe 📦

Twisted based pipeline framework for AMQP

Language: Python - Size: 37.1 KB - Last synced at: 24 days ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 2

Adigorla/xgap

xGAP is an efficient, modular, extensible and fault-tolerant pipeline for massively parallelized genomic analysis/variant discovery from next-generation DNA sequencing data.

Language: Python - Size: 113 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 10 - Forks: 2

Starlink/ORAC-DR

The ORAC-DR astronomy data reduction pipeline

Language: Perl - Size: 24.8 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 9 - Forks: 7

tgbnhy/fast-kmeans

This repo holds the code, dataset, and running scripts for fast k-means evaluation

Language: Java - Size: 5.75 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 9 - Forks: 5

anthonyloukinas/AWX-Promotion-Pipeline

Ansible AWX code promotion solution using Ansible playbooks and the tower modules. This can be consumed via Jenkins, GitHub Actions, GitLab and others for full code promotion and rigid tower resource definitions. This solution also allows you to audit your code promotion using native Git tools.

Size: 1000 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 9 - Forks: 1