Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / kubeflow / training-operator

Distributed ML Training and Fine-Tuning on Kubernetes

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubeflow%2Ftraining-operator

Stars: 1,450
Forks: 616
Open Issues: 86

License: apache-2.0
Language: Go
Repo Size: 92.3 MB
Dependencies: 510

Created: almost 7 years ago
Updated: 10 days ago
Last pushed: 20 days ago
Last synced: 17 days ago

Commit Stats

Commits: 846
Authors: 167
Mean commits per author: 5.07
Development Distribution Score: 0.884
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/kubeflow/training-operator

Topics: ai, distributed, fine-tuning, gpu, huggingface, jax, kubeflow, kubernetes, llm, machine-learning, mlops, python, pytorch, tensorflow, xgboost

Files

Readme

Dependencies

examples/xgboost/xgboost-dist/requirements.txt pypi

Cython >=0.29.4
joblib >=0.13.2
numpy >=1.16.3
oss2 >=2.7.0
pandas >=0.24.2
requests >=2.21.0
scikit-learn >=0.20
scipy >=1.1.0
urllib3 >=1.21.1
xgboost ==1.5.2

.github/workflows/integration-tests.yaml actions

actions/checkout v3 composite
actions/setup-go v3 composite
actions/setup-python v4 composite
helm/kind-action v1.3.0 composite

.github/workflows/publish-conformance-images.yaml actions

.github/workflows/publish-core-images.yaml actions

.github/workflows/publish-example-images.yaml actions

.github/workflows/stale.yaml actions

actions/stale v5 composite

.github/workflows/template-publish-image/action.yaml actions

.github/workflows/test-go.yaml actions

actions/checkout v3 composite
actions/setup-go v3 composite

.github/workflows/test-python.yaml actions

actions/checkout v4 composite
psf/black stable composite

.github/workflows/unittests.yaml actions

actions/checkout v3 composite
actions/setup-go v3 composite
shogo82148/actions-goveralls v1 composite

build/images/kubectl-delivery/Dockerfile docker

alpine 3.17 build

build/images/training-operator/Dockerfile docker

gcr.io/distroless/static latest build
golang 1.20 build

examples/mxnet/train/Dockerfile docker

mxnet/python gpu build

examples/mxnet/tune/Dockerfile docker

nvidia/cuda 10.0-cudnn7-devel-ubuntu16.04 build

examples/pytorch/elastic/echo/Dockerfile docker

python 3.8-buster build

examples/pytorch/elastic/imagenet/Dockerfile docker

$BASE_IMAGE latest build

examples/pytorch/mnist/Dockerfile docker

pytorch/pytorch 1.0-cuda10.0-cudnn7-runtime build

examples/pytorch/pytorch_cuda_docker/Dockerfile docker

nvidia/cuda 9.2-base-ubuntu16.04 build

examples/pytorch/smoke-dist/Dockerfile docker

pytorch/pytorch 1.0-cuda10.0-cudnn7-runtime build

examples/tensorflow/dist-mnist/Dockerfile docker

tensorflow/tensorflow 1.5.0 build

examples/tensorflow/distribution_strategy/estimator-API/Dockerfile docker

tensorflow/tensorflow 1.11.0 build

examples/tensorflow/distribution_strategy/keras-API/Dockerfile docker

python 3.9 build

examples/tensorflow/mnist_with_summaries/Dockerfile docker

tensorflow/tensorflow 1.11.0 build

examples/tensorflow/tf_sample/Dockerfile docker

tensorflow/tensorflow 1.8.0 build

examples/xgboost/lightgbm-dist/Dockerfile docker

python 3.7 build
ubuntu 20.04 build

examples/xgboost/smoke-dist/Dockerfile docker

python 3.6 build

examples/xgboost/xgboost-dist/Dockerfile docker

python 3.6 build

go.mod go

github.com/beorn7/perks v1.0.1
github.com/cespare/xxhash/v2 v2.2.0
github.com/davecgh/go-spew v1.1.1
github.com/emicklei/go-restful/v3 v3.9.0
github.com/evanphx/json-patch v5.6.0+incompatible
github.com/evanphx/json-patch/v5 v5.6.0
github.com/fsnotify/fsnotify v1.6.0
github.com/go-logr/logr v1.2.4
github.com/go-logr/zapr v1.2.4
github.com/go-openapi/jsonpointer v0.19.6
github.com/go-openapi/jsonreference v0.20.2
github.com/go-openapi/swag v0.22.3
github.com/go-task/slim-sprig v0.0.0-20230315185526-52ccab3ef572
github.com/gogo/protobuf v1.3.2
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
github.com/golang/protobuf v1.5.3
github.com/google/gnostic-models v0.6.8
github.com/google/go-cmp v0.5.9
github.com/google/gofuzz v1.2.0
github.com/google/pprof v0.0.0-20210720184732-4bb14d4b1be1
github.com/google/uuid v1.3.0
github.com/imdario/mergo v0.3.13
github.com/josharian/intern v1.0.0
github.com/json-iterator/go v1.1.12
github.com/mailru/easyjson v0.7.7
github.com/matttproud/golang_protobuf_extensions v1.0.4
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
github.com/modern-go/reflect2 v1.0.2
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822
github.com/onsi/ginkgo/v2 v2.11.0
github.com/onsi/gomega v1.27.10
github.com/pkg/errors v0.9.1
github.com/pmezard/go-difflib v1.0.0
github.com/prometheus/client_golang v1.16.0
github.com/prometheus/client_model v0.4.0
github.com/prometheus/common v0.44.0
github.com/prometheus/procfs v0.10.1
github.com/sirupsen/logrus v1.9.0
github.com/spf13/pflag v1.0.5
github.com/stretchr/testify v1.8.2
go.uber.org/multierr v1.11.0
go.uber.org/zap v1.25.0
golang.org/x/exp v0.0.0-20220722155223-a9213eeb770e
golang.org/x/mod v0.10.0
golang.org/x/net v0.13.0
golang.org/x/oauth2 v0.8.0
golang.org/x/sys v0.11.0
golang.org/x/term v0.10.0
golang.org/x/text v0.11.0
golang.org/x/time v0.3.0
golang.org/x/tools v0.9.3
gomodules.xyz/jsonpatch/v2 v2.4.0
google.golang.org/appengine v1.6.7
google.golang.org/protobuf v1.30.0
gopkg.in/inf.v0 v0.9.1
gopkg.in/yaml.v2 v2.4.0
gopkg.in/yaml.v3 v3.0.1
k8s.io/api v0.28.2
k8s.io/apiextensions-apiserver v0.28.0
k8s.io/apimachinery v0.28.2
k8s.io/client-go v0.28.2
k8s.io/code-generator v0.28.2
k8s.io/component-base v0.28.1
k8s.io/gengo v0.0.0-20220902162205-c0856e24416d
k8s.io/klog/v2 v2.100.1
k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9
k8s.io/utils v0.0.0-20230406110748-d93618cff8a2
sigs.k8s.io/controller-runtime v0.16.2
sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
sigs.k8s.io/scheduler-plugins v0.26.7
sigs.k8s.io/structured-merge-diff/v4 v4.2.3
sigs.k8s.io/yaml v1.3.0
volcano.sh/apis v1.8.0

examples/xgboost/smoke-dist/requirements.txt pypi

Cython >=0.29.4
numpy >=1.16.3
requests >=2.21.0
scipy >=1.4.1
urllib3 >=1.21.1
xgboost ==1.5.2

.github/workflows/build-and-publish-images.yaml actions

./.github/workflows/template-publish-image * composite
actions/checkout v3 composite
docker/login-action v2 composite

hack/swagger/go.mod go

github.com/emicklei/go-restful/v3 v3.9.0
github.com/go-logr/logr v1.2.4
github.com/go-openapi/jsonpointer v0.19.6
github.com/go-openapi/jsonreference v0.20.2
github.com/go-openapi/swag v0.22.3
github.com/gogo/protobuf v1.3.2
github.com/golang/protobuf v1.5.3
github.com/google/gnostic v0.5.7-v3refs
github.com/google/go-cmp v0.5.9
github.com/google/gofuzz v1.2.0
github.com/josharian/intern v1.0.0
github.com/json-iterator/go v1.1.12
github.com/kubeflow/training-operator v0.0.0-00010101000000-000000000000
github.com/mailru/easyjson v0.7.7
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
github.com/modern-go/reflect2 v1.0.2
github.com/sirupsen/logrus v1.9.0
golang.org/x/net v0.13.0
golang.org/x/sys v0.11.0
golang.org/x/text v0.11.0
google.golang.org/protobuf v1.30.0
gopkg.in/inf.v0 v0.9.1
gopkg.in/yaml.v2 v2.4.0
gopkg.in/yaml.v3 v3.0.1
k8s.io/api v0.28.2
k8s.io/apimachinery v0.28.2
k8s.io/klog/v2 v2.100.1
k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9
k8s.io/utils v0.0.0-20230406110748-d93618cff8a2
sigs.k8s.io/controller-runtime v0.16.2
sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
sigs.k8s.io/structured-merge-diff/v4 v4.2.3

examples/tensorflow/tf_sample/setup.py pypi

examples/xgboost/lightgbm-dist/requirements.txt pypi

numpy ==1.20.3
pandas ==1.3.0
scikit-learn ==0.24.2
scipy ==1.6.2

go.sum go

174 dependencies

hack/swagger/go.sum go

173 dependencies