Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / hectorhe001 / DataflowTemplates
Google-provided Cloud Dataflow template pipelines for solving simple in-Cloud data tasks
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hectorhe001%2FDataflowTemplates
Fork of GoogleCloudPlatform/DataflowTemplates
Stars: 0
Forks: 0
Open Issues: 0
License: apache-2.0
Language:
Repo Size: 5.14 MB
Dependencies:
235
Created: over 1 year ago
Updated: over 1 year ago
Last pushed: over 1 year ago
Last synced: 23 days ago
Files
Loading...
Readme
Loading...
Dependencies
- ./.github/actions/setup-java-env * composite
- actions/setup-go 44e221478fc6847752e5c574fc7a7b3247b00fbf composite
- tj-actions/changed-files 61ee456a9d0f512e7ecfdf28863634c97dae2d16 composite
- actions/cache 72d1e4fdff0ff7b1b6e86b415f2d4f5941e5c006 composite
- actions/setup-java a12e082d834968c1847f782019214fadd20719f6 composite
.github/workflows/go-pr.yml
actions
- actions/checkout 230611dbd0eb52da1e1f4f7bc8bb0c3a339fc8b7 composite
- actions/setup-go 44e221478fc6847752e5c574fc7a7b3247b00fbf composite
.github/workflows/java-pr.yml
actions
- ./.github/actions/cleanup-java-env * composite
- ./.github/actions/setup-env * composite
- actions/checkout 230611dbd0eb52da1e1f4f7bc8bb0c3a339fc8b7 composite
- ./.github/actions/cleanup-java-env * composite
- ./.github/actions/setup-java-env * composite
- actions/checkout 230611dbd0eb52da1e1f4f7bc8bb0c3a339fc8b7 composite
.github/workflows/release.yml
actions
- actions/checkout v3 composite
- actions/checkout ec3a7ce113134d7a93b817d10a8272cb61118579 composite
- actions/upload-artifact 82c141cc518b40d92cc801eee768e7aafc9c2fa2 composite
- github/codeql-action/upload-sarif 5f532563584d71fdef14ee64d17bafb34f751ce5 composite
- ossf/scorecard-action e3e75cf2ffbf9364bbff86cdbdf52b23176fe492 composite
cicd/go.mod
go
it/pom.xml
maven
- com.google.cloud:libraries-bom 24.2.0 import
- com.google.auto.value:auto-value 1.8.2 provided
- com.google.auto.value:auto-value-annotations 1.8.2
- com.google.cloud:google-cloud-bigquery
- com.google.cloud:google-cloud-storage 2.2.2
- com.google.guava:guava 31.0.1-jre
- com.google.re2j:re2j 1.5
- org.apache.beam:beam-runners-google-cloud-dataflow-java 2.38.0
- org.slf4j:slf4j-simple 1.7.25
- com.google.truth:truth 1.0.1 test
- junit:junit 4.13.1 test
- org.mockito:mockito-core 3.7.7 test
- org.mockito:mockito-inline 4.5.1 test
pom.xml
maven
- org.apache.beam:beam-sdks-java-io-parquet compile
- com.google.cloud:libraries-bom 24.4.0 import
- org.apache.beam:beam-sdks-java-bom 2.41.0 import
- com.google.auto.value:auto-value 1.7.4 provided
- org.apache.hbase:hbase-common 1.4.5 provided
- com.datastax.cassandra:cassandra-driver-core 3.6.0
- com.google.api.grpc:proto-google-cloud-kms-v1 0.87.0
- com.google.auto.service:auto-service 1.0-rc6
- com.google.auto.value:auto-value-annotations 1.7.4
- com.google.cloud.bigtable:bigtable-beam-import 1.15.0
- com.google.cloud:google-cloud-bigquery 1.108.0
- com.google.cloud:google-cloud-dlp 2.1.0
- com.google.cloud:google-cloud-kms 1.40.0
- com.google.cloud:google-cloud-secretmanager
- com.google.http-client:google-http-client 1.40.1
- com.google.http-client:google-http-client-apache-v2 1.40.1
- com.google.http-client:google-http-client-bom 1.41.2
- com.google.re2j:re2j 1.4
- commons-codec:commons-codec 1.14
- commons-io:commons-io 2.4
- io.opencensus:opencensus-api 0.24.0
- org.apache.beam:beam-runners-direct-java
- org.apache.beam:beam-runners-google-cloud-dataflow-java
- org.apache.beam:beam-sdks-java-core
- org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core
- org.apache.beam:beam-sdks-java-extensions-protobuf
- org.apache.beam:beam-sdks-java-io-cassandra
- org.apache.beam:beam-sdks-java-io-google-cloud-platform
- org.apache.beam:beam-sdks-java-io-jdbc
- org.apache.commons:commons-csv 1.8
- org.apache.commons:commons-text 1.9
- org.apache.hadoop:hadoop-common 2.8.5
- org.apache.hadoop:hadoop-mapreduce-client-core 2.8.5
- org.apache.kafka:kafka-clients 1.0.0
- org.codehaus.jackson:jackson-core-asl 1.9.13
- org.codehaus.jackson:jackson-mapper-asl 1.9.13
- org.json:json 20200518
- org.openjdk.nashorn:nashorn-core 15.4
- org.springframework:spring-expression 5.2.8.RELEASE
- org.tensorflow:proto 1.15.0
- org.threeten:threetenbp 1.4.4
- com.google.truth:truth 1.0.1 test
- junit:junit 4.13 test
- org.apache.derby:derby 10.14.2.0 test
- org.apache.derby:derbyclient 10.14.2.0 test
- org.apache.derby:derbynet 10.14.2.0 test
- org.hamcrest:hamcrest-core 2.1 test
- org.hamcrest:hamcrest-library 2.1 test
- org.junit.jupiter:junit-jupiter-api 5.5.2 test
- org.mock-server:mockserver-junit-rule 5.11.1 test
- org.mock-server:mockserver-netty 5.11.1 test
- org.mockito:mockito-core 3.0.0 test
- org.scassandra:cql-antlr 1.1.2 test
- org.scassandra:java-client 1.1.2 test
syndeo-template/pom.xml
maven
- org.apache.beam:beam-sdks-java-bom 2.39.0 import
- com.google.auto.service:auto-service 1.0.1
- com.google.protobuf:protobuf-java 3.15.8
- com.google.protobuf:protoc 3.15.8
- org.apache.beam:beam-runners-direct-java
- org.apache.beam:beam-runners-google-cloud-dataflow-java
- org.apache.beam:beam-sdks-java-core
- org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core
- org.apache.beam:beam-sdks-java-io-google-cloud-platform
- org.apache.beam:beam-vendor-guava-26_0-jre 0.1
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- com.google.auto.value:auto-value-annotations 1.6.2 compile
- com.google.cloud.dataflow.cdc:cdc-common 0.1 compile
- com.google.cloud:google-cloud-bigquery ${gcp.version} compile
- org.slf4j:slf4j-api ${slf4j.version} compile
- com.google.api.grpc:grpc-google-cloud-datacatalog-v1beta1 ${data-catalog.version} compile
- com.google.api.grpc:proto-google-cloud-datacatalog-v1beta1 ${data-catalog.version} compile
- com.google.cloud:google-cloud-datacatalog ${data-catalog.version} compile
- org.apache.beam:beam-sdks-java-extensions-sql compile
- org.slf4j:slf4j-jdk14 ${slf4j.version}
- org.slf4j:slf4j-nop ${slf4j.version}
- com.google.cloud.dataflow.cdc:cdc-common 0.1 compile
- commons-beanutils:commons-beanutils 1.9.3 compile
- io.debezium:debezium-connector-mysql ${debezium.version} compile
- io.debezium:debezium-embedded ${debezium.version} compile
- org.apache.commons:commons-configuration2 2.5 compile
- org.mockito:mockito-all 1.10.19 test
v2/cdc-parent/pom.xml
maven
- com.google.guava:guava 25.1-jre compile
- org.slf4j:slf4j-api ${slf4j.version} compile
- io.grpc:grpc-api 1.45.1
- io.grpc:grpc-core 1.45.1
- io.grpc:grpc-netty-shaded 1.45.1
- io.grpc:grpc-protobuf 1.45.1
- io.grpc:grpc-stub 1.45.1
- org.junit.jupiter:junit-jupiter-api 5.5.1 test
- org.junit.jupiter:junit-jupiter-engine 5.5.1 test
v2/common/pom.xml
maven
- com.google.cloud.bigtable:bigtable-hbase-beam 1.15.0
- com.google.cloud:google-cloud-bigquery 2.9.0
- com.google.cloud:google-cloud-secretmanager 2.1.2
- org.apache.avro:avro 1.8.2
- org.apache.beam:beam-sdks-java-io-parquet
- org.apache.commons:commons-csv 1.8
- org.apache.commons:commons-text 1.9
- org.apache.hadoop:hadoop-client ${hadoop.version}
- org.openjdk.nashorn:nashorn-core 15.4
- com.google.truth.extensions:truth-proto-extension 1.0.1 test
- com.google.truth:truth 1.0.1 test
- junit:junit ${junit.version} test
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.apache.beam:beam-sdks-java-io-mongodb
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.postgresql:postgresql 42.2.2
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.json:json 20160810
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- mysql:mysql-connector-java 8.0.13
- org.postgresql:postgresql 42.2.2
- com.google.truth:truth 1.0.1 test
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT
- com.google.cloud.teleport.v2:elasticsearch-common 1.0-SNAPSHOT
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT
- com.google.cloud:google-cloud-kms 1.20.0
- com.google.guava:guava ${guava.version}
- org.apache.beam:beam-sdks-java-io-hadoop-common
- org.apache.hadoop:hadoop-common 2.8.5
- org.apache.hadoop:hadoop-mapreduce-client-core 2.8.5
- com.google.truth:truth 1.0.1 test
- org.apache.derby:derby 10.14.2.0 test
- org.apache.derby:derbyclient 10.14.2.0 test
- org.apache.derby:derbynet 10.14.2.0 test
- org.mockito:mockito-core 3.0.0 test
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.apache.beam:beam-sdks-java-io-mongodb
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.projectlombok:lombok 1.18.24 provided
- com.google.cloud:google-cloud-bigquery 1.128.3
- org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core
- org.apache.beam:beam-sdks-java-extensions-sql
- org.apache.beam:beam-sdks-java-io-google-cloud-platform
- org.apache.beam:beam-sdks-java-io-neo4j
- org.neo4j:neo4j-cypher-dsl 2022.4.0
- com.google.truth:truth 1.0.1 test
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.apache.beam:beam-sdks-java-io-splunk 2.38.0
- com.google.truth:truth 1.0.1 test
- junit:junit 4.13.1 test
v2/kafka-common/pom.xml
maven
- com.google.cloud.teleport.v2:kafka-common 1.0-SNAPSHOT
v2/kafka-to-gcs/pom.xml
maven
- com.google.cloud.teleport.v2:kafka-common 1.0-SNAPSHOT
- com.google.cloud.teleport.v2:kafka-common 1.0-SNAPSHOT
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.apache.beam:beam-sdks-java-io-kudu
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.apache.beam:beam-sdks-java-io-mongodb
v2/pom.xml
maven
- com.google.cloud:google-cloud-spanner-bom 6.23.3 import
- org.apache.beam:beam-sdks-java-bom 2.41.0 import
- com.google.auto.value:auto-value 1.7.4 provided
- com.google.api:gax 2.3.0
- com.google.api:gax-grpc 2.3.0
- com.google.auto.service:auto-service 1.0-rc6
- com.google.auto.value:auto-value-annotations 1.7.4
- com.google.re2j:re2j 1.5
- io.opencensus:opencensus-api 0.31.0
- org.apache.beam:beam-runners-direct-java
- org.apache.beam:beam-runners-google-cloud-dataflow-java
- org.apache.beam:beam-sdks-java-core
- org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core
- org.apache.beam:beam-sdks-java-io-google-cloud-platform
- org.apache.beam:beam-sdks-java-io-jdbc
- org.json:json 20200518
- org.slf4j:slf4j-simple 1.7.25
- com.google.cloud.teleport:integration-testing-lib 1.0-SNAPSHOT test
- junit:junit 4.13 test
- junit:junit-dep 4.10 test
- org.hamcrest:hamcrest 2.1 test
- org.hamcrest:hamcrest-core 2.1 test
- org.hamcrest:hamcrest-library 2.1 test
- org.mockito:mockito-core 3.0.0 test
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT
- com.google.guava:guava ${guava.version}
- com.google.truth:truth 1.0.1 test
- junit:junit 4.13.1 test
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT compile
- org.apache.beam:beam-sdks-java-io-mongodb
- com.github.vincentrussell:json-data-generator 1.10
- com.google.cloud.teleport.v2:common 1.0-SNAPSHOT
- org.yaml:snakeyaml 1.23
- com.google.truth:truth 1.0.1 test
- Copyright2020GoogleInc.AllRightsReserved. *
- LicensedundertheApacheLicense ,Version2.0
- SeetheLicenseforthespecificlanguagegoverningpermissionsand *
- Unlessrequiredbyapplicablelaworagreedtoinwriting ,software
- WITHOUTWARRANTIESORCONDITIONSOFANYKIND ,eitherexpressorimplied.
- YoumayobtainacopyoftheLicenseat *
- distributedundertheLicenseisdistributedonan *
- google-cloud *
- google-cloud-pubsub *
- limitationsundertheLicense. *
- youmaynotusethisfileexceptincompliancewiththeLicense. *