Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / saraivaufc / bigdata-docker

Run Hadoop Cluster within Docker Containers.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saraivaufc%2Fbigdata-docker

Stars: 14
Forks: 7
Open Issues: 11

License: other
Language: Shell
Repo Size: 600 KB
Dependencies: 130

Created: over 4 years ago
Updated: 10 months ago
Last pushed: over 1 year ago
Last synced: 8 months ago

Topics: docker, docker-compose, hadoop, hdfs, hive, hue, spark

Files

Readme

Dependencies

spark/requirements.txt pypi

Cython ==0.29.17
Fiona ==1.8.18
Jinja2 ==2.10.3
Keras-Applications ==1.0.8
Keras-Preprocessing ==1.1.0
Markdown ==3.1.1
MarkupSafe ==1.1.1
PyKrige ==1.5.1
PyYAML ==5.4.1
Pygments ==2.5.2
SecretStorage ==2.3.1
Send2Trash ==1.5.0
Shapely ==1.7.1
Werkzeug ==0.16.0
absl-py ==0.9.0
asn1crypto ==0.24.0
astor ==0.8.1
attrs ==19.3.0
backcall ==0.1.0
bleach ==3.1.0
cachetools ==4.0.0
certifi ==2019.11.28
chardet ==3.0.4
click ==7.1.2
click-plugins ==1.1.1
cligj ==0.7.1
cryptography ==2.1.4
cycler ==0.10.0
decorator ==4.4.1
defusedxml ==0.6.0
descartes ==1.1.0
entrypoints ==0.3
enum34 ==1.1.6
findspark ==1.4.2
gast ==0.2.2
geopandas ==0.8.1
google-auth ==1.10.0
google-auth-oauthlib ==0.4.1
google-pasta ==0.1.8
graphviz ==0.14.2
grpcio ==1.26.0
h5py ==2.10.0
idna ==2.6
importlib-metadata ==1.4.0
ipykernel ==5.1.3
ipython ==7.11.1
ipython-genutils ==0.2.0
ipywidgets ==7.5.1
jedi ==0.15.2
joblib ==1.0.1
jsonschema ==3.2.0
jupyter ==1.0.0
jupyter-client ==5.3.4
jupyter-console ==6.0.0
jupyter-core ==4.6.1
jupyter-http-over-ws ==0.0.7
keyring ==10.6.0
keyrings.alt ==3.0
kiwisolver ==1.1.0
matplotlib ==3.2.1
metakernel ==0.27.5
mistune ==0.8.4
more-itertools ==8.0.2
munch ==2.5.0
nbconvert ==5.6.1
nbformat ==5.0.3
notebook ==6.0.2
numpy ==1.18.0
oauthlib ==3.1.0
opencv-python ==4.4.0.46
opt-einsum ==3.1.0
pandas ==1.1.2
pandocfilters ==1.4.2
parso ==0.5.2
patsy ==0.5.1
pexpect ==4.7.0
pickleshare ==0.7.5
pmdarima ==1.7.1
prometheus-client ==0.7.1
prompt-toolkit ==2.0.10
protobuf ==3.11.2
ptyprocess ==0.6.0
py4j ==0.10.7
pyarrow ==1.0.1
pyasn1 ==0.4.8
pyasn1-modules ==0.2.8
pycrypto ==2.6.1
pydot ==1.4.1
pygobject ==3.26.1
pyparsing ==2.4.6
pyproj ==3.0.0.post1
pyrsistent ==0.15.7
pyspark ==2.4.4
python-apt ==1.6.4
python-dateutil ==2.8.1
pytz ==2021.1
pyxdg ==0.25
pyzmq ==18.1.1
qtconsole ==4.6.0
requests ==2.22.0
requests-oauthlib ==1.3.0
rsa ==4.0
scikit-image ==0.17.2
scikit-learn ==0.23.2
scipy ==1.4.1
seaborn ==0.10.1
six ==1.13.0
spylon ==0.3.0
spylon-kernel ==0.4.1
ssh-import-id ==5.7
statsmodels ==0.11.0
tensorflow-estimator ==2.1.0
tensorflow-gpu ==2.1.0
termcolor ==1.1.0
terminado ==0.8.3
testpath ==0.4.4
threadpoolctl ==2.1.0
tornado ==6.0.3
tqdm ==4.50.2
traitlets ==4.3.3
urllib3 ==1.25.7
wcwidth ==0.1.8
webencodings ==0.5.1
widgetsnbextension ==3.5.1
wrapt ==1.11.2
zipp ==0.6.0

hadoop/Dockerfile docker

ubuntu 18.04 build

kafka/Dockerfile docker

ubuntu 18.04 build

spark/Dockerfile docker

tensorflow/tensorflow latest-gpu-py3-jupyter build

zookeeper/Dockerfile docker

ubuntu 18.04 build