Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / ismaildawoodjee / GreatEx
A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ismaildawoodjee%2FGreatEx
Stars: 20
Forks: 6
Open Issues: 1
License: None
Language: Python
Repo Size: 1.73 MB
Dependencies:
112
Created: almost 3 years ago
Updated: 4 months ago
Last pushed: over 1 year ago
Last synced: about 1 month ago
Topics: airflow, csv, data-engineering, data-pipeline, data-profiling, data-quality, docker, ecommerce, elt, etl, great-expectations, parquet, pipeline, postgres, python, sql
Files
Dependencies
- apache/airflow latest-python3.8 build
- black ==22.6.0
- fastparquet ==0.8.3
- great-expectations *
- pip-chill ==1.0.1
- psycopg2-binary ==2.9.3
- pyarrow ==9.0.0
- python-dotenv ==0.20.0
- sqlalchemy ==1.4.40
- Jinja2 ==3.1.2
- MarkupSafe ==2.1.1
- Pygments ==2.13.0
- SQLAlchemy ==1.4.40
- Send2Trash ==1.8.0
- altair ==4.2.0
- argon2-cffi ==21.3.0
- argon2-cffi-bindings ==21.2.0
- asttokens ==2.0.8
- attrs ==22.1.0
- backcall ==0.2.0
- beautifulsoup4 ==4.11.1
- black ==22.6.0
- bleach ==5.0.1
- certifi ==2022.6.15
- cffi ==1.15.1
- charset-normalizer ==2.1.1
- click ==8.1.3
- colorama ==0.4.5
- cramjam ==2.5.0
- cryptography ==37.0.4
- debugpy ==1.6.3
- decorator ==5.1.1
- defusedxml ==0.7.1
- entrypoints ==0.4
- executing ==1.0.0
- fastjsonschema ==2.16.1
- fastparquet ==0.8.3
- fsspec ==2022.7.1
- great-expectations ==0.15.20
- greenlet ==1.1.3
- idna ==3.3
- importlib-metadata ==4.12.0
- ipykernel ==6.15.2
- ipython ==8.4.0
- ipython-genutils ==0.2.0
- ipywidgets ==8.0.1
- jedi ==0.18.1
- jsonpatch ==1.32
- jsonpointer ==2.3
- jsonschema ==4.14.0
- jupyter-core ==4.11.1
- jupyter_client ==7.3.5
- jupyterlab-pygments ==0.2.2
- jupyterlab-widgets ==3.0.2
- lxml ==4.9.1
- makefun ==1.14.0
- matplotlib-inline ==0.1.6
- mistune ==2.0.4
- mypy-extensions ==0.4.3
- nbclient ==0.6.7
- nbconvert ==7.0.0
- nbformat ==5.4.0
- nest-asyncio ==1.5.5
- notebook ==6.4.12
- numpy ==1.23.2
- packaging ==21.3
- pandas ==1.4.3
- pandocfilters ==1.5.0
- parso ==0.8.3
- pathspec ==0.9.0
- pickleshare ==0.7.5
- pip-chill ==1.0.1
- platformdirs ==2.5.2
- prometheus-client ==0.14.1
- prompt-toolkit ==3.0.30
- psutil ==5.9.1
- psycopg2-binary ==2.9.3
- pure-eval ==0.2.2
- pyarrow ==9.0.0
- pycparser ==2.21
- pyparsing ==2.4.7
- pyrsistent ==0.18.1
- python-dateutil ==2.8.2
- python-dotenv ==0.20.0
- pytz ==2022.2.1
- pytz-deprecation-shim ==0.1.0.post0
- pywin32 ==304
- pywinpty ==2.0.7
- pyzmq ==23.2.1
- requests ==2.28.1
- ruamel.yaml ==0.17.17
- ruamel.yaml.clib ==0.2.6
- scipy ==1.9.1
- six ==1.16.0
- soupsieve ==2.3.2.post1
- stack-data ==0.5.0
- termcolor ==1.1.0
- terminado ==0.15.0
- tinycss2 ==1.1.1
- tomli ==2.0.1
- toolz ==0.12.0
- tornado ==6.2
- tqdm ==4.64.0
- traitlets ==5.3.0
- typing_extensions ==4.3.0
- tzdata ==2022.2
- tzlocal ==4.2
- urllib3 ==1.26.12
- wcwidth ==0.2.5
- webencodings ==0.5.1
- widgetsnbextension ==4.0.2
- zipp ==3.8.1