databricks | Topic | Ecosyste.ms: Repos

Topic: "databricks"

getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Language: Python - Size: 27.5 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 27,712 - Forks: 4,510

cube-js/cube

📊 Cube’s universal semantic layer platform is the next evolution of OLAP technology for AI, BI, spreadsheets, and embedded analytics

Language: Rust - Size: 372 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 18,854 - Forks: 1,887

🏆 实时零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构 🏆 Real-Time coding-free, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and the returned JSON of API can be customized by Frontend(Client) users

Language: Java - Size: 70 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 18,150 - Forks: 2,250

databrickslabs/dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Language: Python - Size: 96.7 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 10,805 - Forks: 1,151

tobymao/sqlglot

Python SQL Parser and Transpiler

Language: Python - Size: 566 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 8,250 - Forks: 963

microsoft/SynapseML

Simple and Distributed Machine Learning

Language: Scala - Size: 161 MB - Last synced at: 5 days ago - Pushed at: 23 days ago - Stars: 5,160 - Forks: 852

delta-io/delta-rs

A native Rust library for Delta Lake, with bindings into Python

Language: Rust - Size: 22.1 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,923 - Forks: 514

databricks/dbrx

Code examples and resources for DBRX, a large language model developed by Databricks

Language: Python - Size: 63.5 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 2,571 - Forks: 244

dotnet/spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Language: C# - Size: 4.88 MB - Last synced at: 5 days ago - Pushed at: 2 months ago - Stars: 2,076 - Forks: 329

Multiwoven/multiwoven

🔥🔥🔥 Open source composable CDP - alternative to hightouch and census.

Language: Ruby - Size: 6.42 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 1,613 - Forks: 77

zinggAI/zingg

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Language: Java - Size: 679 MB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 1,076 - Forks: 136

Azure-Samples/modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

Language: Shell - Size: 120 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 657 - Forks: 506

databricks/mlops-stacks

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.

Language: Python - Size: 38.5 MB - Last synced at: 9 days ago - Pushed at: 30 days ago - Stars: 585 - Forks: 215

synmetrix/synmetrix

Synmetrix – production-ready open source semantic layer on Cube

Language: JavaScript - Size: 4.38 MB - Last synced at: about 23 hours ago - Pushed at: 7 months ago - Stars: 572 - Forks: 37

databricks/terraform-provider-databricks

Databricks Terraform Provider

Language: Go - Size: 84 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 531 - Forks: 450

databricks/databricks-sdk-py

Databricks SDK for Python (Beta)

Language: Python - Size: 14.3 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 476 - Forks: 160

databrickslabs/dbx

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

Language: Python - Size: 1.78 MB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 449 - Forks: 125

databrickslabs/dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

Language: Python - Size: 11.1 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 425 - Forks: 79

thoughtworks/mlops-platforms 📦

Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...

Size: 17.6 MB - Last synced at: 30 days ago - Pushed at: almost 3 years ago - Stars: 394 - Forks: 33

kruskal-labs/toolfront

Data retrieval for AI agents

Language: Python - Size: 1.6 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 371 - Forks: 31

databrickslabs/dqx

Databricks framework to validate Data Quality of pySpark DataFrames

Language: Python - Size: 2.95 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 309 - Forks: 59

microsoft/nutter

Testing framework for Databricks notebooks

Language: Python - Size: 208 KB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 308 - Forks: 44

dataflint/spark

Drop-in replacement for Apache Spark UI

Language: TypeScript - Size: 18.6 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 299 - Forks: 39

databricks/dbt-databricks

A dbt adapter for Databricks.

Language: Python - Size: 4.77 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 291 - Forks: 152

databrickslabs/ucx

Automated migrations to Unity Catalog

Language: Python - Size: 30.4 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 286 - Forks: 97

databricks/terraform-databricks-examples

Examples of using Terraform to deploy Databricks resources

Language: HCL - Size: 17.9 MB - Last synced at: 9 days ago - Pushed at: 14 days ago - Stars: 280 - Forks: 175

adidas/lakehouse-engine

The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.

Language: Python - Size: 8.79 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 256 - Forks: 45

Azure/azure-event-hubs-spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Language: Scala - Size: 19.6 MB - Last synced at: about 21 hours ago - Pushed at: 7 months ago - Stars: 238 - Forks: 179

databrickslabs/overwatch

Capture deep metrics on one or all assets within a Databricks workspace

Language: Scala - Size: 37.6 MB - Last synced at: 2 months ago - Pushed at: 10 months ago - Stars: 232 - Forks: 70

databricks/cli

Databricks CLI

Language: Go - Size: 47.9 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 230 - Forks: 107

databrickslabs/dlt-meta

Metadata driven Databricks Lakeflow Declarative Pipelines framework for bronze/silver pipelines

Language: Python - Size: 22.9 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 208 - Forks: 95

databricks/databricks-sql-python

Databricks SQL Connector for Python

Language: Python - Size: 4.18 MB - Last synced at: 9 days ago - Pushed at: 11 days ago - Stars: 206 - Forks: 120

Azure/azure-cosmosdb-spark 📦

Apache Spark Connector for Azure Cosmos DB

Size: 192 MB - Last synced at: about 21 hours ago - Pushed at: 6 months ago - Stars: 203 - Forks: 119

databrickslabs/cicd-templates 📦

Manage your Databricks deployments and CI with code.

Language: Python - Size: 604 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 201 - Forks: 102

CartoDB/analytics-toolbox-core

A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift, Postgres and Databricks with Spatial Analytics capabilities

Language: JavaScript - Size: 12.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 196 - Forks: 45

buremba/universql

Pushdown compute from Snowflake to DuckDB running on your infrastructure

Language: Jupyter Notebook - Size: 7.87 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 185 - Forks: 7

aloneguid/stowage

Bloat-free, no BS cloud storage SDK.

Language: C# - Size: 611 KB - Last synced at: 6 days ago - Pushed at: 7 months ago - Stars: 179 - Forks: 19

lamastex/scalable-data-science

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Language: HTML - Size: 1.24 GB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 168 - Forks: 93

alexott/databricks-nutter-repos-demo

Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline

Language: Python - Size: 470 KB - Last synced at: about 12 hours ago - Pushed at: about 1 year ago - Stars: 153 - Forks: 127

aehrc/VariantSpark

machine learning for genomic variants

Language: JavaScript - Size: 75.1 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 146 - Forks: 45

olonok69/LLM_Notebooks

Notebooks and Code about Generative Ai, LLMs, MLOPS, NLP , CV and Graph databases

Language: Jupyter Notebook - Size: 334 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 120 - Forks: 36

databrickslabs/lakebridge

Accelerates migrations to Databricks by automating key migration activities

Language: Python - Size: 302 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 105 - Forks: 64

databricks-solutions/databricks-apps-cookbook

Ready-to-use code snippets for building interactive Databricks Apps.

Language: Python - Size: 5.33 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 103 - Forks: 74

DataThirstLtd/azure.databricks.cicd.tools 📦

Tools for Deploying Databricks Solutions in Azure

Language: PowerShell - Size: 1.43 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 97 - Forks: 61

databrickslabs/pytester

Python Testing for Databricks

Language: Python - Size: 335 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 91 - Forks: 10

yokawasa/databricks-notebooks

Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )

Language: Jupyter Notebook - Size: 15.6 KB - Last synced at: 3 months ago - Pushed at: about 7 years ago - Stars: 89 - Forks: 76

Azure-Samples/azure-databricks-mlops-mlflow

Azure Databricks MLOps sample for Python based source code using MLflow without using MLflow Project.

Language: Jupyter Notebook - Size: 3.2 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 84 - Forks: 53

Azure/azure-databricks-client

Client library for Azure Databricks

Language: C# - Size: 566 KB - Last synced at: about 21 hours ago - Pushed at: about 2 months ago - Stars: 83 - Forks: 65

microsoft/dstoolkit-mlops-databricks

ML Ops Accelerator: Databricks & Azure Machine Learning Unification

Language: Python - Size: 82.2 MB - Last synced at: 5 days ago - Pushed at: about 1 year ago - Stars: 77 - Forks: 69

yueureka/WildFireDetection

Using U-Net Model to Detect Wildfire from Satellite Imagery

Language: HTML - Size: 62.5 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 76 - Forks: 33

lhbench/lhbench

Lakehouse storage system benchmark

Language: Scala - Size: 8.94 MB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 72 - Forks: 9

martandsingh/ApacheSpark

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.

Language: Python - Size: 141 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 71 - Forks: 47

databrickslabs/jupyterlab-integration 📦

DEPRECATED: Integrating Jupyter with Databricks via SSH

Language: HTML - Size: 46.5 MB - Last synced at: 22 days ago - Pushed at: about 3 years ago - Stars: 71 - Forks: 12

JohnSnowLabs/johnsnowlabs

Gateway into the John Snow Labs Ecosystem

Language: Python - Size: 1.66 GB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 70 - Forks: 26

BenChaliah/TimeSeriesGAN

GANs for Time series analysis (Synthetic data generation, anomaly detection and interpolation), Hypertuning using Optuna, MLFlow and Databricks

Language: Jupyter Notebook - Size: 1010 KB - Last synced at: 8 months ago - Pushed at: almost 3 years ago - Stars: 70 - Forks: 4

flmu/mlflow-tracking-server

MLFLow Tracking Server based on Docker and AWS S3

Language: Shell - Size: 52.7 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 68 - Forks: 20

alexott/databricks-playground

Code samples, etc. for Databricks

Language: Python - Size: 202 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 64 - Forks: 19

Amrit-Hub/Databricks-Certified-Data-Engineer-Associate-Questions

This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.

Size: 21.7 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 64 - Forks: 39

mullerpeter/databricks-grafana

Grafana Databricks integration allowing direct connection to Databricks to query and visualize Databricks data in Grafana.

Language: TypeScript - Size: 3.38 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 62 - Forks: 9

databricks/databricks-sdk-go

Databricks SDK for Go

Language: Go - Size: 32.8 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 61 - Forks: 52

starlake-ai/jsqltranspiler

Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data types and format characters) using Java.

Language: Java - Size: 12.6 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 60 - Forks: 6

tomaztk/Azure-Databricks

Azure Databricks - Advent of 2020 Blogposts

Language: Jupyter Notebook - Size: 44.9 MB - Last synced at: 5 months ago - Pushed at: almost 3 years ago - Stars: 60 - Forks: 49

crflynn/databricks-api 📦

A simplified, autogenerated API client interface using the databricks-cli package

Language: Python - Size: 103 KB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 59 - Forks: 15

viktoriasemaan/data-engineering

🚀 Advanced Data & AI Engineering Portfolio: Real-world projects and production-ready patterns to level up your AI skills—from building clean data pipelines to deploying RAG systems, AI agents, and intelligent dashboards.

Language: Jupyter Notebook - Size: 20.4 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 56 - Forks: 23

dotlas/databricks_helpers

🧱 A collection of supplementary utilities and helper notebooks to perform admin tasks on Databricks

Language: Jupyter Notebook - Size: 570 KB - Last synced at: 9 days ago - Pushed at: 2 months ago - Stars: 56 - Forks: 4

djouallah/Testing_BI_Engine

TPC-H_SF10

Language: Jupyter Notebook - Size: 1.32 MB - Last synced at: 6 days ago - Pushed at: 8 months ago - Stars: 53 - Forks: 17

bhavink/databricks

Databricks Platform - Architecture, Security, Automation and much more!!

Language: Jupyter Notebook - Size: 14.4 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 51 - Forks: 28

databrickslabs/blueprint

Baseline for Databricks Labs projects written in Python

Language: Python - Size: 3.07 MB - Last synced at: 6 days ago - Pushed at: about 1 month ago - Stars: 50 - Forks: 12

databricks/unity-catalog-setup

Notebooks, terraform, tools to enable setting up Unity Catalog

Size: 1.42 MB - Last synced at: 9 days ago - Pushed at: over 2 years ago - Stars: 49 - Forks: 32

souvik-databricks/dlt-with-debug

A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT run and Non-DLT interactive notebook run.

Language: Python - Size: 88.9 KB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 49 - Forks: 8

databricks/databricks-sdk-java

Databricks SDK for Java

Language: Java - Size: 9.78 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 46 - Forks: 31

inspera/blackbricks

Black for Databricks notebooks

Language: Python - Size: 282 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 45 - Forks: 9

databricks/databricks-sql-go

Golang database/sql driver for Databricks SQL.

Language: Go - Size: 2.57 MB - Last synced at: 9 days ago - Pushed at: 16 days ago - Stars: 44 - Forks: 47

rafaelpierre/pyjaws

PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows

Language: Python - Size: 3.46 MB - Last synced at: 9 days ago - Pushed at: 3 months ago - Stars: 43 - Forks: 4

PrefectHQ/prefect-databricks 📦

Prefect integrations for interacting with Databricks.

Language: Python - Size: 4.19 MB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 43 - Forks: 9

TatevKaren/free-resources-books-papers

Books and Papers in Mathematics, Econometrics, Machine Learning, Finance etc for different levels that can be useful for Data Scientists, Developers and everyone whoo is interesting in STEM.

Size: 79.8 MB - Last synced at: 3 months ago - Pushed at: over 4 years ago - Stars: 43 - Forks: 9

databrickslabs/sandbox

Experimental labs projects

Language: Python - Size: 28.6 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 42 - Forks: 31

osin-vladimir/architect_big_data_solutions_with_spark

code, labs and lectures for the course

Language: Jupyter Notebook - Size: 26.5 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 42 - Forks: 32

databrickslabs/delta-oms

DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-rc1 release.Documentation here - https://databrickslabs.github.io/delta-oms/v0.7.0-rc1/

Language: Scala - Size: 5.94 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 39 - Forks: 5

datamole-ai/pysparkdt

An open-source Python library for simplifying local testing of Databricks workflows that use PySpark and Delta tables.

Language: Python - Size: 48.8 KB - Last synced at: 16 days ago - Pushed at: 3 months ago - Stars: 38 - Forks: 1

getstrm/pace

Data policy IN, dynamic view OUT: PACE is the Policy As Code Engine. It helps you to programatically create and apply a data policy to a processing platform like Databricks, Snowflake or BigQuery (or plain 'ol Postgres, even!) with definitions imported from Collibra, Datahub, ODD and the like.

Language: Kotlin - Size: 13.2 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 36 - Forks: 1