databrickslabs Goto Github PK

arcuate

Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)

automl-toolkit

Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Model selection and training, Hyper parameter optimization and selection, Model interprability.

blueprint

Baseline for Databricks Labs projects written in Python

cicd-templates

Manage your Databricks deployments and CI with code.

databricks-sdk-r

Databricks SDK for R (Experimental)

databricks-sync

An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.

dataframe-rules-engine

Extensible Rules Engine for custom Dataframe / Dataset validation

dbignite

dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

dbx

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

delta-oms

DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-rc1 release.Documentation here - https://databrickslabs.github.io/delta-oms/v0.7.0-rc1/

delta-sharing-java-connector

A Java connector for delta.io/sharing/ that allows you to easily ingest data on any JVM.

discoverx

A Swiss-Army-knife for your Data Intelligence platform administration.

dlt-meta

This is metadata driven DLT based framework for bronze/silver pipelines

doc-qa

dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

feature-factory

Accelerator to rapidly deploy customized features for your business

geoscan

Geospatial clustering at massive scale

jupyterlab-integration

DEPRECATED: Integrating Jupyter with Databricks via SSH

lsql

Lightweight SQL execution wrapper only on top of Databricks SDK

migrate

Old scripts for one-off ST-to-E2 migrations. Use "terraform exporter" linked in the readme.

mosaic

An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.

overwatch

Capture deep metrics on one or all assets within a Databricks workspace

partner-connect-api

pylint-plugin

Databricks Plugin for PyLint

remorph

Cross-compiler into Databricks Lakehouse

sandbox

Experimental or low-maturity things

smolder

HL7 Apache Spark Datasource

splunk-integration

Databricks Add-on for Splunk

tempo

API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation