datatrekkers Goto Github PK

datatracer

Data Lineage Tracing Library

dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt-postgres-demo

A quick demo to play with dbt and Postgres.

deepmind-research

This repository contains implementations and illustrative code to accompany DeepMind publications

delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

devops-python-tools

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

dfply

dplyr-style piping operations for pandas dataframes

docarray

The data structure for unstructured data

examples

Apache Kafka and Confluent Platform examples and demos

free-programming-books

:books: Freely available programming books

hadoop-ebook

handson-ml2

A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.

intro_github_api_data_extraction

Preset the process of data extraction using GitHub API

json-schema-avro

Avro to JSON Schema, and back

json-to-avro-schema-generator

This will help you to generate AVRO schema from JSON schema.

jsonref

Automatically dereferences JSON references within a JSON document.

jsonschema

An(other) implementation of JSON Schema for Python

jsonschema2popo

Converts a JSON Schema to a Plain Old Python Object class

jupter-notebook-rest-api

Run your jupyter notebooks as a REST API endpoint. This isn't a jupyter server but rather just a way to run your notebooks as a REST API Endpoint.

kafka-streams-demo

koopa

Koopa (COBOL) Parser Generator

lakeview

lakeview is a visibility tool for S3 based data lakes

legstar.avro

A COBOL to Apache Avro translator

lyra

A Very Low-Bitrate Codec for Speech Compression

machine_learning_bookshelf

机器学习深度学习相关书籍、课件、代码的仓库。 Machine learning is the warehouse of books, courseware and codes.

ml_pocket_reference

Resources for Machine Learning Pocket Reference

mlguide

A centralized reference of courses, tutorials and articles related to machine learning

nessie-demos

Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.

notebook-to-microservice

nyc-taxi-data

Use this if you want to convert the nyc-taxi-data into a parquet format for use in Apache Spark