Dan Rammer's Projects
In-memory, data sketch aligned HDFS implementation
Basic implementation of the pastry dht system
Benchmarking utility for the bitswap protocol in IPFS
Twitter API for rust
Hugo project for the brewing website
A utility communication library for rust
Distributed fuzzy matching application written in rust
Distributed string fuzzy matching application written in golang
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
A theme for the Hugo static website generation project
Distributed sketch-aligned, hdfs compliant file system
terminal program to bulk download from USGS Earth Engine
Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.
A cross platform CLI for Flyte. Written in Golang. Offers an intuitive interface to Flyte https://flytectl.readthedocs.io/en/latest/
Flyte at its core has a declarative, type-safe language for declaring data dependencies between arbitrary computation units. This repository contains the core specification of this language in the form of protocol-buffers.
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
Flyte Backend Plugins contributed by the Flyte community.
FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface
Flyte Examples, User-Guides and Tutorials - https://flytecookbook.readthedocs.io/en/latest/
A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage abstraction, caching etc
Distributed fuzzy matching DB
Rust bindings for GDAL
A generic geocoding library for rust.
IPFS cluster deployment using docker-compose
Implementation of HDFS communication protocols in rust.