| OS | master |
Python support |
|---|---|---|
| 2.7, 3.4, 3.5, 3.6 | ||
| 2.7, 3.5, 3.6 | ||
| 3.5, 3.6 |
Visit docs.quiltdata.com. Or browse the docs on GitHub.
With Quilt you can build, push, and install data packages. Data packages are versioned, reusable data structures that can be loaded into Python. Quilt is designed to support reproducible, auditable, and compliant workflows.
Core features include:
- Versioning and storage of large data
- Transformation of a variety of file formats into data frames (via pandas and pyarrow)
- De-duplication of repeated data for reduced disk and network footprint
Here are the basic Quilt commands:
Quilt consists of three components:
-
- Displays package meta-data in HTML
-
- Controls permissions
- Stores pacakge fragments in blob storage
- Stores package meta-data
- De-duplicates repeated data fragments
-
- Serializes tabular data to Apache Parquet
- Transforms and parses files
builds packages locallypushes packages to the registrypulls packages from the registry

