rupurt / tif

Lightning fast tabular diffs, patches and merges for larger than memory datasets

Tif

Lightning fast tabular diffs, patches and merges for larger than memory datasets.

Usage

tif test/fixtures/people.csv test/fixtures/people_reverse.csv

tif
[-h] [-r <READBUFFER>] [-c <COLBUFFER>] [-m <MAXCOLUMNS>] <PATH1> <PATH1>

tif -h
    -h, --help
            Display this help and exit.

    -r, --readbuffer <READBUFFER>
            Number of bytes to use as a buffer. Default: 65536

    -c, --colbuffer <COLBUFFER>
            Number of bytes to use as a column buffer. Default: 4096

    -m, --maxcolumns <MAXCOLUMNS>
            Maximum number of columns in a record. Default: 512

    <PATH1>
            The base path

    <PATH1>
            The path to compare

How

tif produces differences over datasets by generating a literal, logical and physical layer for the given inputs.

Diffs are produced according to the Daff tabular diff specification.

Development

This project assumes you have already installed nix

1. Start a Nix devshell

nix develop -c $SHELL

2. Build and run with the zig toolchain

zig build run -- test/fixtures/people.csv test/fixtures/people_reverse.csv

License

tif is released under the MIT license