mbostock / json-write

A stream-based serializer for JSON.

json-write

This module implements a stream-based JSON serializer. Whereas JSON.stringify tends to run out memory, this serializer can handle very large objects without creating massive strings in memory.

var jsonWrite = require("json-write");

var writer = jsonWrite();
writer.pipe(process.stdout);
writer.write({type: "Topology", objects: [1,2]});
writer.end({type: "Topology", objects: [1,2]});

Each object you writer.write is separated by a new line.

json-write's Issues

Prettify option?

Thank you for this library! It's saved me from JSON.stringify still running out of memory.

Would love to have an option for human-readable output, to achieve feature parity with JSON.stringify(). Would that be in scope? If not, I understand.

Does it work?

Well, not for me. :)

"use strict";

var fs = require('fs');
var jsonWrite = require("json-write");

var data = [];
for (var i = 0 ; i < 10000 ; i++) {
    data.push({"foo": "bar"});
}

var writer = jsonWrite();
writer.pipe(fs.createWriteStream('test.json', 'utf8'));
// writer.write(data);
writer.end(data);

The output is cut short after 16386 bytes, which incidentally is bufferSize plus a line break.