mycelial / mycelite

Mycelite is a SQLite extension that allows you to synchronize changes from one instance of SQLite to another.

What is Mycelial?

Mycelial is an open-source software solution that moves data from sources to destinations.

For example, consider an Edge Machine Learning application that stores its information in a local SQLite database.

So, how do you get the information off of your edge device and onto a system where the information can be analyzed?

Well, with Mycelial you can declaratively create data pipelines that move your data from a source system like SQLite, to a destination system like Snowflake.

How does it work?

There are two main components in Mycelial: daemons and a control plane. (Mycelial, Inc. offers a hosted control plane as well! See app.mycelial.com to sign up!)

The daemon is installed and executed on source and destination computers. These daemons will register with the control plane, and they will receive data pipeline specifications from the server.

The control plane offers you a way to set up data pipeline specifications, which move your data from one location to another via the installed daemons. You can set up these data pipelines via a drag-and-drop web interface, or you can add these pipelines via api calls.

Once you've installed Mycelial (daemon[s] and control plane), you can easily begin moving your data from source systems to destination systems of your choosing. Currently Mycelial has connectors for:

• Postgres
• SQLite
• MySQL
• Kafka
• Snowflake
• Amazon Redshift, and
• File streaming

How do I get started?

Follow our Tutorial to start using Mycelial from the command line.

Watch this short demo:

API

API documentation

Community

• Discord
• @mycelial
• Newsletter

License

Mycelial is available under the Apache 2 license.

mycelite's Issues

mycelite is now in the SQLite package registry

Hi! I've just added mycelial/mycelite to the package registry. It's now available on the website and via the CLI package manager.

No action is required on your part, just a quick heads up.

Thank you for this great extension!

sqlite wasm support?

I have a Chrome extension that uses PouchDB that I'd love to use Mycelite with instead. Are there any plans to support sqlite wasm for browsers?

quick-start page is 404

https://www.mycelial.com/docs/get-started/quick-start

is not available, where to find the documents?

Thanks.

[Question] Is the server portion of mycelite going to be open-sourced/available?

Will we be able to host our own synchronization server for mycelite? I am just looking into it, not a user yet, but would like to be able to host my own server instead of registering with mycelial if possible.

Attempting to write to a table in a reader instance leads to repeated error messages on subsequent valid queries.

I configured a reader as shown below and attempted to insert a new row.
The insert failed as expected, however, subsequent valid queries repeated the same error message.
I closed and reopened the read-only database, and I continue to receive errors Error: attempt to write to a read-only database
If I open the reader.db without our extension, I'm able to query the table.

sqlite> .load ./target/release/libmycelite 
sqlite> .open reader.db
sqlite> .load ./target/release/libmycelite mycelite_config
sqlite>  insert into mycelite_config values
    ('endpoint', 'https://us-east-1.mycelial.com'),
    ('domain', 'my-public-domain'),
    ('client_id', 'client_id'),
    ('secret', 'secret');
sqlite> select * from a;
name
-----
James
sqlite> insert into a(name) values ('John');
Runtime error: attempt to write a readonly database (8)
sqlite> select * from a;
Runtime error: attempt to write a readonly database (8)

LiteFS

Hi!
How does this compare to https://github.com/superfly/litefs? Is this multi-master?

Thanks

in production?

Hi, is this being used anywhere in production?
Thanks,
David Alm