Comments (6)
Hey, thanks, this is a great idea. I think we have one major technical blocker atm which is that DuckDB doesn’t support triggers.
Are you aware of any mechanisms we can use to hook into writes / commits / transactions / a WAL or replication stream?
from electric.
I'm not super familiar with DuckDB — they do have a WAL apparently https://duckdb.org/docs/sql/statements/checkpoint.html
Thinking about this more — DuckDB would perhaps be best run alongside SQLite as a read-only copy as it's intended for analytics not transactional. Potentially this could just be a userland concern — load duckdb as needed for a feature and sync data from sqlite in.
from electric.
Interesting
from electric.
I'm lazy... what are they using for storage with their wasm build? This is the key issue for OLAP with wasm sqlite - IDB-based storage layers are slow, and OLAP is for "big data" (right?). The sync file handle layers are super fast, but in the browser require having the sqlite engine in a web worker. That introduces quite a bit of extra complexity, particularly surrounding concurrent access, etc.
from electric.
in 2021 at least on release they skipped on persistence — https://news.ycombinator.com/item?id=29039480 Not sure they've revisited it since
from electric.
Turning this issue into a feature request discussion
from electric.
Related Issues (20)
- client:generate error P1017 HOT 6
- error: "Field is already defined on model" when field has same name as table HOT 2
- Suggestion: better error message when electrifying table with missing primary key HOT 1
- Starting the electric sync service was confusing HOT 1
- Non-obvious connection string issue with generating client / better help needed HOT 2
- Weird documentation doing a React Native install
- PG_PROXY_URL not honored. Should be replaced with ELECTRIC_PROXY_URL HOT 2
- Prisma generator script not working in monorepos HOT 1
- when I exec npx electric-sql generate ,the console is blocking.
- Uncaught (in promise) TypeError: globalThis.uuid is not a function HOT 18
- Unable to pull docker image in supabase example HOT 2
- connecting to db in docker container fails on windows HOT 11
- Cannot read properties of undefined (reading 'numTables') thrown during electrification of Capacitor adapter HOT 2
- Insufficient privileges while connecting to supabase HOT 7
- Docker compose separator conflict HOT 4
- "iat" claim is invalid unless I add timeout HOT 2
- Electric mesh allows connection only in `replication=database` mode HOT 2
- Altering a table with existing data to add a jsonb column results in zod parse errors HOT 3
- Feature request: Dart support HOT 3
- query including referenced table errors sometimes HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from electric.