Comments (2)
Per Slack conversation with @aaronbuchwald Data Platform would archive HyperSDK payloads using a similar pattern we use now when we ingest our EVM based subnets into our Data Lake
It will depend on a subscriber based producer/consumer push pattern.
- parent consumer will subscribe to HyperSDK messages and push messages to a messaging stream, in this case Kafka
- child consumers will subscribe to HyperSDK Kafka topic for all payloads
from hypersdk.
Linking a few relevant issues here:
Export Block/Tx/State Diffs to External Store
I think the best way to support block/tx indexing is with this accepted subscriber pattern. Exporting state diffs would be a change from the current interface that we could optionally support if needed. Depending on the VM and use case, this may push a lot of data, so I'd prefer to export state diffs to an external store if the need arises rather than prioritizing it and changing the code to support it now.
If this is completed w/o exporting state diffs to an external store, we should open a new GitHub issue for state diffs as a potential future improvement.
Support S3 Archiver
This would be great to support. To avoid feature bloat in the HyperSDK, I'd prefer an S3 archiver implementation to be implemented as an external service to the HyperSDK using the gRPC Accepted Subscriber.
from hypersdk.
Related Issues (20)
- Add max-size to schema
- VM integration testing
- Example Action VMs - CFMM + NFTs HOT 1
- RPC Server Stops Responding Under Load
- Bug : Compact start is not less than end when running avalanchego HOT 3
- [DSMR] Chunk Storage + Signing
- [DSMR] Chunk Based Block Building and Verification
- [DSMR] Implement Pluggable Chunk -> Block Transformation
- [DSMR] Fortification - Guarantee Bandwidth Fee Payment for Replicated Transactions
- Re-Implement Vilmo POC
- [DSMR] Reproducible Load Test
- Wallet Support - MetaMask Snap + Core Support
- [Expand Customizability] Upgradeability Support
- Hashed Trie - Optional Hashed State Wrapper
- Account Abstraction
- Define and Implement Network Extensions
- Configurable Multi-Dimensional Fees
- Modularize Components
- HyperSDK <> EVM POC
- HyperSDK CLI - Initial Spec
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hypersdk.