trustnote-org / rust-trustnote Goto Github PK

this is another independent small module that we can implment

this should be compatible with the getSourceString(obj) and then the result can be used to calc the hash of the object

rust struct and map should be corresponding to js obj
incompatible types like unit should return an error

ref #11

need all necessary crypto and hash functions and tests

add unit struct
add json serialization and deserialization support

ref #18

output log both to stdout and file

we need this module for the main_chain module

currently serde_json::Value object type is not sorted, need to find a way to serialize it into the correct order

support websocket infrastructure

implement network send_version

ref #40

impl get_connection() method from the pool

The Chash160 is used for the device address generation, we also need to validate the address.

Latest rust nightly version breaks the cargo test with an UB, because the generator library was corrupted by wrongly assembly output where the stack was polluted by function initial setup (rcx and rdx should not be saved on stack). this only affect the nightly debug version. the stable version and release version works fine.

I need to find a way to fix that, but seems really hard.

use config file that don't need to recompile

connect with hub via https and websocket
ref #40

we need to init secp256k1 in main thread to avoid too much stack consume, also the initialization could happen only once.

ref #18

we use actor module for network framework, each connection will have a receive coroutine associated with the actor running in back ground, when the actor got dropped, the coroutine would be killed

there are two types connections, inbound connection which is created from the the server and outbount connection which is created from the connect to outside. both connections has the same interface.

search connection from global by peer name and close it. when send returns an error or when receive mismatched connection, we need to close it explicitly.

ws and tls stream can't support clone, so we can't handle the receive things in separate coroutines. How to do that without clone/from_raw interface?

ws can use from_raw to create separate stream for reading. but tls stream doesn't have such interface.

ref #18

this is a big function, construct a joint from database, used widely by other modules

support sqlite for storing data

we need to finish all the following work to porting from trustnote js code! almost rewrite everything!

• others(utils and framework) 5%
• writer 5% (#14)
• storage 10% (#39)
• main_chain 5% (#59)
• validation 10% (#24)
• catch_up 10% (#18)
• graph 5% (#23)
• commission 5% (#25)
• joint storage 5% (#64)
• definition 5% (#126)
• compatible object serialization (#35)
• crypto,hashing, chash (#11, #21, #3)
• network 15% (#40)
• wallet related service (#238)
  composer 15% (#66) (wallet only)

@victor55511
we need to get a clear catch up procedure from the JS logic and translate it into rust logic.

• review the work process of JS code catch up
• purgeHandledBallsFromHashTree (#29)
• readHashTree (#32)
• processHashTree (#33)
• prepareCatchupChain (#30)
• processCatchupChain (#31)

here list some features that we are not supported and may implement in future

• only support payment definition
• not support private payment
• prepare catch up units for other hubs
• witness list is now fixed
• unit content_hash is empty (always a good unit)
• definition only support sig data_feed text
• not support multi sign
• not support wallet logic (composer)
• not support network self connection detection

this is a relatively small independent module that used by catch up

• prepareWitnessProof
• processWitnessProof

this is a relatively small module that can be ported to rust

• Compare units/unitProps ref #38
• determineIfIncluded #42
• readDescendantUnitsByAuthorsBeforeMcIndex #42
• UNUSED readDescendantUnitsBeforeLandingOnMc
• UNUSED readAscendantUnitsAfterTakingOffMc

need to refine Result to unify format, use failure or err_chain

ref #18

this is a track issue for the network implementation

• json rpc framework over websocket (#50)
• allow send messages to peers without feedback (#50)
• basic network utils and layer API (#50)
• replace actor implementation (#55)
• close connection if error (#53)
• record peer events (#74)
• heartbeat (#41, #57)
• send version (#52)
• hub/challenge (#60)
• subscribe (#61)
• concurrent joint request checking (#84)
• request_joints (#83)
• catchup (#92)
• hash_tree(#93)
• handle joint (#65)
• send_joints_since_mci (#96)
• checkCatchupLeftovers (#97)
• purgeJunkUnhandledJoints (#98)
• requestFreeJointsFromAllOutboundPeers (#99)
• refine catchup logic (#100)
• request lost joints (#103)
• findAndHandleJointsThatAreReady (#104)
• purge_joint_and_dependencies_and_notify_peers (#105)
• send_free_joint (#201)
• handle refresh message (#108)
  handleSavedPrivatePayments (#155)
  wss support (#49)
  rerouteble request (#72)
  implement actor communication framework (#51)

this should be equivalent to JS objectHash function

this would implement the writer.js module for rust, this is a big issue that covers a lot sql transactions that deal with unit save to sqlite database

ref #40

describe steps for setting up a hub server locally(on windows develop machine)
@victor55511 could you please help on this?

implement validateAuthorSignaturesWithoutReferences for witness proof

we need a way to wait for the actor closure completion and get the result

a small function that could be used practice

ref #24

this is a track issue that record some work we need to work

• read_witness_list
• read_unit_props
• read_static_unit_property
• read_unit_authors
• determine_if_witness_and_address_definition_have_refs
• read_joint_with_ball
• read_definition (#36)
• read_joint_directly (#34)
• read_porps_of_units(#77)
• read_definition_by_address (#36)
• read_last_stable_mc_unit_props (#106)
• is_genesis_ball (#124)
• determineBestParent (#135)
• determineIfHasWitnessListMutationsAlongMc (#134)

It should be compatible with the js implementation.

read witness from database and cached in a struct

the default rand crate use hc128 as default thread rng which cause stack overflow, need to use ChaCha as default rng generator, patch the Cargo.tom to replace the crate-io dependency.

this is a big work that need to port, evolve a lot of code, and maybe a lot of sub issues to track

• hasValidHashes (#28)
• validateAuthorSignaturesWithoutReferences (#37)
• initPrivatePaymentValidationState
• validatePayment
• validate (#67)

need to maintain a last receive message timestamp for each connection and if it's get bigger enough, send out the heartbeat to it. and if heartbeat times out, just close the connection

this is a relatively independent small module

part of #18

need to init database for basic info

actor model is not suitable for network operations, more complex for implementation and hard to parallel executions.

implement storage read_definition