Erigon - stucked block about bsc-archive-snapshot

[allada]

I have not had to restart my erigon node for a couple months, however twice a bug was found on the BSC chain that erigon patched and I had to do some work to fix. #14 is one of these cases. Since I use zfs I can create snapshots and upload them in the background with only having a few seconds of down time, if you took the time to modify erigon you could do this with near zero down time. This means that in the event of something going wrong on the node, I can easily roll back to the last version.

As for geth, don't under-estimate how expensive it is to run a full geth archive node. geth uses an insane amount of disk space and it takes a very long time to sync back up to latest blocks. I was spending around $1,000USD/mo to just run 1/16ish of the chain at a time and this was on spot instances (which are about 1/3 the price of normal AWS instances).

The big advantage to erigon is that it is able to work with a distributed database and you can have one node write to the database and many nodes read from it to serve the RPC requests. This significantly reduces the cost and improves throughput by orders of magnitude. The down side of erigon is that it is new and has bugs.

[mnguyen-io]

On another note - if you still maintain a copy of the BSC Geth snapshot, is it possible to get a copy? I recall there was a price so would like to know what that cost is as well. Thank you

[allada]

I actually found a bug when using --bad.block referenced here:
#14 (comment)

It might be best to wait until my new sync is done. I'd estimate ~1 week.

As for if I still have a copy of geth database, yes I do, but it's in deep-archive storage and hasn't been updated since ~mid December. The estimate on how much it will cost to transfer is fairly complex. There's about 25TB (IIRC). To restore the data in bulk will likely take multiple days (I'd count on 10 days) and cost around $100USD. To store the data outside of Deep Glacier storage will cost around $550USD. To transfer the data outside of the data center will cost around $2,250USD. (These estimates assume ~1 month of Standard storage while it is copied/transferred).

[mnguyen-io]

Thanks for the info @allada . Out of curiosity - how long has your BSC Erigon node been running for? Have you ever have to start from scratch again after having it working for X amount of time? Currently I would like to get it up as an alternative RPC service while Geth syncs which appears like it'll take a month or more

[mnguyen-io]

Closing this - not much to do here. I'll keep an eye out for your next snapshot. Appreciate all your work and effort