allada / bsc-archive-snapshot Goto Github PK
View Code? Open in Web Editor NEWFree public Binance Smart Chain (BSC) Archive Snapshot
License: Apache License 2.0
bsc-archive-snapshot's People
Stargazers
Watchers
Forkers
jun0tpyrc enthusiastics dexeagle lzielonka tokenshive szichedelic kcyeu hikarishine whoami2323 systemquant ingvarch cryptofewka finnweiler quiknode-labs nehz bretep fesens debu976116 arieltm calmbeing superedison hughwang41 0xth0r ignas-gustainis rbiscio lyn4935bsc-archive-snapshot's Issues
Current version failure to download/run...
This is a known issue and a rebuild is in progress. It will likely take over a week to process as the last backup is from July
Download Issues
Hi,
I've tried to download the snapshot twice over the last couple of days and it's failed each time. The error message is the same (below) but at different points. The first time it failed at around 680GB, the second time was at 1.24TB. Do you have any ideas what this could be, please? Is there an issue with the file?
/stdin\ : Decoding error (36) : Corrupted block detected <=> ]
1.24TiB 20:22:22 [17.7MiB/s] [ <=> ]
tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
download failed: s3://public-blockchain-snapshots/bsc/erigon-latest.tar.zstd to - [Errno 32] Broken pipe
(HTTP 403) failed to download the s3 files
First of all, thank you very much for providing this project.
I'm running this script in region ap-southeast-1's EC2, and with AWS S3 configured. But it failed to download the files, the error code as below:
$ aws s3 ls --request-payer=requester s3://public-blockchain-snapshots/bsc/
An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied
$ export S3_BUCKET_PATH="s3://public-blockchain-snapshots"
$ aws s3 cp --request-payer=requester "$S3_BUCKET_PATH/support/zstd-v1.5.0-linux-x86.tar.gz" .
fatal error: An error occurred (403) when calling the HeadObject operation: ForbiddenCould you please help me to find out what's the problem?
Thanks a lot.
S3 folder structure possibly wrong
Hey, @allada thanks for your excellent work on this repo.
I've been using the GETH client for quite a long time, and it becomes harder to maintain due to its size.
I've been running some tests with Erigon for the past week and I need a full archival node with the whole chain data since the genesis block, and I thought about using your snapshot to speed thing up. However, I noticed something "wrong" with the s3 folder structure or maybe I'm misunderstanding something.
Within the s3://public-blockchain-snapshots/bsc/erigon/archive/latest/v1/nodes/ there are like 19 levels of /nodes under it. Is this really expected? I mean, there's like s3://public-blockchain-snapshots/bsc/erigon/archive/latest/v1/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/nodes/.
ETH vs BSC Archive Nodes`
We run a GETH archive node for ETH that is currently around 12TB. Is there something different about BSC that makes an archive node 30TB for BSC using GETH? It just seems so much larger I'd like to understand if there is something unique about BSC that makes it use twice the space. If you don't know then you can just close this issue. I appreciate your time and effort that you put into this project.
Script finishes with no errors at 568GB.
The script finishes and launches with no errors at 568GB, I noticed another person opened up a similar issue, but you said changes had been made since. I'm using the most up to date version of the repo, and am having the same issue as far as I can tell. When I re-run the bash script, it starts deleting the files. Thank you!
Sync slow
Hi @allada,
It takes 2 days but can not catchup to the latest blocks. Do you have any suggestions?
erigon_1 | [INFO] [11-12|16:08:04.971] [7/16 Execution] Executed blocks number=22978706 blk/s=2.1 tx/s=234.1 Mgas/s=30.1 gasState=0.15 batch=192.5MB alloc=3.1GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:08:23.074] [7/16 Execution] Executed blocks number=22978728 blk/s=1.2 tx/s=180.5 Mgas/s=21.8 gasState=0.15 batch=193.4MB alloc=3.3GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:08:43.412] [7/16 Execution] Executed blocks number=22978764 blk/s=1.8 tx/s=212.0 Mgas/s=25.4 gasState=0.15 batch=194.6MB alloc=3.5GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:09:03.094] [7/16 Execution] Executed blocks number=22978795 blk/s=1.6 tx/s=176.7 Mgas/s=25.3 gasState=0.15 batch=195.9MB alloc=3.7GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:09:23.249] [7/16 Execution] Executed blocks number=22978847 blk/s=2.6 tx/s=280.3 Mgas/s=34.6 gasState=0.15 batch=197.5MB alloc=4.0GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:09:43.442] [7/16 Execution] Executed blocks number=22978896 blk/s=2.4 tx/s=265.1 Mgas/s=33.1 gasState=0.15 batch=199.0MB alloc=4.3GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:10:03.030] [7/16 Execution] Executed blocks number=22978949 blk/s=2.7 tx/s=277.3 Mgas/s=32.5 gasState=0.15 batch=200.6MB alloc=3.1GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:10:04.196] [p2p] GoodPeers eth66=91
erigon_1 | [INFO] [11-12|16:10:23.159] [7/16 Execution] Executed blocks number=22979002 blk/s=2.6 tx/s=264.7 Mgas/s=32.4 gasState=0.15 batch=202.3MB alloc=3.4GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:10:43.320] [7/16 Execution] Executed blocks number=22979040 blk/s=1.9 tx/s=226.1 Mgas/s=28.0 gasState=0.15 batch=203.6MB alloc=3.8GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:11:02.982] [7/16 Execution] Executed blocks number=22979069 blk/s=1.5 tx/s=181.8 Mgas/s=23.9 gasState=0.15 batch=204.8MB alloc=4.0GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:11:23.067] [7/16 Execution] Executed blocks number=22979108 blk/s=1.9 tx/s=197.1 Mgas/s=28.2 gasState=0.16 batch=206.2MB alloc=4.2GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:11:44.505] [7/16 Execution] Executed blocks number=22979147 blk/s=1.8 tx/s=181.0 Mgas/s=27.1 gasState=0.16 batch=207.7MB alloc=4.5GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:12:04.196] [p2p] GoodPeers eth66=91
erigon_1 | [INFO] [11-12|16:12:05.067] [7/16 Execution] Executed blocks number=22979189 blk/s=2.0 tx/s=214.0 Mgas/s=29.2 gasState=0.16 batch=209.2MB alloc=3.3GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:12:23.257] [7/16 Execution] Executed blocks number=22979226 blk/s=2.0 tx/s=257.4 Mgas/s=31.6 gasState=0.16 batch=210.5MB alloc=3.5GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:12:46.150] [7/16 Execution] Executed blocks number=22979273 blk/s=2.1 tx/s=248.1 Mgas/s=33.1 gasState=0.16 batch=212.3MB alloc=3.8GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:13:03.174] [7/16 Execution] Executed blocks number=22979312 blk/s=2.3 tx/s=268.0 Mgas/s=34.5 gasState=0.16 batch=213.7MB alloc=4.0GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:13:23.197] [7/16 Execution] Executed blocks number=22979355 blk/s=2.1 tx/s=308.4 Mgas/s=37.8 gasState=0.16 batch=215.2MB alloc=4.4GB sys=8.1GB
erigon_1 | [INFO] [11-12|16:13:43.064] [7/16 Execution] Executed blocks number=22979395 blk/s=2.0 tx/s=228.8 Mgas/s=31.5 gasState=0.16 batch=216.8MB alloc=4.6GB sys=8.1GB
No space left on device
Great project
I run it on a fresh i3en.6xlarge us-west-2 machine
After some time I get this error.
tar: geth/chaindata/38841535.ldb: Cannot open: No space left on device
I believe this line gets the error.
bash -c "cd /$ZFS_NAME && aws s3 cp --request-payer=requester '$S3_BUCKET_PATH/bsc/$FILE_NAME' - | /zstd/zstd --long=30 -d | tar -xf -" &
When running df I get
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/root 8065444 2712964 5336096 34% /
devtmpfs 97838628 0 97838628 0% /dev
tmpfs 97844616 0 97844616 0% /dev/shm
tmpfs 19568924 940 19567984 1% /run
tmpfs 5120 0 5120 0% /run/lock
tmpfs 97844616 0 97844616 0% /sys/fs/cgroup
/dev/loop0 34176 34176 0 100% /snap/amazon-ssm-agent/3552
/dev/loop1 56832 56832 0 100% /snap/core18/1997
/dev/loop3 33152 33152 0 100% /snap/snapd/11588
/dev/loop2 72192 72192 0 100% /snap/lxd/19647
tmpfs 19568920 0 19568920 0% /run/user/1000
tank/zstd 23488 22848 640 98% /zstd
tank/geth 743712 743072 640 100% /geth
tank/0-4907901 523868192 523867552 640 100% /0-4907901
tank/10087707-10632706 914930816 914930176 640 100% /10087707-10632706
tank/4907773-5564225 741643680 741643040 640 100% /4907773-5564225
tank/5564098-6202903 760236960 760236320 640 100% /5564098-6202903
tank/6202776-6662396 810298784 810298144 640 100% /6202776-6662396
tank/6662388-6946919 865857088 865856448 640 100% /6662388-6946919
tank/6946792-7214799 821645536 821644896 640 100% /6946792-7214799
tank/7214671-7292199 412697408 412696768 640 100% /7214671-7292199
tank/7292185-7474200 859476416 859475776 640 100% /7292185-7474200
tank/7474189-7690956 793418336 793417696 640 100% /7474189-7690956
tank/7690829-7888146 663395168 663394528 640 100% /7690829-7888146
tank/7888019-8029402 573842816 573842176 640 100% /7888019-8029402
tank/8029385-8291918 779473856 779473216 640 100% /8029385-8291918
tank/8291791-8723634 938581920 938581280 640 100% /8291791-8723634
tank/8723507-9170062 945875616 945874976 640 100% /8723507-9170062
tank/9169935-9568990 927828576 927827936 640 100% /9169935-9568990
tank/9568861-9791958 918481536 918480896 640 100% /9568861-9791958
tank/9791831-10087834 920108384 920107744 640 100% /9791831-10087834
Any ideas on how to solve this?
fail to start bsc archive with new snapshot
I have download the ""s3://public-blockchain-snapshots/bsc/erigon-16k-db-latest.mdbx.zstd" this week and start a bsc erigon archve node . Then I started it with newest erigon code. I have not use "https://github.com/allada/bsc-archive-snapshot. " and the node started and download snapshot automaticly. After finished indexing , I meeted this error blow and got struck , the error is "No block headers to write in this log period":
then I unwind 1000 blocks and restart it :
but it has still meeted the same error and even got a fatal error with memory
download failed: Unable to locate credential
I tried to dowload but it's failed
+ git clone https://github.com/ledgerwatch/erigon.git
Cloning into 'erigon'...
remote: Enumerating objects: 157783, done.
remote: Counting objects: 100% (639/639), done.
remote: Compressing objects: 100% (359/359), done.
remote: Total 157783 (delta 373), reused 502 (delta 274), pack-reused 157144
Receiving objects: 100% (157783/157783), 214.77 MiB | 33.92 MiB/s, done.
Resolving deltas: 100% (114717/114717), done.
+ sed -i 's/command: erigon /command: erigon --chain bsc /g' /erigon/erigon/docker-compose.yml
+ zfs create -o mountpoint=/erigon/data/erigon tank/erigon_data
+ cd /erigon/data/erigon
+ aws s3 cp --request-payer=requester s3://public-blockchain-snapshots/bsc/erigon-latest.tar.zstd -
+ pv
+ /zstd/zstd --long=31 -d
+ tar -xf -
download failed: s3://public-blockchain-snapshots/bsc/erigon-latest.tar.zstd to - Unable to locate credentials
0.00 B 0:00:00 [0.00 B/s] [<=> ]
zstd: /*stdin*\: unexpected end of file
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
How to store 30TB in AWS EBS?
I see you metioned you store geth archive node for 30TB size.
I am interesting in how to store it in EBS, because AWS EBS gp2/gp3 only support 16TB at max.
I know io1 or io2 can support up to 64TB but they are too expensive.
Recover data to have only one geth node
Hello @allada,
Do you know if there is a way to use all the data you provide to create an unique full bsc archive node ?
Thanks
is it possible to split the archive over multiple servers?
Hello,
i like this repository. i have a two questions for now.
- Is it possible to run the split archives on different servers with 1 TB storage each?
- I would like to see the code for ENTRY_POINT="/geth/readonly.sh" and ENTRY_POINT="/geth/latest.sh", since i dont really know how to run geth so it doesnt sync anymore.
Docker running erigon mdbx_env_open permission denied
Hi,
i can't start erigon container from the docker-compose file with error message following this
err="mdbx_env_open: permission denied, label: chaindata, trace: [kv_mdbx.go:245 node.go:323 node.go:326 backend.go:156 node.go:121 node.go:112 main.go:41 app.go:526 app.go:286 main.go:28 proc.go:250 asm_arm64.s:1263]"
Does anyone know how to solve this ?
i'm using Centos 8 arm64.
is it still woking?
hi, it's two month later since you publish this repo, is it still working? As far as I know, quicknode have bsc archive node service, start at $259 per month, a little bit expensive...
AWS fatal error: Unable to locate credentials
Hey,
I'm new to AWS and just tried your script. However, the download for the parlia database fails with the error Unable to locate credentials.
When I run aws s3 ls it doesn't give back The AWS Access Key Id you provided does not exist in our records. So I'm guessing this command can find the keys.
I have created a new access key and plugged it in with aws configure. Is there any more steps I need to do?
Thanks in advance!
Procedure to create new latest
Hello,
Can you please share with us the procedure you do to stop the current latest, make it a "readonly" node, and start the new latest please ?
Many thanks
Archive node RPC as a service?
I need BSC archive node access with very low latency within us-west-2. I've already tested out a few BSC archive node providers available but none meets my requirements. I considered running my own node but the volume of requests I'm doing doesn't justify the running cost.
Is there any chance you offer your archive node as a paid service?
Can I download it for a fee
Can I download it for a fee？I want a compressed package of gz
Download failed
Hi,
I saw on another issue that if I only downloaded ~500-600 GB it meant something failed, so I went back in my logs and saw s3://public-blockchain-snapshots/bsc/parlia-db-latest.mdbx.zstd failed with "[Errno 32] Broken pipe." Would you by any chance know if that could be the source of the issue? Based on the code from build_archive_node.sh, this download doesn't seem to be necessary, but I'm running into other issues as well, which may be a result of this download failing. I'm using an EC2 instance in the us-west-2 region if that matters. Thanks!
On (probable) discontinuation of erigon support for BSC
Hi @allada! Thanks for maintaining erigon snapshots for BSC! Your scripts and data have been highly useful to us in setting up our own BSC nodes
Unfortunately, as per this article I came across recently, it seems erigon is soon about to drop support for BSC from their node. Wonder what's the right call here.. is it possible for you to update the script to go back to using geth archive nodes?
Thanks again for your community effort! Cheers
Failed to derive block receipts fields
Hi there,
Many thanks for the incredibly valuable work here!
When running getTransactionReceipt on transactions in blocks around 14794507 I am getting the following error in the erigon output:
[EROR] [02-24|15:36:10.630] Failed to derive block receipts fields hash=0x7cca3e99c68f0cda13ec1a1a48769cbf420c690f457d23677b0a1d8cb2bd83df number=14794507 err="transaction and receipt count mismatch, tx count = 276, receipts count = 275"
I am not getting this error for most recent blocks, and not getting it either for blocks prior to ~14500000
Any thoughts?
Documentation issues
Hi ... Erigon team here.
Hope you don't mind if I point out some inaccuracies found in your readme.
Erigon first stores the data of each wallet and contract in a flat key-value database (mdbx for default local db, but does support remote databases too)
Actually we don't support/implement any persistence engine other than MDBX. Though erigon is improving in building and torrent seeding snapshot files (plain binaries) their indexes and re-computed data are mantained on MDBX only.
The biggest problem with Erigon is that to my knowledge, it does not keep executing latest blocks as it gets them, instead it queues them up and batches them together.
That's not completely accurate. Erigon implements a sync cycle loop which aims to follow the tip of the chain just as any other client.
Let me explain.
Assume we're syncing a chain from scratch (archive mode):
- Erigon starts, initializes genesis block, and starts p2p
- Discovered peers (as well as dial-in ones) provide erigon with the number of highest block they have (say 10M)
- Erigon begins download headers and bodies up to block 10M (it might take hours) and when done ...
- All stages are invoked sequentially to execute all downloaded blocks, produce state changes, recompute Merkle root, build indexes (on this very first cycle it might take days or weeks on behalf of your hw capabilities - meanwhile the chain advances)
- At the end of first cycle Erigon goes to peers once again to check which is now the block number at the tip. Say the chain has advanced 500K blocks ...
- Erigon downloads all 500k block headers and bodies and starts a new cycle which, this time, has a span of 500k blocks instead of 10M hence its duration it will be considerably less (say 2 day - YMMV). Nontheless in the mean time the chain advances ...
- Once this second cycle has completed Erigon, once again, queries peers for the highest block of the chain at that very moment (say 10K blocks ahead) and once again downloads all block headers and bodies it does not have yet and start a new cycle ...
- [....]
- and on and on and on ....
It appears clear that after several cycles Erigon can reach the tip of the chain and as long as the instance is running on HW which is capable to complete a full cycle in less time then chain block time it will process one block by one block just pretty much like other clients. So actually a batch of blocks can be made of 1 block only and we don't stay behind the tip.
Obviously this description is over simplified and does not take into account snapshot sync, purging historical data, and, of course, whether erigon has RPCdaemon exposed to the internet to serve queries for remotes: this all have an impact on cycle's timings and db footprint. Worth to mention that ZFS compression add overhead to IO.
Hope this helps.
prune parmeters
Could you share your prune parmeters ?
When i run erigon based the snapshot, it indicates me wrong prune parmeters.
No peers
Not sure if this is an issue with the downloaded files or not but...
I can't get any peers...
Any idea what can I change in the configs to get peers?
I have TCP/UDP open on ports 30303 and 42069 on my AWS security group
Euler Upgrade
Hi,
Just wanted to check before downloading, do these snapshots work with the updated Erigon after this weeks hard fork? As I understand it, there is some re-syncing required after recent Erigon alpha upgrades.
Thanks for all of the work you do maintaining this!
Thanks
Scott
fatal error: An error occurred (404) when calling the HeadObject operation: Key "bsc/erigon-latest.tar.zstd" does not exist
When I execute this command from shell,
aws s3 cp --request-payer=requester "s3://public-blockchain-snapshots/bsc/erigon-latest.tar.zstd" erigon-latest.tar.zstd
the output is
fatal error: An error occurred (404) when calling the HeadObject operation: Key "bsc/erigon-latest.tar.zstd" does not exist
getting block not found for older blocks
Downloaded the latest v1 version two times and ran with Erigon's stable version. It took few hours and its now sync with latest block , however when i run older blocks, i get block not found error.
Sample Request
curl -X POST --header 'Content-Type: application/json' --data '[{"jsonrpc": "2.0", "method": "debug_traceBlockByNumber", "params": ["0xd2d985", {"tracer": "callTracer", "timeout": "600s"}], "id": 13818245}]' localhost:8545
Response
[{"jsonrpc":"2.0","id":13818245,"result":null,"error":{"code":-32000,"message":"invalid arguments; block with number 13818245 not found"}}]
Please advice.
Erigon - stucked block
Hi - have you run into this issue where erigon appears to be stuck at a single block? I tried to see if using --badblock would allow it to skip, but probably not the right way to do it.. and even still it doesn't work.
Mar 02 16:34:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:34:06.293] [p2p] GoodPeers eth66=38
Mar 02 16:34:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:34:06.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="579.18 MiB" sys="1.09 GiB"
Mar 02 16:34:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:34:36.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="709.26 MiB" sys="1.09 GiB"
Mar 02 16:35:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:35:06.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="854.67 MiB" sys="1.09 GiB"
Mar 02 16:35:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:35:36.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="543.80 MiB" sys="1.09 GiB"
Mar 02 16:36:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:36:06.293] [p2p] GoodPeers eth66=38
Mar 02 16:36:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:36:06.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="673.06 MiB" sys="1.09 GiB"
Mar 02 16:36:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:36:36.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="815.58 MiB" sys="1.09 GiB"
Mar 02 16:37:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:37:06.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="515.15 MiB" sys="1.09 GiB"
Mar 02 16:37:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:37:36.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="672.62 MiB" sys="1.09 GiB"
Mar 02 16:38:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:38:06.293] [p2p] GoodPeers eth66=38
Mar 02 16:38:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:38:06.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="820.81 MiB" sys="1.09 GiB"
Mar 02 16:38:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:38:36.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="530.59 MiB" sys="1.09 GiB"
Mar 02 16:39:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:39:06.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="653.44 MiB" sys="1.09 GiB"
Mar 02 16:39:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:39:36.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="785.85 MiB" sys="1.09 GiB"
Mar 02 16:40:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:40:06.293] [p2p] GoodPeers eth66=38
Mar 02 16:40:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:40:06.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="484.32 MiB" sys="1.09 GiB"
Mar 02 16:40:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:40:36.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="610.96 MiB" sys="1.09 GiB"
Mar 02 16:41:06 erigon-2022.02.04[4042435]: [INFO] [03-02|16:41:06.777] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="737.80 MiB" sys="1.09 GiB"
Mar 02 16:41:36 erigon-2022.02.04[4042435]: [INFO] [03-02|16:41:36.778] [1/16 Headers] Wrote block headers number=15597806 blk/second=0.000 alloc="872.93 MiB" sys="1.09 GiB"
Download snapshots failed
First of all, Thank you so much for sharing BSC snapshot.
Based on your bash script, I've tried to download snapshots but failed.
aws s3 sync --request-payer requester s3://public-blockchain-snapshots/bsc/erigon-snapshots-folder-latest/ ./snapshots/
Here is debug information
2022-11-09 06:49:15,078 - MainThread - botocore.httpsession - DEBUG - Certificate path: /usr/local/aws-cli/v2/2.8.10/dist/awscli/botocore/cacert.pem
2022-11-09 06:49:15,079 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): public-blockchain-snapshots.s3.us-west-2.amazonaws.com:443
2022-11-09 06:49:15,768 - MainThread - urllib3.connectionpool - DEBUG - https://public-blockchain-snapshots.s3.us-west-2.amazonaws.com:443 "GET /?list-type=2&prefix=bsc%2Ferigon-snapshots-folder-latest%2F&encoding-type=url HTTP/1.1" 200 None
2022-11-09 06:49:15,768 - MainThread - botocore.parsers - DEBUG - Response headers: {'x-amz-id-2': 'P1FotygX3k8f8GcEoYvW9+opBYqdpqaXY5sZeK1kNM279APSc/gzB9bz5Ah0NXJS1M1eTI8GYFY=', 'x-amz-request-id': 'XMPFC7C0HSNXXACR', 'Date': 'Wed, 09 Nov 2022 06:49:16 GMT', 'x-amz-request-charged': 'requester', 'x-amz-bucket-region': 'us-west-2', 'Content-Type': 'application/xml', 'Transfer-Encoding': 'chunked', 'Server': 'AmazonS3'}
2022-11-09 06:49:15,769 - MainThread - botocore.parsers - DEBUG - Response body:
b'<?xml version="1.0" encoding="UTF-8"?>\n<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>public-blockchain-snapshots</Name><Prefix>bsc/erigon-snapshots-folder-latest/</Prefix><KeyCount>0</KeyCount><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated></ListBucketResult>'
2022-11-09 06:49:15,769 - MainThread - botocore.hooks - DEBUG - Event needs-retry.s3.ListObjectsV2: calling handler <bound method RetryHandler.needs_retry of <botocore.retries.standard.RetryHandler object at 0x7fd466675310>>
2022-11-09 06:49:15,769 - MainThread - botocore.retries.standard - DEBUG - Not retrying request.
2022-11-09 06:49:15,769 - MainThread - botocore.hooks - DEBUG - Event needs-retry.s3.ListObjectsV2: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x7fd4666753a0>>
2022-11-09 06:49:15,769 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.ListObjectsV2: calling handler <function decode_list_object_v2 at 0x7fd46968eca0>
2022-11-09 06:49:15,769 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.ListObjectsV2: calling handler <function enhance_error_msg at 0x7fd4677fc700>
2022-11-09 06:49:15,769 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.ListObjectsV2: calling handler <bound method RetryQuotaChecker.release_retry_quota of <botocore.retries.standard.RetryQuotaChecker object at 0x7fd4666b9dc0>>
2022-11-09 06:49:15,770 - Thread-1 - awscli.customizations.s3.results - DEBUG - Shutdown request received in result processing thread, shutting down result thread.
Hole in the blockchain
Hello,
There is a little issue on the blockchain ranges provided.
As you can see here :
2021-09-07 18:10:29 1979381495977 10087707-10632706.tar.zstd
2021-10-09 17:19:21 2108037859898 10632717-11354478.tar.zstd
There is 11 blocks missing. We managed to correct that, by running the "10087707-10632706" node with the latest.toml file, in order to restart the synchronisation during some minutes, and recover the block missing.
Regards
how login account
Binance Smart Chain (BSC)
address 0x3a5f8bc460ded057cbcbec022a599642c3ca65d5
private key --redacted--
I just wanna know how login this account, my friend give it to me
BSC Erigon
Cloud you say what repo do you use to run erigon bsc node?
Problem when calling the ListObjectsV2 operation: Access Denied
aws s3 sync --request-payer requester s3://public-blockchain-snapshots/bsc/erigon-snapshots-folder-latest/ /erigon/data/bsc/snapshots/
fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied
Is the snapshot still being update until today ?
Hi thank you for this archive snapshot.. just wondering when did you last update the archive?
Always about 8 minutes behind the latest block
Hi allada, thank you for your great work, this library is very useful.
After I downloaded and ran it for 4 days, it seems to have caught up with the latest progress, but it is always about 8 minutes slower than the latest speed. What is the reason for this? The following is my configuration, hard disk, and machine load.
thanks again.
Machine: AWS m6a.4xlarge (16C 64G)
Hard disk: 6T, io2, IOPS: 25000
Filesystem Size Used Avail Use% Mounted on
/dev/root 194G 71G 124G 37% /
devtmpfs 31G 0 31G 0% /dev
tmpfs 31G 0 31G 0% /dev/shm
tmpfs 6.2G 936K 6.2G 1% /run
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 31G 0 31G 0% /sys/fs/cgroup
/dev/nvme0n1p15 105M 5.2M 100M 5% /boot/efi
tank/erigon_data 3.0T 128K 3.0T 1% /erigon/data
tank/erigon_data/bsc 3.0T 20M 3.0T 1% /erigon/data/bsc
tank/erigon_data/bsc/chaindata 5.2T 2.2T 3.0T 42% /erigon/data/bsc/chaindata
/dev/loop0 25M 25M 0 100% /snap/amazon-ssm-agent/6312
/dev/loop3 92M 92M 0 100% /snap/lxd/24061
/dev/loop1 56M 56M 0 100% /snap/core18/2632
/dev/loop2 92M 92M 0 100% /snap/lxd/23991
/dev/loop4 56M 56M 0 100% /snap/core18/2667
/dev/loop5 106M 106M 0 100% /snap/go/10008
/dev/loop6 64M 64M 0 100% /snap/core20/1695
/dev/loop7 64M 64M 0 100% /snap/core20/1778
/dev/loop8 50M 50M 0 100% /snap/snapd/17883
tank/erigon_data/bsc/snapshots 3.6T 594G 3.0T 17% /erigon/data/bsc/snapshots
tank/erigon_data/bsc/nodes 3.0T 50M 3.0T 1% /erigon/data/bsc/nodes
tank/erigon_data/bsc/parlia 3.0T 1.9M 3.0T 1% /erigon/data/bsc/parlia
tmpfs 6.2G 0 6.2G 0% /run/user/1000
Jan 3 06:21:52 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:21:52.698] [1/16 Snapshots] download finished time=19m41.666543214s
Jan 3 06:21:52 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:21:52.743] [Snapshots] Blocks Stat blocks=24367k indices=24367k alloc=4.4GB sys=6.2GB
Jan 3 06:21:52 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:21:52.756] [1/16 Snapshots] DONE in=19m41.732127741s
Jan 3 06:21:52 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:21:52.763] [2/16 Headers] Waiting for headers... from=24457372
Jan 3 06:21:58 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:21:58.829] [2/16 Headers] Processed highest inserted=24458158 age=2s
Jan 3 06:22:00 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:00.668] [5/16 Bodies] Processing bodies... from=24457372 to=24458158
Jan 3 06:22:03 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:03.532] [5/16 Bodies] Writing block bodies block_num=24457471 remaining=687 alloc=2.5GB sys=6.2GB
Jan 3 06:22:05 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:05.344] [5/16 Bodies] Writing block bodies block_num=24457760 remaining=398 alloc=2.6GB sys=6.2GB
Jan 3 06:22:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:08.268] [p2p] GoodPeers eth66=22 eth67=10
Jan 3 06:22:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:10.987] [txpool] stat block=24457372 pending=9525 baseFee=400 queued=11350 alloc=2.7GB sys=6.2GB
Jan 3 06:22:20 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:20.668] [5/16 Bodies] Downloading block bodies block_num=24457760 delivery/sec=636.7KB wasted/sec=0B remaining=397 delivered=527 alloc=2.7GB sys=6.2GB
Jan 3 06:22:32 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:32.275] [5/16 Bodies] Writing block bodies block_num=24457872 remaining=286 alloc=2.8GB sys=6.2GB
Jan 3 06:22:34 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:34.912] [5/16 Bodies] Writing block bodies block_num=24458158 remaining=0 alloc=2.9GB sys=6.2GB
Jan 3 06:22:34 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:34.918] [5/16 Bodies] Processed highest=24458158
Jan 3 06:22:34 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:34.918] [6/16 Senders] Started from=24457372 to=24458158
Jan 3 06:22:35 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:35.938] [7/16 Execution] Blocks execution from=24457372 to=24458158
Jan 3 06:22:56 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:22:56.050] [7/16 Execution] Executed blocks number=24457405 blk/s=1.6 tx/s=129.2 Mgas/s=15.0 gasState=0.00 batch=417.4KB alloc=3.2GB sys=6.2GB
Jan 3 06:23:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:23:10.987] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=11875 alloc=3.4GB sys=6.2GB
Jan 3 06:23:16 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:23:16.042] [7/16 Execution] Executed blocks number=24457459 blk/s=2.7 tx/s=223.5 Mgas/s=26.0 gasState=0.00 batch=1.3MB alloc=3.5GB sys=6.2GB
Jan 3 06:23:36 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:23:36.131] [7/16 Execution] Executed blocks number=24457517 blk/s=2.9 tx/s=248.4 Mgas/s=32.5 gasState=0.00 batch=2.5MB alloc=3.8GB sys=6.2GB
Jan 3 06:23:55 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:23:55.989] [7/16 Execution] Executed blocks number=24457582 blk/s=3.3 tx/s=326.1 Mgas/s=35.0 gasState=0.00 batch=3.9MB alloc=4.2GB sys=6.2GB
Jan 3 06:24:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:24:08.268] [p2p] GoodPeers eth66=22 eth67=9
Jan 3 06:24:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:24:10.987] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=12367 alloc=2.6GB sys=6.2GB
Jan 3 06:24:16 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:24:16.022] [7/16 Execution] Executed blocks number=24457652 blk/s=3.5 tx/s=326.6 Mgas/s=38.3 gasState=0.01 batch=5.5MB alloc=2.7GB sys=6.2GB
Jan 3 06:24:36 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:24:36.080] [7/16 Execution] Executed blocks number=24457726 blk/s=3.7 tx/s=342.2 Mgas/s=41.2 gasState=0.01 batch=7.2MB alloc=3.1GB sys=6.2GB
Jan 3 06:24:56 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:24:56.358] [7/16 Execution] Executed blocks number=24457797 blk/s=3.5 tx/s=376.3 Mgas/s=40.9 gasState=0.01 batch=9.2MB alloc=3.4GB sys=6.2GB
Jan 3 06:25:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:25:10.986] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=12845 alloc=3.7GB sys=6.2GB
Jan 3 06:25:16 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:25:16.068] [7/16 Execution] Executed blocks number=24457898 blk/s=5.1 tx/s=454.7 Mgas/s=49.2 gasState=0.01 batch=11.6MB alloc=3.9GB sys=6.2GB
Jan 3 06:25:36 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:25:36.128] [7/16 Execution] Executed blocks number=24457993 blk/s=4.7 tx/s=434.0 Mgas/s=52.0 gasState=0.01 batch=13.9MB alloc=4.3GB sys=6.2GB
Jan 3 06:25:56 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:25:56.105] [7/16 Execution] Executed blocks number=24458095 blk/s=5.1 tx/s=466.3 Mgas/s=53.3 gasState=0.01 batch=16.3MB alloc=2.6GB sys=6.2GB
Jan 3 06:26:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:26:08.268] [p2p] GoodPeers eth66=22 eth67=11
Jan 3 06:26:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:26:10.988] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=13289 alloc=2.9GB sys=6.2GB
Jan 3 06:27:12 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:27:12.981] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=13895 alloc=3.4GB sys=6.2GB
Jan 3 06:28:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:28:08.268] [p2p] GoodPeers eth66=22 eth67=11
Jan 3 06:28:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:28:10.989] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14408 alloc=2.5GB sys=6.2GB
Jan 3 06:28:53 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:28:53.597] [7/16 Execution] Completed on block=24458158
Jan 3 06:28:53 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:28:53.597] [7/16 Execution] DONE in=6m17.658812126s
Jan 3 06:28:53 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:28:53.597] [8/16 HashState] Promoting plain state from=24457372 to=24458158
Jan 3 06:28:53 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:28:53.597] [8/16 HashState] Incremental promotion from=24457372 to=24458158 codes=true csbucket=AccountChangeSet
Jan 3 06:29:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:29:10.985] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14476 alloc=2.9GB sys=6.2GB
Jan 3 06:29:12 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:29:12.492] [8/16 HashState] Incremental promotion from=24457372 to=24458158 codes=false csbucket=AccountChangeSet
Jan 3 06:29:42 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:29:42.939] [8/16 HashState] ETL [2/2] Loading into=HashedAccount current key=baba7dde...
Jan 3 06:29:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:29:54.172] [8/16 HashState] Incremental promotion from=24457372 to=24458158 codes=false csbucket=StorageChangeSet
Jan 3 06:30:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:30:08.268] [p2p] GoodPeers eth66=21 eth67=12
Jan 3 06:30:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:30:10.988] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14097 alloc=2.7GB sys=6.2GB
Jan 3 06:30:25 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:30:25.666] [8/16 HashState] ETL [2/2] Loading into=HashedStorage current key=61b0b202...
Jan 3 06:30:55 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:30:55.667] [8/16 HashState] ETL [2/2] Loading into=HashedStorage current key=be09a843...
Jan 3 06:31:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:31:10.985] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=13958 alloc=3.0GB sys=6.2GB
Jan 3 06:31:25 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:31:25.666] [8/16 HashState] ETL [2/2] Loading into=HashedStorage current key=e9dae3d7...
Jan 3 06:32:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:32:08.268] [p2p] GoodPeers eth66=21 eth67=12
Jan 3 06:32:12 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:32:12.548] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=13869 alloc=2.6GB sys=6.2GB
Jan 3 06:32:15 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:32:15.682] [8/16 HashState] ETL [2/2] Loading into=HashedStorage current key=f7b34df5...
Jan 3 06:33:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:33:10.988] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=13939 alloc=2.9GB sys=6.2GB
Jan 3 06:34:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:34:08.268] [p2p] GoodPeers eth66=21 eth67=13
Jan 3 06:34:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:34:10.990] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=13958 alloc=2.5GB sys=6.2GB
Jan 3 06:34:39 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:34:39.994] [8/16 HashState] DONE in=5m46.397453452s
Jan 3 06:34:40 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:34:39.998] [9/16 IntermediateHashes] Generating intermediate hashes from=24457372 to=24458158
Jan 3 06:35:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:35:10.989] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14169 alloc=3.2GB sys=6.2GB
Jan 3 06:35:18 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:35:18.298] [9/16 IntermediateHashes] Calculating Merkle root current key=26412c5a
Jan 3 06:35:48 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:35:48.229] [9/16 IntermediateHashes] Calculating Merkle root current key=5237fd11
Jan 3 06:36:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:36:08.268] [p2p] GoodPeers eth66=21 eth67=13
Jan 3 06:36:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:36:10.989] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14359 alloc=2.7GB sys=6.2GB
Jan 3 06:36:18 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:36:18.227] [9/16 IntermediateHashes] Calculating Merkle root current key=7dd48d8a
Jan 3 06:36:48 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:36:48.228] [9/16 IntermediateHashes] Calculating Merkle root current key=a966101e
Jan 3 06:37:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:37:10.984] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14701 alloc=3.3GB sys=6.2GB
Jan 3 06:37:18 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:37:18.263] [9/16 IntermediateHashes] Calculating Merkle root current key=ca4c29f3
Jan 3 06:37:49 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:37:49.566] [9/16 IntermediateHashes] Calculating Merkle root current key=dc19da14
Jan 3 06:38:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:38:08.268] [p2p] GoodPeers eth66=21 eth67=13
Jan 3 06:38:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:38:10.989] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=14995 alloc=2.8GB sys=6.2GB
Jan 3 06:38:28 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:38:28.858] [9/16 IntermediateHashes] Calculating Merkle root current key=e9dae3d7
Jan 3 06:38:48 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:38:48.393] [9/16 IntermediateHashes] Calculating Merkle root current key=fae0c21b
Jan 3 06:39:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:39:10.986] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=15352 alloc=3.5GB sys=6.4GB
Jan 3 06:39:52 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:39:52.876] [9/16 IntermediateHashes] ETL [2/2] Loading into=TrieStorage current key=e9dae3d7...
Jan 3 06:40:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:40:08.268] [p2p] GoodPeers eth66=22 eth67=15
Jan 3 06:40:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:40:10.988] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=15662 alloc=2.8GB sys=6.4GB
Jan 3 06:40:13 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:40:13.920] [9/16 IntermediateHashes] ETL [2/2] Loading into=TrieStorage current key=f7c451c1...
Jan 3 06:41:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:41:10.987] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=16016 alloc=3.1GB sys=6.4GB
Jan 3 06:42:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:42:08.268] [p2p] GoodPeers eth66=23 eth67=16
Jan 3 06:42:13 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:42:13.352] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=16393 alloc=2.6GB sys=6.4GB
Jan 3 06:42:38 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:42:38.779] [9/16 IntermediateHashes] DONE in=7m58.784472249s
Jan 3 06:42:40 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:42:40.108] [10/16 CallTraces] Pruned call trace intermediate table from=24367372 to=24368157
Jan 3 06:43:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:43:10.168] [10/16 CallTraces] ETL [2/2] Loading into=CallFromIndex current key=9d202543...
Jan 3 06:43:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:43:10.986] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=16714 alloc=3.2GB sys=6.4GB
Jan 3 06:43:59 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:43:59.348] [10/16 CallTraces] ETL [2/2] Loading into=CallToIndex current key=de5833f2...
Jan 3 06:44:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:44:08.268] [p2p] GoodPeers eth66=23 eth67=16
Jan 3 06:44:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:44:10.988] [txpool] stat block=24457372 pending=10000 baseFee=400 queued=17136 alloc=2.6GB sys=6.4GB
Jan 3 06:45:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:45:10.984] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=17643 alloc=2.9GB sys=6.4GB
Jan 3 06:45:18 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:45:18.563] [10/16 CallTraces] DONE in=2m39.784375453s
Jan 3 06:45:48 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:45:48.728] [11/16 AccountHistoryIndex] ETL [2/2] Loading into=AccountHistory current key=8d8a7874...
Jan 3 06:46:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:46:08.268] [p2p] GoodPeers eth66=22 eth67=17
Jan 3 06:46:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:46:10.988] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=18052 alloc=2.7GB sys=6.4GB
Jan 3 06:46:58 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:46:58.472] [11/16 AccountHistoryIndex] DONE in=1m39.908518247s
Jan 3 06:47:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:47:10.988] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=18495 alloc=3.3GB sys=6.4GB
Jan 3 06:47:29 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:47:29.166] [12/16 StorageHistoryIndex] ETL [2/2] Loading into=StorageHistory current key=3d24c455...
Jan 3 06:47:59 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:47:59.166] [12/16 StorageHistoryIndex] ETL [2/2] Loading into=StorageHistory current key=69c0e147...
Jan 3 06:48:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:48:08.269] [p2p] GoodPeers eth66=23 eth67=17
Jan 3 06:48:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:48:10.988] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=18924 alloc=2.7GB sys=6.4GB
Jan 3 06:48:29 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:48:29.167] [12/16 StorageHistoryIndex] ETL [2/2] Loading into=StorageHistory current key=cb5327ed...
Jan 3 06:49:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:49:10.987] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=19366 alloc=3.3GB sys=6.4GB
Jan 3 06:50:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:50:08.268] [p2p] GoodPeers eth66=23 eth67=17
Jan 3 06:50:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:50:10.991] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=19817 alloc=2.5GB sys=6.4GB
Jan 3 06:50:29 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:50:29.668] [12/16 StorageHistoryIndex] DONE in=3m31.196538553s
Jan 3 06:50:29 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:50:29.670] [13/16 LogIndex] processing from=24457373 to=24458158
Jan 3 06:51:02 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:51:02.159] [13/16 LogIndex] ETL [2/2] Loading into=LogTopicIndex current key=0000000000000000000000007841f74b1610f7e3972100d80bd7cc62445522fcffffffff
Jan 3 06:51:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:51:10.984] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=20257 alloc=3.4GB sys=6.4GB
Jan 3 06:51:32 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:51:32.160] [13/16 LogIndex] ETL [2/2] Loading into=LogTopicIndex current key=aecf2b0f...
Jan 3 06:52:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:52:08.268] [p2p] GoodPeers eth66=23 eth67=18
Jan 3 06:52:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:52:10.989] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=20712 alloc=2.5GB sys=6.4GB
Jan 3 06:52:37 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:52:37.569] [13/16 LogIndex] DONE in=2m7.90058645s
Jan 3 06:53:09 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:53:09.379] [14/16 TxLookup] ETL [2/2] Loading into=BlockTransactionLookup current key=895c1a8d...
Jan 3 06:53:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:53:10.986] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=21147 alloc=2.9GB sys=6.4GB
Jan 3 06:54:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:54:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 06:54:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:54:10.988] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=21594 alloc=2.5GB sys=6.4GB
Jan 3 06:54:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:54:24.211] [14/16 TxLookup] DONE in=1m46.64206727s
Jan 3 06:54:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:54:54.647] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23109567
Jan 3 06:55:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:55:10.987] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=22039 alloc=3.8GB sys=6.4GB
Jan 3 06:55:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:55:24.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23124879
Jan 3 06:55:46 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:55:46.314] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-4142195788
Jan 3 06:55:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:55:54.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23134080
Jan 3 06:56:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:56:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 06:56:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:56:10.994] [txpool] stat block=24457372 pending=9999 baseFee=401 queued=22437 alloc=5.1GB sys=6.4GB
Jan 3 06:56:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:56:24.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23148831
Jan 3 06:56:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:56:54.649] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23161762
Jan 3 06:57:07 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:57:07.959] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-2973863089
Jan 3 06:57:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:57:10.987] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=22911 alloc=2.9GB sys=6.4GB
Jan 3 06:57:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:57:24.646] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23173429
Jan 3 06:57:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:57:54.649] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23188871
Jan 3 06:58:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:58:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 06:58:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:58:10.990] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=23381 alloc=3.6GB sys=6.4GB
Jan 3 06:58:28 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:58:28.882] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-789703142
Jan 3 06:58:28 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:58:28.882] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23204243
Jan 3 06:58:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:58:54.651] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23216370
Jan 3 06:59:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:59:10.986] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=23867 alloc=3.9GB sys=6.4GB
Jan 3 06:59:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:59:24.647] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23229381
Jan 3 06:59:49 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:59:49.696] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-3672314657
Jan 3 06:59:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|06:59:54.647] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23241436
Jan 3 07:00:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:00:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 07:00:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:00:10.990] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=24303 alloc=4.3GB sys=6.4GB
Jan 3 07:00:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:00:24.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23254498
Jan 3 07:00:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:00:54.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23270617
Jan 3 07:01:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:01:08.586] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-2225178250
Jan 3 07:01:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:01:10.986] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=24746 alloc=4.7GB sys=6.4GB
Jan 3 07:01:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:01:24.645] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23279894
Jan 3 07:01:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:01:54.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23296980
Jan 3 07:02:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:02:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 07:02:13 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:02:13.106] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=25211 alloc=2.8GB sys=6.4GB
Jan 3 07:02:27 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:02:27.950] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-3783107950
Jan 3 07:02:27 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:02:27.951] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23306740
Jan 3 07:02:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:02:54.646] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23321037
Jan 3 07:03:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:03:10.987] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=25674 alloc=3.1GB sys=6.4GB
Jan 3 07:03:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:03:24.649] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23334054
Jan 3 07:03:40 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:03:40.095] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-1324586153
Jan 3 07:03:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:03:54.653] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23347964
Jan 3 07:04:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:04:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 07:04:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:04:10.990] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=26185 alloc=3.7GB sys=6.4GB
Jan 3 07:04:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:04:24.646] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23361008
Jan 3 07:04:56 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:04:56.807] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-601191886
Jan 3 07:04:56 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:04:56.808] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23375038
Jan 3 07:05:11 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:05:11.003] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=26713 alloc=4.1GB sys=6.4GB
Jan 3 07:05:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:05:24.649] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23387868
Jan 3 07:05:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:05:54.647] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23403202
Jan 3 07:06:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:06:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 07:06:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:06:10.992] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=27185 alloc=4.7GB sys=6.4GB
Jan 3 07:06:15 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:06:15.228] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-3171013491
Jan 3 07:06:24 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:06:24.646] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23414302
Jan 3 07:06:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:06:54.648] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23429583
Jan 3 07:07:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:07:10.987] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=27698 alloc=5.2GB sys=6.4GB
Jan 3 07:07:29 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:07:29.896] [14/16 TxLookup Prune] Flushed buffer file name=/erigon/data/bsc/temp/erigon-sortable-buf-527544467
Jan 3 07:07:29 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:07:29.897] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23443022
Jan 3 07:07:54 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:07:54.646] [14/16 TxLookup Prune] ETL [1/2] Extracting from=CanonicalHeader block=23452899
Jan 3 07:08:08 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:08:08.268] [p2p] GoodPeers eth66=22 eth67=18
Jan 3 07:08:10 ip-172-31-2-246 start_erigon_service.sh[863348]: [INFO] [01-03|07:08:10.991] [txpool] stat block=24457372 pending=10000 baseFee=401 queued=28199 alloc=2.9GB sys=6.4GB
Jan 2 12:42:40 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:42:40.633] [7/16 Execution] DONE in=2m34.335452766s
Jan 2 12:45:32 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:45:32.452] [8/16 HashState] DONE in=2m51.818444174s
Jan 2 12:50:51 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:50:51.813] [9/16 IntermediateHashes] DONE in=5m19.361166418s
Jan 2 12:52:37 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:52:37.664] [10/16 CallTraces] DONE in=1m45.850958712s
Jan 2 12:53:51 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:53:51.209] [11/16 AccountHistoryIndex] DONE in=1m13.545544291s
Jan 2 12:56:09 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:56:09.355] [12/16 StorageHistoryIndex] DONE in=2m18.145226263s
Jan 2 12:57:27 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:57:27.774] [13/16 LogIndex] DONE in=1m18.419903198s
Jan 2 12:58:34 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|12:58:34.948] [14/16 TxLookup] DONE in=1m7.173248414s
Jan 2 13:03:42 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:03:42.785] [7/16 Execution] DONE in=2m46.006918367s
Jan 2 13:06:58 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:06:58.668] [8/16 HashState] DONE in=3m15.883053892s
Jan 2 13:12:46 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:12:46.457] [9/16 IntermediateHashes] DONE in=5m47.788457599s
Jan 2 13:14:48 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:14:48.164] [10/16 CallTraces] DONE in=2m1.707804235s
Jan 2 13:16:21 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:16:21.810] [11/16 AccountHistoryIndex] DONE in=1m33.645485989s
Jan 2 13:18:32 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:18:32.811] [12/16 StorageHistoryIndex] DONE in=2m11.001428946s
Jan 2 13:19:53 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:19:53.156] [13/16 LogIndex] DONE in=1m20.344922563s
Jan 2 13:21:30 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:21:30.756] [14/16 TxLookup] DONE in=1m37.599948074s
Jan 2 13:26:14 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:26:14.450] [7/16 Execution] DONE in=2m39.364184603s
Jan 2 13:28:58 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:28:58.142] [8/16 HashState] DONE in=2m43.691381846s
Jan 2 13:34:14 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:34:14.758] [9/16 IntermediateHashes] DONE in=5m16.616331082s
Jan 2 13:35:53 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:35:53.917] [10/16 CallTraces] DONE in=1m39.159151165s
Jan 2 13:37:16 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:37:16.914] [11/16 AccountHistoryIndex] DONE in=1m22.997010398s
Jan 2 13:39:29 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:39:29.859] [12/16 StorageHistoryIndex] DONE in=2m12.944571702s
Jan 2 13:41:04 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:41:04.664] [13/16 LogIndex] DONE in=1m34.80493376s
Jan 2 13:42:12 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:42:12.932] [14/16 TxLookup] DONE in=1m8.26838707s
Jan 2 13:46:53 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:46:53.070] [7/16 Execution] DONE in=2m29.249416778s
Jan 2 13:49:31 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:49:31.743] [8/16 HashState] DONE in=2m38.672591082s
Jan 2 13:54:11 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:54:11.344] [9/16 IntermediateHashes] DONE in=4m39.600723235s
Jan 2 13:55:49 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:55:49.702] [10/16 CallTraces] DONE in=1m38.358609882s
Jan 2 13:56:56 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:56:56.376] [11/16 AccountHistoryIndex] DONE in=1m6.674123579s
Jan 2 13:59:12 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|13:59:12.799] [12/16 StorageHistoryIndex] DONE in=2m16.422410074s
Jan 2 14:00:43 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:00:43.135] [13/16 LogIndex] DONE in=1m30.336075276s
Jan 2 14:01:49 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:01:49.966] [14/16 TxLookup] DONE in=1m6.830613145s
Jan 2 14:06:19 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:06:19.516] [7/16 Execution] DONE in=2m21.598649891s
Jan 2 14:08:46 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:08:46.578] [8/16 HashState] DONE in=2m27.061387581s
Jan 2 14:14:03 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:14:03.505] [9/16 IntermediateHashes] DONE in=5m16.927175449s
Jan 2 14:15:27 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:15:27.659] [10/16 CallTraces] DONE in=1m24.153662553s
Jan 2 14:16:36 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:16:36.797] [11/16 AccountHistoryIndex] DONE in=1m9.138608008s
Jan 2 14:18:59 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:18:59.033] [12/16 StorageHistoryIndex] DONE in=2m22.235358259s
Jan 2 14:20:44 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:20:44.931] [13/16 LogIndex] DONE in=1m45.898320969s
Jan 2 14:21:52 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:21:52.053] [14/16 TxLookup] DONE in=1m7.122074972s
Jan 2 14:26:32 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:26:32.571] [7/16 Execution] DONE in=2m39.023211996s
Jan 2 14:29:13 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:29:13.236] [8/16 HashState] DONE in=2m40.665617426s
Jan 2 14:34:01 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:34:01.080] [9/16 IntermediateHashes] DONE in=4m47.843353075s
Jan 2 14:35:27 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:35:27.342] [10/16 CallTraces] DONE in=1m26.262276308s
Jan 2 14:36:30 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:36:30.249] [11/16 AccountHistoryIndex] DONE in=1m2.906917542s
Jan 2 14:38:34 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:38:34.304] [12/16 StorageHistoryIndex] DONE in=2m4.055286713s
Jan 2 14:40:01 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:40:01.400] [13/16 LogIndex] DONE in=1m27.095597647s
Jan 2 14:41:07 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:41:07.038] [14/16 TxLookup] DONE in=1m5.638507018s
Jan 2 14:45:16 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:45:16.591] [7/16 Execution] DONE in=2m18.049148411s
Jan 2 14:47:31 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:47:31.265] [8/16 HashState] DONE in=2m14.673487445s
Jan 2 14:51:48 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:51:48.512] [9/16 IntermediateHashes] DONE in=4m17.247517207s
Jan 2 14:53:14 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:53:14.176] [10/16 CallTraces] DONE in=1m25.663683846s
Jan 2 14:56:17 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:56:17.227] [12/16 StorageHistoryIndex] DONE in=2m5.152578621s
Jan 2 14:57:26 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|14:57:26.062] [13/16 LogIndex] DONE in=1m8.834722456s
Jan 2 15:02:27 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:02:27.093] [7/16 Execution] DONE in=2m11.158918499s
Jan 2 15:04:50 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:04:50.229] [8/16 HashState] DONE in=2m23.135851752s
Jan 2 15:09:41 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:09:41.830] [9/16 IntermediateHashes] DONE in=4m51.601519493s
Jan 2 15:11:02 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:11:02.826] [10/16 CallTraces] DONE in=1m20.995739285s
Jan 2 15:12:10 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:12:10.133] [11/16 AccountHistoryIndex] DONE in=1m7.306533915s
Jan 2 15:14:21 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:14:21.189] [12/16 StorageHistoryIndex] DONE in=2m11.056198282s
Jan 2 15:15:34 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:15:34.926] [13/16 LogIndex] DONE in=1m13.737537879s
Jan 2 15:21:54 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:21:54.718] [7/16 Execution] DONE in=2m47.010455098s
Jan 2 15:24:30 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:24:30.405] [8/16 HashState] DONE in=2m35.687204838s
Jan 2 15:29:22 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:29:22.419] [9/16 IntermediateHashes] DONE in=4m52.013924518s
Jan 2 15:30:37 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:30:37.794] [10/16 CallTraces] DONE in=1m15.374733852s
Jan 2 15:31:52 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:31:52.678] [11/16 AccountHistoryIndex] DONE in=1m14.884659769s
Jan 2 15:33:53 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:33:53.593] [12/16 StorageHistoryIndex] DONE in=2m0.914261966s
Jan 2 15:34:58 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:34:58.221] [13/16 LogIndex] DONE in=1m4.628837588s
Jan 2 15:39:39 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:39:39.375] [7/16 Execution] DONE in=1m56.77744119s
Jan 2 15:41:28 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:41:28.365] [8/16 HashState] DONE in=1m48.990106637s
Jan 2 15:45:05 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:45:05.332] [9/16 IntermediateHashes] DONE in=3m36.966936763s
Jan 2 15:46:15 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:46:15.310] [10/16 CallTraces] DONE in=1m9.978415845s
Jan 2 15:48:36 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:48:36.558] [12/16 StorageHistoryIndex] DONE in=1m31.285339237s
Jan 2 15:49:45 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:49:45.342] [13/16 LogIndex] DONE in=1m8.784279172s
Jan 2 15:53:28 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:53:28.723] [7/16 Execution] DONE in=1m33.560856104s
Jan 2 15:54:42 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:54:42.678] [8/16 HashState] DONE in=1m13.955254518s
Jan 2 15:57:21 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|15:57:21.218] [9/16 IntermediateHashes] DONE in=2m38.540538383s
Jan 2 16:00:03 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:00:03.646] [12/16 StorageHistoryIndex] DONE in=1m12.562723345s
Jan 2 16:04:00 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:04:00.774] [7/16 Execution] DONE in=1m14.488714501s
Jan 2 16:05:02 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:05:02.552] [8/16 HashState] DONE in=1m1.778296209s
Jan 2 16:07:00 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:07:00.828] [9/16 IntermediateHashes] DONE in=1m58.276093658s
Jan 2 16:14:27 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:14:27.637] [9/16 IntermediateHashes] DONE in=1m29.070740993s
Jan 2 16:23:36 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:23:36.360] [9/16 IntermediateHashes] DONE in=1m25.8123603s
Jan 2 16:26:02 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:26:02.594] [12/16 StorageHistoryIndex] DONE in=1m4.25723952s
Jan 2 16:32:35 ip-172-31-2-246 start_erigon_service.sh[407725]: [INFO] [01-02|16:32:35.043] [9/16 IntermediateHashes] DONE in=1m27.033404092s
Sync slower than other node
I have run following your spec requirement on AWS EC2 on im4gn.2xlarge in us-west-2 apart from OS, i'm using Centos8 after configurated everything following your script and run for 3 days the node is sync to almost latest block but it always slower than other node around 500 - 1000 block is it normally for an archive node?
The script stopped working
Hello. I ran the script as mentioned in readme, and the following is the output of the shell
cannot open 'tank': dataset does not exist
+ DEVICES=($(lsblk --fs --json | jq -r '.blockdevices[] | select(.children == null and .fstype == null) | .name'))
++ lsblk --fs --json
++ jq -r '.blockdevices[] | select(.children == null and .fstype == null) | .name'
+ DEVICES_FULLNAME=()
+ zpool create -o ashift=12 tank
missing vdev specification
usage:
create [-fnd] [-o property=value] ...
[-O file-system-property=value] ...
[-m mountpoint] [-R root] <pool> <vdev> ...
ubuntu@ip-172-31-7-63:~/bsc-archive-snapshot$ sudo ./build_archive_node.sh
+ [[ 0 -ne 0 ]]
+ cat
+ install_prereq
+ set -euxo pipefail
+ apt update
Hit:1 http://us-east-1.ec2.archive.ubuntu.com/ubuntu jammy InRelease
Hit:2 http://us-east-1.ec2.archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:3 http://us-east-1.ec2.archive.ubuntu.com/ubuntu jammy-backports InRelease
Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
25 packages can be upgraded. Run 'apt list --upgradable' to see them.
+ DEBIAN_FRONTEND=noninteractive
+ apt install -y zfsutils-linux unzip pv clang-12 make jq python3-boto3 super
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
jq is already the newest version (1.6-2.1ubuntu3).
make is already the newest version (4.3-4.1build1).
pv is already the newest version (1.6.6-1build2).
clang-12 is already the newest version (1:12.0.1-19ubuntu3).
python3-boto3 is already the newest version (1.20.34+dfsg-1).
super is already the newest version (3.30.3-2).
unzip is already the newest version (6.0-26ubuntu3.1).
zfsutils-linux is already the newest version (2.1.4-0ubuntu0.1).
0 upgraded, 0 newly installed, 0 to remove and 25 not upgraded.
++ which clang-12
+ ln -s /usr/bin/clang-12 /usr/bin/cc
ln: failed to create symbolic link '/usr/bin/cc': File exists
+ true
+ snap install --classic go
snap "go" is already installed, see 'snap help refresh'
+ cargo --version
./build_archive_node.sh: line 101: cargo: command not found
+ curl --proto =https --tlsv1.2 -sSf https://sh.rustup.rs
+ bash /dev/stdin -y
info: downloading installer
info: profile set to 'default'
info: default host triple is x86_64-unknown-linux-gnu
warning: Updating existing toolchain, profile choice will be ignored
info: syncing channel updates for 'stable-x86_64-unknown-linux-gnu'
info: default toolchain set to 'stable-x86_64-unknown-linux-gnu'
stable-x86_64-unknown-linux-gnu unchanged - rustc 1.66.0 (69f9c33d7 2022-12-12)
Rust is installed now. Great!
To get started you may need to restart your current shell.
This would reload your PATH environment variable to include
Cargo's bin directory ($HOME/.cargo/bin).
To configure your current shell, run:
source "$HOME/.cargo/env"
+ source /root/.cargo/env
++ case ":${PATH}:" in
++ export PATH=/root/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
++ PATH=/root/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
+ install_zstd
+ set -euxo pipefail
+ pzstd --help
+ install_aws_cli
+ set -euxo pipefail
+ aws --version
+ install_s3pcp
+ set -euxo pipefail
+ s3pcp --help
+ install_putils
+ safe_wait
+ set -euxo pipefail
+ BACKGROUND_PIDS=($(jobs -p))
+ psplit --help
+ install_erigon
+ set -euxo pipefail
+ erigon --help
++ jobs -p
+ for PID in "${BACKGROUND_PIDS[@]}"
+ wait -f 16635
Usage:
pzstd [args] [FILE(s)]
Parallel ZSTD options:
-p, --processes # : number of threads to use for (de)compression (default:<numcpus>)
ZSTD options:
-# : # compression level (1-19, default:<numcpus>)
-d, --decompress : decompression
-o file : result stored into `file` (only if 1 input file)
-f, --force : overwrite output without prompting, (de)compress links
--rm : remove source file(s) after successful (de)compression
-k, --keep : preserve source file(s) (default)
-h, --help : display help and exit
-V, --version : display version number and exit
-v, --verbose : verbose mode; specify multiple times to increase log level (default:2)
-q, --quiet : suppress warnings; specify twice to suppress errors too
-c, --stdout : force write to standard output, even if it is the console
-r : operate recursively on directories
--ultra : enable levels beyond 19, up to 22 (requires more memory)
psplit 0.1.0
Takes a file or stdin and splits it by -b bytes and sends them to the
OUTPUT_COMMAND in parallel limited by -p concurrent jobs.
Example:
$ printf '012345678901234567890123' | psplit -b 10 sh -c 'cat > /tmp/psplit_$SEQ; echo >>
/tmp/psplit_$SEQ'
Will result in 3 files:
/tmp/psplit_0 = "0123456789
"
/tmp/psplit_1 = "0123456789
"
/tmp/psplit_2 = "0123
"
USAGE:
psplit [OPTIONS] <OUTPUT_COMMAND>
ARGS:
<OUTPUT_COMMAND> Command to run on each output. An environmental variable "SEQ" will be
set containing the sequence number of the slice. Data will be sent to
stdin of command
OPTIONS:
-b, --bytes <BYTES>
Number of bytes per output file [default: 1073741824]
-h, --help
Print help information
-i, --input-file <INPUT_FILE>
Input file to split. If not set, uses stdin
-p, --parallel-count <PARALLEL_COUNT>
Number of commands allowed to run in parallel [default: 16]
-V, --version
Print version information
-C, --check : integrity check (default)
--no-check : no integrity check
-t, --test : test compressed file integrity
-- : all arguments after "--" are treated as files
+ pjoin --help
+ return
+ for PID in "${BACKGROUND_PIDS[@]}"
+ wait -f 16636
pjoin 0.1.0
Takes stdin commands split by new lines and executes them in parallel and
prints stdout in order based on the order they are in stdin.
Example:
$ pjoin <<'EOT'
sh -c 'printf foo; sleep 1'
printf bar
EOT
Will result in:
'foobar' (without quotes)
USAGE:
pjoin [OPTIONS] [OUTPUT_FILE]
ARGS:
<OUTPUT_FILE> Path to write file. Prints to stdout if not set. Using a file can be faster
than stdout
OPTIONS:
-b, --buffer-size <BUFFER_SIZE>
Size in bytes of the stdout buffer for reach command [default: 1073741824]
-h, --help
Print help information
-p, --parallel-count <PARALLEL_COUNT>
Number of commands to run in parallel [default: 16]
-V, --version
Print version information
Downloads data from s3 and sends it to stdout very fast and on a pinned version.
Many concurrent connections to s3 are opened and different chunks of the file
are downloaded in parallel and stiched together using the `pjoin` utility.
USAGE:
s3pcp [OPTIONS] [S3_PATH]
ARGS:
S3_PATH A path to an s3 object. Format: 's3://{bucket}/{key}'
OPTIONS:
--requester-pays
If the account downloading is requesting to be the payer for
the request.
--region <REGION>
The region the request should be sent to.
-p, --parallel-count <PARALLEL_COUNT>
Number of commands to run in parallel [default: based on computer resources]
-h, --help
Print help information
+ return
+ return
NAME:
erigon - erigon experimental cli
USAGE:
erigon [global options] command [command options] [arguments...]
VERSION:
2.31.0-stable-a53e8a3e
COMMANDS:
snapshots
help, h Shows a list of commands or help for one command
BLOCKCHAIN COMMANDS:
init Bootstrap and initialize a new genesis block
import Import a blockchain file
GLOBAL OPTIONS:
--datadir value Data directory for the databases (default: /root/.local/share/erigon)
--ethash.dagdir value Directory to store the ethash mining DAGs (default: /root/.local/share/erigon-ethash)
--snapshots Default: use snapshots "true" for BSC, Mainnet and Goerli. use snapshots "false" in all other cases (default: true)
--externalcl enables external consensus (default: false)
--txpool.disable experimental external pool and block producer, see ./cmd/txpool/readme.md for more info. Disabling internal txpool and block producer. (default: false)
--txpool.locals value Comma separated accounts to treat as locals (no flush, priority inclusion)
--txpool.nolocals Disables price exemptions for locally submitted transactions (default: false)
--txpool.pricelimit value Minimum gas price (fee cap) limit to enforce for acceptance into the pool (default: 1)
--txpool.pricebump value Price bump percentage to replace an already existing transaction (default: 10)
--txpool.accountslots value Minimum number of executable transaction slots guaranteed per account (default: 16)
--txpool.globalslots value Maximum number of executable transaction slots for all accounts (default: 10000)
--txpool.globalbasefeeslots value Maximum number of non-executable transactions where only not enough baseFee (default: 30000)
--txpool.accountqueue value Maximum number of non-executable transaction slots permitted per account (default: 64)
--txpool.globalqueue value Maximum number of non-executable transaction slots for all accounts (default: 30000)
--txpool.lifetime value Maximum amount of time non-executable transaction are queued (default: 3h0m0s)
--txpool.trace.senders value Comma separared list of addresses, whoes transactions will traced in transaction pool with debug printing
--prune value Choose which ancient data delete from DB:
h - prune history (ChangeSets, HistoryIndices - used by historical state access, like eth_getStorageAt, eth_getBalanceAt, debug_traceTransaction, trace_block, trace_transaction, etc.)
r - prune receipts (Receipts, Logs, LogTopicIndex, LogAddressIndex - used by eth_getLogs and similar RPC methods)
t - prune transaction by it's hash index
c - prune call traces (used by trace_filter method)
Does delete data older than 90K blocks, --prune=h is shortcut for: --prune.h.older=90000.
Similarly, --prune=t is shortcut for: --prune.t.older=90000 and --prune=c is shortcut for: --prune.c.older=90000.
However, --prune=r means to prune receipts before the Beacon Chain genesis (Consensus Layer might need receipts after that).
If an item is NOT on the list - means NO pruning for this data.
Example: --prune=htc (default: "disabled")
--prune.h.older value Prune data older than this number of blocks from the tip of the chain (if --prune flag has 'h', then default is 90K) (default: 0)
--prune.r.older value Prune data older than this number of blocks from the tip of the chain (default: 0)
--prune.t.older value Prune data older than this number of blocks from the tip of the chain (if --prune flag has 't', then default is 90K) (default: 0)
--prune.c.older value Prune data older than this number of blocks from the tip of the chain (if --prune flag has 'c', then default is 90K) (default: 0)
--prune.h.before value Prune data before this block (default: 0)
--prune.r.before value Prune data before this block (default: 0)
--prune.t.before value Prune data before this block (default: 0)
--prune.c.before value Prune data before this block (default: 0)
--batchSize value Batch size for the execution stage (default: "256M")
--blockDownloaderWindow value Outstanding limit of block bodies being downloaded (default: 32768)
--database.verbosity value Enabling internal db logs. Very high verbosity levels may require recompile db. Default: 2, means warning. (default: 2)
--private.api.addr value private api network address, for example: 127.0.0.1:9090, empty string means not to start the listener. do not expose to public network. serves remote database interface (default: "127.0.0.1:9090")
--private.api.ratelimit value Amount of requests server handle simultaneously - requests over this limit will wait. Increase it - if clients see 'request timeout' while server load is low - it means your 'hot data' is small or have much RAM. (default: 31872)
--etl.bufferSize value Buffer size for ETL operations. (default: "256MB")
--tls Enable TLS handshake (default: false)
--tls.cert value Specify certificate
--tls.key value Specify key file
--tls.cacert value Specify certificate authority
--state.stream.disable Disable streaming of state changes from core to RPC daemon (default: false)
--sync.loop.throttle value Sets the minimum time between sync loop starts (e.g. 1h30m, default is none)
--bad.block value Marks block with given hex string as bad and forces initial reorg before normal staged sync
--http HTTP-RPC server (enabled by default). Use --http=false to disable it (default: true)
--http.addr value HTTP-RPC server listening interface (default: "localhost")
--http.port value HTTP-RPC server listening port (default: 8545)
--authrpc.addr value HTTP-RPC server listening interface for the Engine API (default: "localhost")
--authrpc.port value HTTP-RPC server listening port for the Engine API (default: 8551)
--authrpc.jwtsecret value Path to the token that ensures safe connection between CL and EL
--http.compression Enable compression over HTTP-RPC (default: false)
--http.corsdomain value Comma separated list of domains from which to accept cross origin requests (browser enforced)
--http.vhosts value Comma separated list of virtual hostnames from which to accept requests (server enforced). Accepts '*' wildcard. (default: "localhost")
--authrpc.vhosts value Comma separated list of virtual hostnames from which to accept Engine API requests (server enforced). Accepts '*' wildcard. (default: "localhost")
--http.api value API's offered over the HTTP-RPC interface (default: "eth,erigon,engine")
--ws Enable the WS-RPC server (default: false)
--ws.compression Enable compression over WebSocket (default: false)
--http.trace Trace HTTP requests with INFO level (default: false)
--state.cache value Amount of data to store in StateCache (enabled if no --datadir set). Set 0 to disable StateCache. Defaults to 0MB (default: "0MB")
--rpc.batch.concurrency value Does limit amount of goroutines to process 1 batch request. Means 1 bach request can't overload server. 1 batch still can have unlimited amount of request (default: 2)
--rpc.streaming.disable Erigon has enalbed json streaming for some heavy endpoints (like trace_*). It's treadoff: greatly reduce amount of RAM (in some cases from 30GB to 30mb), but it produce invalid json format if error happened in the middle of streaming (because json is not streaming-friendly format) (default: false)
--db.read.concurrency value Does limit amount of parallel db reads. Default: equal to GOMAXPROCS (or number of CPU) (default: 64)
--rpc.accessList value Specify granular (method-by-method) API allowlist
--trace.compat Bug for bug compatibility with OE for trace_ routines (default: false)
--rpc.gascap value Sets a cap on gas that can be used in eth_call/estimateGas (default: 50000000)
--txpool.api.addr value txpool api network address, for example: 127.0.0.1:9090 (default: use value of --private.api.addr)
--trace.maxtraces value Sets a limit on traces that can be returned in trace_filter (default: 200)
--http.timeouts.read value Maximum duration for reading the entire request, including the body. (default: 30s)
--http.timeouts.write value Maximum duration before timing out writes of the response. It is reset whenever a new request's header is read. (default: 30m0s)
--http.timeouts.idle value Maximum amount of time to wait for the next request when keep-alives are enabled. If http.timeouts.idle is zero, the value of http.timeouts.read is used. (default: 2m0s)
--authrpc.timeouts.read value Maximum duration for reading the entire request, including the body. (default: 30s)
--authrpc.timeouts.write value Maximum duration before timing out writes of the response. It is reset whenever a new request's header is read. (default: 30m0s)
--authrpc.timeouts.idle value Maximum amount of time to wait for the next request when keep-alives are enabled. If authrpc.timeouts.idle is zero, the value of authrpc.timeouts.read is used. (default: 2m0s)
--rpc.evmtimeout value Maximum amount of time to wait for the answer from EVM call. (default: 5m0s)
--snap.keepblocks Keep ancient blocks in db (useful for debug) (default: false)
--snap.stop Workaround to stop producing new snapshots, if you meet some snapshots-related critical bug (default: false)
--db.pagesize value set mdbx pagesize on db creation: must be power of 2 and '256b <= pagesize <= 64kb'. default: equal to OperationSystem's pageSize (default: "4KB")
--torrent.port value port to listen and serve BitTorrent protocol (default: 42069)
--torrent.maxpeers value unused parameter (reserved for future use) (default: 100)
--torrent.conns.perfile value connections per file (default: 10)
--torrent.download.slots value amount of files to download in parallel. If network has enough seeders 1-3 slot enough, if network has lack of seeders increase to 5-7 (too big value will slow down everything). (default: 3)
--torrent.upload.rate value bytes per second, example: 32mb (default: "4mb")
--torrent.download.rate value bytes per second, example: 32mb (default: "16mb")
--torrent.verbosity value 0=silent, 1=error, 2=warn, 3=info, 4=debug, 5=detail (must set --verbosity to equal or higher level and has defeault: 3) (default: 2)
--port value Network listening port (default: 30303)
--p2p.protocol value [ --p2p.protocol value ] Version of eth p2p protocol (default: 66, 67)
--nat value NAT port mapping mechanism (any|none|upnp|pmp|stun|extip:<IP>)
"" or "none" default - do not nat
"extip:77.12.33.4" will assume the local machine is reachable on the given IP
"any" uses the first auto-detected mechanism
"upnp" uses the Universal Plug and Play protocol
"pmp" uses NAT-PMP with an auto-detected gateway address
"pmp:192.168.0.1" uses NAT-PMP with the given gateway address
"stun" uses STUN to detect an external IP using a default server
"stun:<server>" uses STUN to detect an external IP using the given server (host:port)
--nodiscover Disables the peer discovery mechanism (manual peer addition) (default: false)
--v5disc Enables the experimental RLPx V5 (Topic Discovery) mechanism (default: false)
--netrestrict value Restricts network communication to the given IP networks (CIDR masks)
--nodekey value P2P node key file
--nodekeyhex value P2P node key as hex (for testing)
--discovery.dns value Sets DNS discovery entry points (use "" to disable DNS)
--bootnodes value Comma separated enode URLs for P2P discovery bootstrap
--staticpeers value Comma separated enode URLs to connect to
--trustedpeers value Comma separated enode URLs which are always allowed to connect, even above the peer limit
--maxpeers value Maximum number of network peers (network disabled if set to 0) (default: 100)
--chain value Name of the testnet to join (default: "mainnet")
--dev.period value Block period to use in developer mode (0 = mine only if transaction pending) (default: 0)
--vmdebug Record information useful for VM and contract debugging (default: false)
--networkid value Explicitly set network id (integer)(For testnets: use --chain <testnet_name> instead) (default: 1)
--fakepow Disables proof-of-work verification (default: false)
--gpo.blocks value Number of recent blocks to check for gas prices (default: 20)
--gpo.percentile value Suggested gas price is the given percentile of a set of recent transaction gas prices (default: 60)
--allow-insecure-unlock Allow insecure account unlocking when account-related RPCs are exposed by http (default: false)
--metrics Enable metrics collection and reporting (default: false)
--metrics.addr value Enable stand-alone metrics HTTP server listening interface (default: "127.0.0.1")
--metrics.port value Metrics HTTP server listening port (default: 6060)
--experimental.history.v3 (also known as Erigon3) Not recommended yet: Can't change this flag after node creation. New DB and Snapshots format of history allows: parallel blocks execution, get state as of given transaction without executing whole block. (default: false)
--identity value Custom node name
--clique.checkpoint value number of blocks after which to save the vote snapshot to the database (default: 10)
--clique.snapshots value number of recent vote snapshots to keep in memory (default: 1024)
--clique.signatures value number of recent block signatures to keep in memory (default: 16384)
--clique.datadir value a path to clique db folder
--watch-the-burn Enable WatchTheBurn stage to keep track of ETH issuance (default: false)
--mine Enable mining (default: false)
--proposer.disable Disables PoS proposer (default: false)
--miner.notify value Comma separated HTTP URL list to notify of new work packages
--miner.gaslimit value Target gas limit for mined blocks (default: 30000000)
--miner.etherbase value Public address for block mining rewards (default: "0")
--miner.extradata value Block extra data set by the miner (default = client version)
--miner.noverify Disable remote sealing verification (default: false)
--miner.sigfile value Private key to sign blocks with
--sentry.api.addr value comma separated sentry addresses '<host>:<port>,<host>:<port>'
--sentry.log-peer-info Log detailed peer info when a peer connects or disconnects. Enable to integrate with observer. (default: false)
--downloader.api.addr value downloader address '<host>:<port>'
--no-downloader to disable downloader component (default: false)
--downloader.verify verify snapshots on startup. it will not report founded problems but just re-download broken pieces (default: false)
--healthcheck Enable grpc health check (default: false)
--bor.heimdall value URL of Heimdall service (default: "http://localhost:1317")
--bor.withoutheimdall Run without Heimdall service (for testing purpose) (default: false)
--ethstats value Reporting URL of a ethstats service (nodename:secret@host:port)
--override.terminaltotaldifficulty value Manually specify TerminalTotalDifficulty, overriding the bundled setting (default: 0)
--override.mergeNetsplitBlock value Manually specify FORK_NEXT_VALUE (see EIP-3675), overriding the bundled setting (default: 0)
--config value Sets erigon flags from YAML/TOML file
--log.console.verbosity value Set the log level for console logs (default: "info")
--log.dir.verbosity value Set the log verbosity for logs stored to disk (default: "dbug")
--log.dir.path value Path to store user and error logs to disk
--log.console.json Format console logs with JSON (default: false)
--log.json Format console logs with JSON (default: false)
--log.dir.json Format file logs with JSON (default: false)
--lightclient.discovery.addr value Address for lightclient DISCV5 protocol (default: "127.0.0.1")
--lightclient.discovery.port value Port for lightclient DISCV5 protocol (default: 4000)
--lightclient.discovery.tcpport value TCP Port for lightclient DISCV5 protocol (default: 4001)
--sentinel.addr value Address for sentinel (default: "localhost")
--sentinel.port value Port for sentinel (default: 7777)
--pprof Enable the pprof HTTP server (default: false)
--pprof.addr value pprof HTTP server listening interface (default: "127.0.0.1")
--pprof.port value pprof HTTP server listening port (default: 6060)
--pprof.cpuprofile value Write CPU profile to the given file
--trace value Write execution trace to the given file
--help, -h show help (default: false)
--version, -v print the version (default: false)
+ return
aws-cli/2.9.8 Python/3.9.11 Linux/5.15.0-1026-aws exe/x86_64.ubuntu.22 prompt/off
+ return
+ for PID in "${BACKGROUND_PIDS[@]}"
+ wait -f 16637
+ for PID in "${BACKGROUND_PIDS[@]}"
+ wait -f 16639
+ for PID in "${BACKGROUND_PIDS[@]}"
+ wait -f 16641
+ [[ '' == \1 ]]
+ setup_drives
+ set -euxo pipefail
+ zfs list tank
cannot open 'tank': dataset does not exist
+ DEVICES=($(lsblk --fs --json | jq -r '.blockdevices[] | select(.children == null and .fstype == null) | .name'))
++ lsblk --fs --json
++ jq -r '.blockdevices[] | select(.children == null and .fstype == null) | .name'
+ DEVICES_FULLNAME=()
+ zpool create -o ashift=12 tank
missing vdev specification
usage:
create [-fnd] [-o property=value] ...
[-O file-system-property=value] ...
[-m mountpoint] [-R root] <pool> <vdev> ...
```
Empty file after downloading erigon-bsc-archive
Hi, I tried two ways to download erigon bsc archive snapshot in this repo, but enountered two problems accordingly, can I know why?
-
I run as your this comment ledgerwatch/erigon#5703 (comment) using
aws s3 --request-payer=requester sync s3://public-blockchain-snapshots/bsc/erigon-snapshots-folder-latest/ ./snap, but as the image below, the snap directory is empty after running this command.
-
I used
aws s3 --request-payer=requester sync s3://public-blockchain-snapshots/bsc/erigon/archive/latest/v1/snapshots/ ./testas the command in your .sh file, but saying like(AccessDenied) when calling the GetObject operation: Access Deniedas below image
can it run with --db.pagesize=8kb ?
the mdbx should be consistent with the config of pagesize , so this tarball is done with --db.pagesize=8kb or --db.pagesize=4kb ? if it is runned with 4kb , I am afraid that the data can not be run with flag --db.pagesize=8kb
PS : I did not use your script to run it , I have run node with below command and it works well for 10+ hours,
./erigon --chain=bsc --datadir /server/archive --snap.keepblocks --db.pagesize=8kb
Slow synchronization
Hello, I downloaded the snapshot yesterday. The synchronization speed was very fast at first, but it was slow after a period of time. The machine was configured according to the recommended configuration. 'exec erigon --chain bsc --snapshots=true --db.pagesize=16k --datadir=/erigon/data/bsc --txpool.disable --http -- HTTP. Addr "0.0.0.0" - HTTP. API "web3 eth,.net, admin, debug, txpool" '
It was synchronized in the same way before, and there was no slow synchronization problem before
Mar 15 03:20:02 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:20:02.623] [7/16 Execution] Executed blocks number=25946797 blk/s=9.3 tx/s=1808.8 Mgas/s=229.6 gasState=0.17 batch=192.9MB alloc=3.7GB sys=5.8GB Mar 15 03:20:22 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:20:22.607] [7/16 Execution] Executed blocks number=25947019 blk/s=11.1 tx/s=1875.1 Mgas/s=239.0 gasState=0.18 batch=202.6MB alloc=3.0GB sys=5.8GB Mar 15 03:20:42 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:20:42.618] [7/16 Execution] Executed blocks number=25947254 blk/s=11.7 tx/s=2037.2 Mgas/s=236.2 gasState=0.19 batch=212.3MB alloc=4.5GB sys=5.8GB Mar 15 03:21:02 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:21:02.654] [7/16 Execution] Executed blocks number=25947495 blk/s=12.0 tx/s=1922.4 Mgas/s=244.0 gasState=0.20 batch=222.2MB alloc=3.4GB sys=5.8GB Mar 15 03:21:22 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:21:22.596] [7/16 Execution] Executed blocks number=25947731 blk/s=11.8 tx/s=2021.7 Mgas/s=248.1 gasState=0.21 batch=232.5MB alloc=2.8GB sys=5.9GB Mar 15 03:21:42 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:21:42.645] [7/16 Execution] Executed blocks number=25947873 blk/s=7.1 tx/s=1375.5 Mgas/s=177.0 gasState=0.21 batch=240.1MB alloc=4.1GB sys=5.9GB Mar 15 03:21:49 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:21:49.324] [p2p] GoodPeers eth66=14 eth67=5 Mar 15 03:22:02 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:22:02.624] [7/16 Execution] Executed blocks number=25948101 blk/s=11.4 tx/s=1971.3 Mgas/s=243.6 gasState=0.22 batch=250.7MB alloc=3.1GB sys=5.9GB Mar 15 03:22:12 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:22:12.827] Committed State gas reached=124787624522 gasTarget=549755813888 Mar 15 03:23:01 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:23:01.944] [] ETL [2/2] Loading into=PlainState current key=1f474b74... Mar 15 03:23:27 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:23:27.819] [] ETL [2/2] Loading into=PlainState current key=2af55ab3... Mar 15 03:23:49 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:23:49.324] [p2p] GoodPeers eth66=14 eth67=6 Mar 15 03:24:01 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:24:01.417] [] ETL [2/2] Loading into=PlainState current key=3d24c455... Mar 15 03:24:34 ip-172-31-2-38 start_erigon_service.sh[1591536]: [INFO] [03-15|03:24:34.187] [] ETL [2/2] Loading into=PlainState current key=55d39832...
Database version upgrade
The daily archive snapshots will be postponed a bit due to erigon updating their database schema. It will require rebuilding the database, which will likely take a few days.
support xfs
can you supply xfs snapshot instead zfs? we have not used zfs in our machine
How to use this data to deploy a bsc archive node in geth
Hello.I created an ec2 server with i3en.6xlarge configuration in aws according to your suggestion, downloaded all the files from s3://public-blockchain-snapshots/bsc/ and unzipped them, and got 18 data directories, and then I tried to add Block 0-4907901 as geth's data directory and started as an archive node, it can work normally, which is good, but I don't know how to make geth can use all 18 data directories at the same time, can you give me Some suggestions? thank you very much
Erigon stuck at [6/15 Execution] Blocks execution
After snapshot download, on first run of Erigon, it gets stuck in execution stage.
No execution stage status messages
Tried using Im4gn.4xlarge and i3en.3xlarge (Both using zfs as recommended in the script)
Ctrl+C does not exit Erigon. Instead, need to press several times for panic.
Output:
root@ip-172-31-63-1:/home/ubuntu# erigon --chain=bsc --datadir=/media/datadir/datadir --metrics --metrics.addr=0.0.0.0 --metrics.port=6060 --private.api.addr=0.0.0.0:9090 --http.api=eth,erigon,web3,net,debug,trace,txpool --ws --pprof --p
prof.addr=0.0.0.0 --pprof.port=6061 --snapshots=true --db.pagesize=16k
INFO[09-05|07:33:11.513] Starting metrics server addr=http://0.0.0.0:6060/debug/metrics/prometheus
INFO[09-05|07:33:11.513] Starting pprof server cpu="go tool pprof -lines -http=: http://0.0.0.0:6061/debug/pprof/profile?seconds=20" heap="go tool pprof -lines -http=: http://0.0.0.0:6061/debug/pprof/heap"
INFO[09-05|07:33:11.513] Build info git_branch=alpha git_tag=v2021.10.03-1804-g4067b7c4d git_commit=4067b7c4da6c5d741d3027d95ae2afdf6b7a943a
INFO[09-05|07:33:11.513] Starting Erigon on BSC mainnet...
INFO[09-05|07:33:11.517] Maximum peer count ETH=100 total=100
INFO[09-05|07:33:11.517] starting HTTP APIs APIs=eth,erigon,web3,net,debug,trace,txpool
INFO[09-05|07:33:11.517] torrent verbosity level=WRN
INFO[09-05|07:33:13.618] Set global gas cap cap=50000000
INFO[09-05|07:33:13.623] Opening Database label=chaindata path=/media/datadir/datadir/chaindata
INFO[09-05|07:33:13.636] Initialised chain configuration config="{ChainID: 56 Ramanujan: 0, Niels: 0, MirrorSync: 5184000, Bruno: 13082000, Euler: 18907621, Engine: parlia}" genesis=0x0d21840abff46b96c84b2ac9e10e4f5cdaeb5693cb66
5db62a2f3b02d2d57b5b
INFO[09-05|07:33:13.636] Effective prune_flags= snapshot_flags="--snapshots=true" history.v2=false
INFO[09-05|07:33:15.183] Initialising Ethereum protocol network=56
INFO[09-05|07:33:17.026] Starting private RPC server on=0.0.0.0:9090
INFO[09-05|07:33:17.026] new subscription to logs established
INFO[09-05|07:33:17.026] rpc filters: subscribing to Erigon events
INFO[09-05|07:33:17.026] New txs subscriber joined
INFO[09-05|07:33:17.026] new subscription to newHeaders established
INFO[09-05|07:33:17.027] Reading JWT secret path=/media/datadir/datadir/jwt.hex
INFO[09-05|07:33:17.027] Generated JWT secret path=/media/datadir/datadir/jwt.hex
INFO[09-05|07:33:17.027] HTTP endpoint opened for Engine API url=localhost:8551 ws=true ws.compression=true
INFO[09-05|07:33:17.027] HTTP endpoint opened url=localhost:8545 ws=true ws.compression=true grpc=false
INFO[09-05|07:33:17.031] Started P2P networking version=66 self=enode://a78881ed161becdbbec3ab464b3f2e285f59af5460505ddbaa268e1436240ddf2bee6189f69c97e08e3fd07c0fa5b96be599dafaf9edf8d82a7e377aa7a42257@127.0.0.1:30303 na
me=erigon/v2022.09.1-alpha-4067b7c4/linux-amd64/go1.18.1
INFO[09-05|07:33:17.036] [txpool] Started
INFO[09-05|07:33:17.062] [Snapshots] Fetching torrent files metadata
INFO[09-05|07:33:23.426] [Snapshots] Stat blocks=20932k indices=20932k alloc=2.8GB sys=3.0GB
INFO[09-05|07:33:23.426] [1/15 Headers] Waiting for headers... from=21050202
INFO[09-05|07:33:40.936] [1/15 Headers] Processed highest inserted=21060662 age=2s
INFO[09-05|07:33:47.085] [4/15 Bodies] Processing bodies... from=21050202 to=21060662
INFO[09-05|07:34:07.086] [4/15 Bodies] Wrote block bodies block_num=21051089 delivery/sec=11.8MB wasted/sec=2.6MB alloc=4.2GB sys=4.7GB
INFO[09-05|07:34:17.027] [txpool] stat block=21050202 pending=29 baseFee=0 queued=79 alloc=4.2GB sys=4.7GB
INFO[09-05|07:34:35.115] [4/15 Bodies] Processed highest=21060662
INFO[09-05|07:34:35.115] [5/15 Senders] Started from=21050202 to=21060662
INFO[09-05|07:34:51.752] [6/15 Execution] Blocks execution from=21050202 to=21060662
INFO[09-05|07:35:15.183] [p2p] GoodPeers eth66=18
INFO[09-05|07:35:17.027] [txpool] stat block=21050202 pending=29 baseFee=0 queued=79 alloc=5.3GB sys=6.9GB
INFO[09-05|07:36:17.027] [txpool] stat block=21050202 pending=30 baseFee=0 queued=90 alloc=11.9GB sys=13.1GB
INFO[09-05|07:37:15.184] [p2p] GoodPeers eth66=28
INFO[09-05|07:37:17.028] [txpool] stat block=21050202 pending=32 baseFee=0 queued=92 alloc=19.7GB sys=21.7GB
INFO[09-05|07:38:17.054] [txpool] stat block=21050202 pending=1659 baseFee=0 queued=2325 alloc=22.8GB sys=25.2GB
INFO[09-05|07:39:15.183] [p2p] GoodPeers eth66=29
INFO[09-05|07:39:17.031] [txpool] stat block=21050202 pending=2228 baseFee=0 queued=3302 alloc=33.0GB sys=36.5GB
INFO[09-05|07:40:17.030] [txpool] stat block=21050202 pending=3078 baseFee=0 queued=4549 alloc=33.4GB sys=41.4GB
INFO[09-05|07:41:15.183] [p2p] GoodPeers eth66=26
INFO[09-05|07:41:17.030] [txpool] stat block=21050202 pending=3892 baseFee=0 queued=5642 alloc=36.5GB sys=41.4GB
INFO[09-05|07:42:17.028] [txpool] stat block=21050202 pending=4547 baseFee=0 queued=6812 alloc=21.6GB sys=41.4GB
^CINFO[09-05|07:42:26.445] Got interrupt, shutting down...
INFO[09-05|07:42:26.449] Exiting Engine...
INFO[09-05|07:42:26.449] Exiting...
INFO[09-05|07:42:26.452] RPC server shutting down
INFO[09-05|07:42:26.452] RPC server shutting down
INFO[09-05|07:42:26.454] RPC server shutting down
WARN[09-05|07:42:26.457] Failed to serve http endpoint err="http: Server closed"
INFO[09-05|07:42:26.457] Engine HTTP endpoint close url=localhost:8551
WARN[09-05|07:42:26.457] Failed to serve http endpoint err="http: Server closed"
INFO[09-05|07:42:26.458] HTTP endpoint closed url=localhost:8545
^CWARN[09-05|07:42:33.308] Already shutting down, interrupt more to panic. times=9
^CWARN[09-05|07:43:04.647] Already shutting down, interrupt more to panic. times=8
^CWARN[09-05|07:43:05.480] Already shutting down, interrupt more to panic. times=7
^CWARN[09-05|07:43:05.671] Already shutting down, interrupt more to panic. times=6
^CWARN[09-05|07:43:05.847] Already shutting down, interrupt more to panic. times=5
^CWARN[09-05|07:43:06.023] Already shutting down, interrupt more to panic. times=4
^CWARN[09-05|07:43:06.247] Already shutting down, interrupt more to panic. times=3
^CWARN[09-05|07:43:06.647] Already shutting down, interrupt more to panic. times=2
^CWARN[09-05|07:43:06.983] Already shutting down, interrupt more to panic. times=1
^Cpanic: boom
goroutine 5445 [running]:
github.com/ledgerwatch/erigon/internal/debug.LoudPanic(...)
github.com/ledgerwatch/erigon/internal/debug/loudpanic.go:26
github.com/ledgerwatch/erigon/internal/debug.ListenSignals({0x1fedc40?, 0xc000a4eb00})
github.com/ledgerwatch/erigon/internal/debug/signal.go:38 +0x359
created by github.com/ledgerwatch/erigon/cmd/utils.StartNode
github.com/ledgerwatch/erigon/cmd/utils/cmd.go:58 +0xaa
goroutine 1 [chan receive, 9 minutes]:
github.com/ledgerwatch/erigon/node.(*Node).Wait(...)
github.com/ledgerwatch/erigon/node/node.go:265
github.com/ledgerwatch/erigon/turbo/node.(*ErigonNode).Serve(0xc015324880)
github.com/ledgerwatch/erigon/turbo/node/node.go:32 +0x7c
main.runErigon(0xc000543b80?)
github.com/ledgerwatch/erigon/cmd/erigon/main.go:64 +0x325
github.com/urfave/cli.HandleAction({0x16b1980?, 0x1de1738?}, 0xc00027f340?)
github.com/urfave/[email protected]/app.go:526 +0x50
github.com/urfave/cli.(*App).Run(0xc00027f340, {0xc000132000, 0xe, 0xe})
github.com/urfave/[email protected]/app.go:286 +0x7c5
main.main()
github.com/ledgerwatch/erigon/cmd/erigon/main.go:35 +0x75
goroutine 19 [sleep, 3 minutes]:
time.Sleep(0x22ecb25c00)
runtime/time.go:194 +0x12e
github.com/VictoriaMetrics/metrics.summariesSwapCron(0x45d964b800)
github.com/VictoriaMetrics/[email protected]/summary.go:237 +0x36
created by github.com/VictoriaMetrics/metrics.registerSummaryLocked
github.com/VictoriaMetrics/[email protected]/summary.go:211 +0x125
goroutine 8 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f00886b84c8, 0x72)
runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0000d0000?, 0x0?, 0x0)
internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc0000d0000)
internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc0000d0000)
net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc0002a0030)
net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).Accept(0xc0002a0030)
net/tcpsock.go:288 +0x3d
net/http.(*Server).Serve(0xc0001320e0, {0x1ffcbc0, 0xc0002a0030})
net/http/server.go:3039 +0x385
net/http.(*Server).ListenAndServe(0xc0001320e0)
net/http/server.go:2968 +0x7d
net/http.ListenAndServe(...)
net/http/server.go:3222
github.com/ledgerwatch/erigon/metrics/exp.Setup.func2()
github.com/ledgerwatch/erigon/metrics/exp/exp.go:26 +0x69
created by github.com/ledgerwatch/erigon/metrics/exp.Setup
github.com/ledgerwatch/erigon/metrics/exp/exp.go:25 +0x145
goroutine 9 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f00886b83d8, 0x72)
runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0004a4000?, 0x0?, 0x0)
internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc0004a4000)
internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc0004a4000)
net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc000448018)
net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).Accept(0xc000448018)
net/tcpsock.go:288 +0x3d
net/http.(*Server).Serve(0xc00049e000, {0x1ffcbc0, 0xc000448018})
net/http/server.go:3039 +0x385
net/http.(*Server).ListenAndServe(0xc00049e000)
net/http/server.go:2968 +0x7d
net/http.ListenAndServe(...)
net/http/server.go:3222
github.com/ledgerwatch/erigon/internal/debug.StartPProf.func2()
github.com/ledgerwatch/erigon/internal/debug/flags.go:252 +0x69
created by github.com/ledgerwatch/erigon/internal/debug.StartPProf
github.com/ledgerwatch/erigon/internal/debug/flags.go:251 +0x258
goroutine 5259 [chan receive, 9 minutes]:
github.com/ledgerwatch/erigon-lib/direct.(*SubscribeLogsStreamC).Recv(0xc0000d1048?)
github.com/ledgerwatch/[email protected]/direct/eth_backend_client.go:181 +0x2b
github.com/ledgerwatch/erigon/cmd/rpcdaemon/rpcservices.(*RemoteBackend).SubscribeLogs(0xc00d0c5130, {0x1ffea88, 0xc000a4af40}, 0xc00900c000, 0x0?)
github.com/ledgerwatch/erigon/cmd/rpcdaemon/rpcservices/eth_backend.go:156 +0x222
github.com/ledgerwatch/erigon/turbo/rpchelper.New.func2()
github.com/ledgerwatch/erigon/turbo/rpchelper/filters.go:108 +0xec
created by github.com/ledgerwatch/erigon/turbo/rpchelper.New
github.com/ledgerwatch/erigon/turbo/rpchelper/filters.go:98 +0x3d9
goroutine 4049 [sleep]:
time.Sleep(0x6fc23ac00)
runtime/time.go:194 +0x12e
github.com/ledgerwatch/erigon/cmd/downloader/downloader.MainLoop.func1()
github.com/ledgerwatch/erigon/cmd/downloader/downloader/downloader.go:355 +0x4d
created by github.com/ledgerwatch/erigon/cmd/downloader/downloader.MainLoop
github.com/ledgerwatch/erigon/cmd/downloader/downloader/downloader.go:333 +0x11e
goroutine 4995 [chan receive, 9 minutes]:
github.com/ledgerwatch/erigon-lib/direct.(*SubscribeLogsStreamS).Recv(0xc00d0c4730?)
github.com/ledgerwatch/[email protected]/direct/eth_backend_client.go:154 +0x2b
github.com/ledgerwatch/erigon/ethdb/privateapi.(*LogsFilterAggregator).subscribeLogs(0xc00d0c4730, {0x2008990, 0xc006ae2000})
github.com/ledgerwatch/erigon/ethdb/privateapi/logsfilter.go:131 +0xbc
github.com/ledgerwatch/erigon/ethdb/privateapi.(*EthBackendServer).SubscribeLogs(0xd061ab?, {0x2008990?, 0xc006ae2000?})
github.com/ledgerwatch/erigon/ethdb/privateapi/ethbackend.go:677 +0x2c
github.com/ledgerwatch/erigon-lib/direct.(*EthBackendClientDirect).SubscribeLogs.func1()
github.com/ledgerwatch/[email protected]/direct/eth_backend_client.go:121 +0x9b
created by github.com/ledgerwatch/erigon-lib/direct.(*EthBackendClientDirect).SubscribeLogs
github.com/ledgerwatch/[email protected]/direct/eth_backend_client.go:118 +0x15b
goroutine 5270 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f007980dcb0, 0x72)
runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0000d1080?, 0xc0001260f0?, 0x0)
internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc0000d1080)
internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc0000d1080)
net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc015b10228)
net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).Accept(0xc015b10228)
net/tcpsock.go:288 +0x3d
github.com/ledgerwatch/erigon/p2p.(*Server).listenLoop(0xc00a8402c0, {0x1ffea88, 0xc00cb8ed00})
github.com/ledgerwatch/erigon/p2p/server.go:892 +0x753
github.com/ledgerwatch/erigon/p2p.(*Server).setupListening.func2()
github.com/ledgerwatch/erigon/p2p/server.go:721 +0x74
created by github.com/ledgerwatch/erigon/p2p.(*Server).setupListening
github.com/ledgerwatch/erigon/p2p/server.go:718 +0x26d
goroutine 5444 [runnable, locked to thread]:
github.com/ledgerwatch/secp256k1._Cfunc_secp256k1_ext_ecdsa_recover(0x7f008858c010, 0xc5cfbda0a0, 0xc50e733fa0, 0xc5cfbcb5c0)
_cgo_gotypes.go:250 +0x4c
github.com/ledgerwatch/secp256k1.RecoverPubkeyWithContext.func1(0x20?, {0xc5cfbda0a0, 0x16b9fc0?, 0x0?}, {0x0?, 0x0, 0xc5cfbd1880?}, 0xc5cfbcb6a0?, 0x20?)
github.com/ledgerwatch/[email protected]/secp256.go:171 +0x8a
github.com/ledgerwatch/secp256k1.RecoverPubkeyWithContext(0xc5cfbd16c0?, {0xc5cfbcb5c0?, 0x0?, 0x20?}, {0xc50e733fa0?, 0x41?, 0xc0002c5000?}, {0x0, 0x0, 0x0})
github.com/ledgerwatch/[email protected]/secp256.go:171 +0x14e
github.com/ledgerwatch/secp256k1.RecoverPubkey(...)
github.com/ledgerwatch/[email protected]/secp256.go:147
github.com/ledgerwatch/erigon/crypto.Ecrecover({0xc5cfbcb5c0?, 0x34c7f531a443290a?, 0x15a6793946363c01?}, {0xc50e733fa0?, 0x18b9c60?, 0xc50e765680?})
github.com/ledgerwatch/erigon/crypto/signature_cgo.go:32 +0x4d
github.com/ledgerwatch/erigon/consensus/parlia.ecrecover(0xc50e765680, 0x0?, 0x0?)
github.com/ledgerwatch/erigon/consensus/parlia/parlia.go:163 +0x245
github.com/ledgerwatch/erigon/consensus/parlia.(*Snapshot).apply(0xc662ba19f0, {0xc5b7a00000, 0x141335a, 0xc00011a8a0?}, {0x2004fb8, 0xc0fa2d2c30}, {0x0, 0x0, 0x0}, 0xc0002c5000)
github.com/ledgerwatch/erigon/consensus/parlia/snapshot.go:196 +0x76f
github.com/ledgerwatch/erigon/consensus/parlia.(*Parlia).snapshot(0xc00d202a00, {0x2004fb8, 0xc0fa2d2c30}, 0x49f7d62eb8e81f8f?, {0xd, 0x21, 0x84, 0xa, 0xbf, 0xf4, ...}, ...)
github.com/ledgerwatch/erigon/consensus/parlia/parlia.go:565 +0x8c5
github.com/ledgerwatch/erigon/consensus/parlia.(*Parlia).finalize(0xc00d202a00, 0xc000243900, 0x0?, {0xc0e5db1500?, 0xc0e7994618?, 0x432367?}, {0xc09352ea00?, 0x35, 0x40}, {0x2004fb8, ...}, ...)
github.com/ledgerwatch/erigon/consensus/parlia/parlia.go:692 +0x148
github.com/ledgerwatch/erigon/consensus/parlia.(*Parlia).Finalize(0x0?, 0x0?, 0xc007030480?, 0xc000243b80?, {0xc0e5db1500?, 0xc00d202a00?, 0x454710?}, {0x2d6acc8, 0x0, 0x0}, ...)
github.com/ledgerwatch/erigon/consensus/parlia/parlia.go:679 +0x66
github.com/ledgerwatch/erigon/core.ExecuteBlockEphemerallyForBSC(0xc0001c4b00, 0xc0e7995140, 0x8?, {0x200d6b0?, 0xc00d202a00}, 0xc0e78f2700, {0x2001c20?, 0xc007030460}, {0x2007750, 0xc0e78fd260}, ...)
github.com/ledgerwatch/erigon/core/blockchain.go:165 +0x866
github.com/ledgerwatch/erigon/eth/stagedsync.executeBlock(_, {_, _}, {_, _}, {{0x2007610, 0xc00027b3f0}, 0x10000000, {0x1, {0x2002aa0, ...}, ...}, ...}, ...)
github.com/ledgerwatch/erigon/eth/stagedsync/stage_execute.go:167 +0x43e
github.com/ledgerwatch/erigon/eth/stagedsync.SpawnExecuteBlocksStage(_, {_, _}, {_, _}, _, {_, _}, {{0x2007610, 0xc00027b3f0}, ...}, ...)
github.com/ledgerwatch/erigon/eth/stagedsync/stage_execute.go:436 +0xedf
github.com/ledgerwatch/erigon/eth/stagedsync.DefaultStages.func16(0xb0?, 0xa0?, 0x1981109?, {0x1fedbe0?, 0xc00a80a0b0?}, {0x0?, 0x0?})
github.com/ledgerwatch/erigon/eth/stagedsync/default_stages.go:85 +0x90
github.com/ledgerwatch/erigon/eth/stagedsync.(*Sync).runStage(0xc00a80a0b0, 0xc00d0c4a00, {0x2007610?, 0xc00027b3f0}, {0x0?, 0x0}, 0x50?, 0x53?)
github.com/ledgerwatch/erigon/eth/stagedsync/sync.go:352 +0x150
github.com/ledgerwatch/erigon/eth/stagedsync.(*Sync).Run(0xc00a80a0b0, {0x2007610?, 0xc00027b3f0}, {0x0, 0x0}, 0x0?)
github.com/ledgerwatch/erigon/eth/stagedsync/sync.go:255 +0x265
github.com/ledgerwatch/erigon/turbo/stages.StageLoopStep({0x1ffea88, 0xc000a4af40}, {0x2007610?, 0xc00027b3f0?}, 0xc00a80a0b0, 0x0, 0xc000a5af80, 0x1, 0xc014df4e60, 0x0)
github.com/ledgerwatch/erigon/turbo/stages/stageloop.go:163 +0x445
github.com/ledgerwatch/erigon/turbo/stages.StageLoop({0x1ffea88, 0xc000a4af40}, {0x2007610?, 0xc00027b3f0}, 0x19be385?, 0x27?, 0xa72f00?, 0xc000a2a4e0?, 0xc0092e57b8?, 0x0)
github.com/ledgerwatch/erigon/turbo/stages/stageloop.go:84 +0x145
created by github.com/ledgerwatch/erigon/eth.(*Ethereum).Start
github.com/ledgerwatch/erigon/eth/backend.go:883 +0x1e5
goroutine 5447 [syscall]:
os/signal.signal_recv()
runtime/sigqueue.go:151 +0x2f
os/signal.loop()
os/signal/signal_unix.go:23 +0x19
created by os/signal.Notify.func1.1
os/signal/signal.go:151 +0x2a
goroutine 162683 [chan receive]:
github.com/ledgerwatch/erigon/eth.(*Ethereum).Stop(0xc0001fcd80)
github.com/ledgerwatch/erigon/eth/backend.go:911 +0x189
github.com/ledgerwatch/erigon/node.(*Node).stopServices(0xc007a1b620?, {0xc015324870, 0x1, 0x80aea0?})
github.com/ledgerwatch/erigon/node/node.go:219 +0xb3
github.com/ledgerwatch/erigon/node.(*Node).Close(0xc000a4eb00)
github.com/ledgerwatch/erigon/node/node.go:162 +0x18b
created by github.com/ledgerwatch/erigon/internal/debug.ListenSignals
github.com/ledgerwatch/erigon/internal/debug/signal.go:29 +0x26d
root@ip-172-31-63-1:/home/ubuntu#
new snapshot decode error
I have download erigon-16k-db-latest.mdbx.zstd manually , than I use " zstd -d erigon-16k-db-latest.mdbx.zstd " commnd to untar the tarball
got error:
Decoding error (36) : Corrupted block detected
The whole snapshot only 500GB?
After I run the script and complete download , this the disk usage.
tank/erigon_data 3T 128K 39T 1% /erigon/data
tank/erigon_data/bsc 3T 256K 39T 1% /erigon/data/bsc
tank/erigon_data/bsc/parlia 3T 128K 39T 1% /erigon/data/bsc/parlia
tank/erigon_data/bsc/nodes 3T 5.4M 39T 1% /erigon/data/bsc/nodes
tank/erigon_data/bsc/snapshots 3T 563G 39T 2% /erigon/data/bsc/snapshots
tank/erigon_data/bsc/chaindata 3T 2.1G 39T 1% /erigon/data/bsc/chaindata
The data only less that 600GB?
Is my data correct?
Using Snapshot without zfs
Hi,
I'm running into some problems running zfs on my drives (can't create pool). Is it possible to use the snapshot without zfs or is there some specific formating?
Thanks for creating this!
Not able to sync with "latest" node
Hello,
Thanks for this project, it looks really good, and can help us to make this blockchain really scalable.
We have an issue with the "latest" node. When we try to start it, we have this kind of logs :
t=2021-11-08T16:07:35+0000 lvl=eror msg="header not found" peer=65b37e4e hash=0x826b4960ae94cbe207062b3a40c640f2d991ee1e7eec2b29cb9cf3ec59b50308 request=12,247,914
t=2021-11-08T16:07:35+0000 lvl=warn msg="Synchronisation failed, dropping peer" peer=65b37e4e487ac686cf3cc4ac458fce9097951b865a2f45b65b71d02ba4e76c97 err="action from bad peer ignored: header no found (0x826b4960ae94cbe207062b3a40c640f2d991ee1e7eec2b29cb9cf3ec59b50308)"
t=2021-11-08T16:07:35+0000 lvl=eror msg="Ethereum peer removal failed" peer=65b37e4e err="peer not registered"
t=2021-11-08T16:07:37+0000 lvl=eror msg="header not found" peer=6fae5c22 hash=0x7daf31669962d5f19cca502dc0f083a16ff1fd033acae633533ad1d6d3a14071 request=12,247,912
t=2021-11-08T16:07:37+0000 lvl=warn msg="Synchronisation failed, dropping peer" peer=6fae5c226044bef3bd616aea57a23eb04a765339c2a3251af1578178ac81d367 err="action from bad peer ignored: header no found (0x7daf31669962d5f19cca502dc0f083a16ff1fd033acae633533ad1d6d3a14071)"
t=2021-11-08T16:07:37+0000 lvl=eror msg="Ethereum peer removal failed" peer=6fae5c22 err="peer not registered"
t=2021-11-08T16:07:39+0000 lvl=eror msg="Snapshot extension registration failed" peer=af5dfeb7 err="peer connected on snap without compatible eth support"
t=2021-11-08T16:07:39+0000 lvl=eror msg="header not found" peer=baa7e4a5 hash=0x53e92acf3f98d7845d42320d3c1abe58a0d658c19842e10a3386ba5b4b362961 request=12,247,911
t=2021-11-08T16:07:39+0000 lvl=warn msg="Synchronisation failed, dropping peer" peer=baa7e4a5b4297b9ab03afd839eb2347ba2032165cd543ddae3a45644a1304bab err="action from bad peer ignored: header no found (0x53e92acf3f98d7845d42320d3c1abe58a0d658c19842e10a3386ba5b4b362961)"
t=2021-11-08T16:07:39+0000 lvl=eror msg="Ethereum peer removal failed" peer=baa7e4a5 err="peer not registered"
t=2021-11-08T16:07:58+0000 lvl=eror msg="Snapshot extension registration failed" peer=85f71f39 err="peer connected on snap without compatible eth support"
And the blockchain don't start to sync. All others nodes for others block ranges looks working well.
Do you have an idea ?
Regards,
Denis
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.