Time to copy all data about ethereum_blockchain_parser

[hpduong]

Thanks, Alex, and I'm also wondering the same. @cakcora did you end up syncing the entire blockchain? How long did it take?

[cakcora]

Hi,

I actually used an R script to download data very fast. See the Ethr library here: https://github.com/BSDStudios/ethr

[hpduong]

Thanks @cakcora, I'll give it a go! How long did it take you and how big was the file size when complete roughly?

[cakcora]

It should be around 65 GB, I downloaded the last 0.5 million blocks with ethr and wrote each to its file. It took 38 GB, which is too much. Downloaded 0.5m blocks in a night.

[hpduong]

Thanks for the details, that was exactly what I was looking for so I could realistically anticipate.

…

On Wed, May 9, 2018 at 4:45 PM, Cüneyt Gürcan Akçora < ***@***.***> wrote: It should be around 65 GB, I downloaded the last 0.5 million blocks with ethr and wrote each to its file. It took 38 GB, which is too much. Downloaded 0.5m blocks in a night. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#9 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AEOhDSF0x0zmbpG3ko8CXd6FEMMszQ4pks5tw3-BgaJpZM4TRKqX> .

--

[medvedev1088]

Maybe this article will be useful https://medium.com/@medvedev1088/exporting-and-analyzing-ethereum-blockchain-f5353414a94e
Exporting the data will take a few hours if you run it in the cluster https://medium.com/@medvedev1088/how-to-export-the-entire-ethereum-blockchain-to-csv-in-2-hours-for-10-69fef511e9a2

Here is the schema

blocks.csv

Column	Type
block_number	bigint
block_hash	hex_string
block_parent_hash	hex_string
block_nonce	hex_string
block_sha3_uncles	hex_string
block_logs_bloom	hex_string
block_transactions_root	hex_string
block_state_root	hex_string
block_miner	hex_string
block_difficulty	bigint
block_total_difficulty	bigint
block_size	bigint
block_extra_data	hex_string
block_gas_limit	bigint
block_gas_used	bigint
block_timestamp	bigint
block_transaction_count	bigint

transactions.csv

Column	Type
tx_hash	hex_string
tx_nonce	bigint
tx_block_hash	hex_string
tx_block_number	bigint
tx_index	bigint
tx_from	hex_string
tx_to	hex_string
tx_value	bigint
tx_gas	bigint
tx_gas_price	bigint
tx_input	hex_string

erc20_transfers.csv

Column	Type
erc20_token	hex_string
erc20_from	hex_string
erc20_to	hex_string
erc20_value	bigint
erc20_tx_hash	hex_string
erc20_block_number	bigint