stereum-dev / ethereum2-docker-compose Goto Github PK

integrate lodestar with validator

I tried to run the prysm-only process, and I got this error on the validator container:

time="2020-11-20 10:26:45" level=warning msg="Running on ETH2 Mainnet" prefix=flags
time="2020-11-20 10:26:45" level=error msg="could not open wallet: no wallet found. You can create a new wallet with validator wallet create.If you already did, perhaps you created a wallet in a custom directory, which you can specify using --wallet-dir=/path/to/my/wallet" prefix=main

What am I missing?

Goal: docker-compose.yaml example file with nimbus beacon and eth1 geth

Create an docker-compose.override.yaml for a setup of lighthouse without the need of local geth.

Create an docker-compose.no-geth.override.yaml for nimbus-only setup similar to lighthouse-only setup.

dashboard updated here prysmaticlabs/documentation#260

Remove default graffiti settings on all clients for security reasons.

• true/yes
• order/grouping of configs
• commenting

Build a secure docker image for prysm:

• beacon-chain
• validator
• slasher

Docker image features:

• Using non-priviledged user
• Apparmor or similar
• No package managers
• Automized and triggered builds

Use https://github.com/sigp/lighthouse-docker and adapt it to this repository to be runable.

I am trying to follow the prysm-only to create the node.
I am getting this error:

[root@master-0 ethereum2-docker-compose]# docker-compose -f create-account.yaml run validator-import-launchpad

Prysmatic Labs Terms of Use

By downloading, accessing or using the Prysm implementation (“Prysm”), you (referenced herein
as “you” or the “user”) certify that you have read and agreed to the terms and conditions below.

TERMS AND CONDITIONS: https://github.com/prysmaticlabs/prysm/blob/master/TERMS_OF_SERVICE.md


Type "accept" to accept this terms and conditions [accept/decline]: (default: decline):
accept
[2020-11-20 11:34:56]  WARN flags: Running on ETH2 Mainnet
[2020-11-20 11:34:56] FATAL accounts: Could not import accounts: could not initialize wallet: password did not pass validation: password must have at least 8 characters, at least 1 alphabetical character, 1 unicode symbol, and 1 number

I think that I followed the instructions correctly. I have the the wallet password file here:

[root@master-0 ethereum2-docker-compose]# ll data/prysm/validator/wallets/
total 4
-rw-r--r--. 1 root root 15 Nov 20 12:12 wallet-password
[root@master-0 ethereum2-docker-compose]# ll data/prysm/validator/passwords/
total 4
-rw-r--r--. 1 root root 15 Nov 20 12:34 wallet-password

(both are the same, and both are the same as was used during launchpad)

I already finished the launchpad process, so I paid my 32 GETH. Any suggestions?

create validator service for nimbus-only setup and include monitoring

User reported issue with getting alerts, but they are not correct. Validators are not slashed and node works as intended (source beaconcha.in). Validator public keys/indexes won't be posted here to keep the user's funds anonymous.

So I was trying it out using the TestNet and gave a weak password... Now right before the setup finishes, the loader complaines about password policy:
Could not import accounts: could not initialize wallet: password did not pass validation: password must have at least 8 characters, at least 1 alphabetical character, 1 unicode symbol, and 1 number

Grr - Sure its very good to have that in MainNet.. But now I get stuck and wonder how to proceed from here?

Can I change my existing password to match the requirements or do I need to generate new validator configs?

My steps:

Copy templates:

cd /opt/ethereum2-docker-compose/
cp compose-examples/prysm-only/docker-compose.yaml 
cp compose-examples/prysm-only/create-account.yaml ./

Copy keystore & deposit file:

mkdir -p /opt/ethereum2-docker-compose/launchpad/eth2.0-deposit-cli/validator_keys
cd /opt/ethereum2-docker-compose/launchpad/eth2.0-deposit-cli/validator_keys/
cp /opt/ethereum2-docker-compose/launchpad/deposit_data-XYZ.json ./
cp /opt/ethereum2-docker-compose/launchpad/keystore-m_XYZjson ./

Enter password / Create wallet dir:

cd /opt/ethereum2-docker-compose/
mkdir -p data/prysm/validator/wallets
vim data/prysm/validator/passwords/wallet-password

(saved pw to file)

Try to run it:

cd /opt/ethereum2-docker-compose/
sudo docker-compose -f create-account.yaml run validator-import-launchpad

But sadly it fails:

[2021-02-21 18:03:34] FATAL accounts: 
Could not import accounts: could not initialize wallet: 
password did not pass validation: 
password must have at least 8 characters, 
at least 1 alphabetical character, 1 unicode symbol, and 1 number

GETH_DOCKER_TAG, doable when #10 is done & merged.

GETH_DOCKER_TAG, doable when #10 is done & merged.

https://hub.docker.com/layers/attestant/dirk/1.0.1/images/sha256-6fa469f7701d2a8355b37a6f37f8a5600c9397ce36d86ae023986b1a084e0c66?context=explore

Mount them in ./data/{service-name}

https://github.com/harmony-dev/beacon-chain-java
https://github.com/paritytech/shasper
https://github.com/ethereum/trinity not ready for eth2 yet

docs: https://lighthouse-book.sigmaprime.io/slasher.html

make docker-compose.override.yaml to deactivate slasher

• use explicit version with .env version tag
• run with user: "2000"
• pre-define outsource configuration in ./config/prometheus-node-exporter/... and mount as volume in docker-compose.yaml

the grafana provisioning-p configuration sets its prometheus datasource as having basic auth

error="Could not find datasource Data source not found" 

According to https://github.com/coincashew/coincashew/blob/master/coins/overview-eth/guide-how-to-stake-on-eth2-with-lodestar.md the port 9000 is only used for udp, not for tcp. At the moment lodestar's docker-compose.yaml uses also 9000 as tcp.

• Lighthouse
• Lodestar (unsupported right now)
• Multiclient
• Nimbus
• Prysm
• Teku

update dashboard of prysm's grafana with https://github.com/metanull-operator/eth2-grafana

bash script to automate update (git pull, stashing, copy correct docker-compose.yaml, ...)

Teku's prometheus container should use user: "2000" instead of user: root, similar to docker-compose.yaml of lighthouse-only setup. This change needs adjustments of stereum-init's mount too!

Nimbus' prometheus container should use user: "2000" instead of user: root, similar to docker-compose.yaml of lighthouse-only setup. This change needs adjustments of stereum-init's mount too!

• Vouch should use separate internal-only network to connect to beacons

• Dirk should use separate internal-only network to connect to vouch

Hello,

I was able to successfully run the docker compose file, adding user 1000 to grifana and it looks like the Overview New dashboard is not loading any metrics:

It looks like the only metrics that seem to be available are the scrape metrics:

I wanted to get the dashboard metrics working before I stake anything.

Here are the latest bits of logs for each service:

Geth seems to be sync'd to the head of the chain:

Beacon_1 seems ok also:

Validator_1 maybe an issue

slasher_1 gives me some errors, any idea why?

Grafana_1 successfil login:

All in all, I really like this setup and thank you for all of your work,

-bp

I am following along your docker-compose examples for "lighthouse-only" and everything is working great so far (thanks btw!). Grafana is showing no data in any dashboard though. I see that prometheus is running and I can reach it from the grafana container. I have accessed the prometheus interface directly but none of the queries work - nothing is returned.

I don't know where to start looking for the problem. Logs do not show any obvious hints.

To prevent missed attestations/blocks when the main beacon of one vouch is not functioning properly we need to introduce a second vouch container and connect it to one of the other beacons as main its main node.

see ChainSafe/lodestar#1941

https://lighthouse-book.sigmaprime.io/validator-monitoring.html

https://github.com/sigp/lighthouse-metrics/blob/master/dashboards/ValidatorMonitor.json

beacon_1 | time="2020-11-24 07:42:42" level=error msg="blst is deprecated and has no effect. Do not use this flag, it will be deleted soon." prefix=flags

Add monitoring (prometheus, grafana) to lighthouse-standalone and include dashboard.

Create an docker-compose.no-geth.override.yaml for lodestar-only setup similar to lighthouse-only setup.

Should it be mainnet: yes?

Hi all,

I'm having the node-exporter docker crash every couple of days.
The log doesn't show anything.
Does anyone have the same issue?
I'm running with prysm only.
Some output

docker-compose ps
Name Command State Ports

ethereum2-docker-compose_beacon_1 /app/beacon-chain/beacon-c ... Up 0.0.0.0:12000->12000/udp,
0.0.0.0:13000->13000/tcp,
127.0.0.1:3500->3500/tcp,
127.0.0.1:4000->4000/tcp,
127.0.0.1:8080->8080/tcp
ethereum2-docker-compose_geth_1 geth --http --http.port=85 ... Up 0.0.0.0:30303->30303/tcp,
0.0.0.0:30303->30303/udp,
127.0.0.1:8545->8545/tcp, 8546/tcp
ethereum2-docker-compose_grafana_1 /run.sh Up 127.0.0.1:3000->3000/tcp
ethereum2-docker-compose_node- /bin/node_exporter Exit 255 9100/tcp
exporter_1
ethereum2-docker-compose_prometheus_1 /bin/prometheus --storage. ... Up 127.0.0.1:9090->9090/tcp
ethereum2-docker-compose_renderer_1 dumb-init -- node build/ap ... Up 8081/tcp
ethereum2-docker-compose_slasher_1 /app/slasher/slasher --con ... Up
ethereum2-docker-compose_validator_1 /app/validator/validator - ... Up 127.0.0.1:7500->7500/tcp,
127.0.0.1:8081->8081/tcp

all other containers booted correctly

ERROR: for prometheus  Cannot start service prometheus: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"rootfs_linux.go:58: mounting \\\"/home/xyz/Development/ethereum2-docker-compose/config/prometheus/prometheus-p.yaml\\\" to rootfs \\\"/var/lib/docker/overlay2/0859d586e611218284bc2e0a6cc0cb53ef1dba7598b9a9fd54d41d1d36c76993/merged\\\" at \\\"/var/lib/docker/overlay2/0859d586e611218284bc2e0a6cc0cb53ef1dba7598b9a9fd5``4d41d1d36c76993/merged/etc/prometheus/prometheus.yml\\\" caused \\\"not a directory\\\"\"": unknown: Are you trying to mount a directory onto a file (or vice-versa)? Check if the specified host path exists and is the expected type

ethereum2-docker-compose on  master [!?] 
⇡0% ➜ docker -v
cokecDocker version 19.03.4-rc1, build 4ba2b1c606

ethereum2-docker-compose on  master [!?] took 2s 
⇡0% ➜ docker-machine -v
docker-machine version 0.16.0, build 702c267f

no volumes currently

ethereum2-docker-compose on  master [!?] took 3s 
⇡0% ➜ docker volume ls                       
DRIVER              VOLUME NAME