harukama / aleo-prover

Light standalone prover

Just playing with some metrics tools...

aleo-prover's Issues

Getting sppark error

I am trying to run it with cuda feature but getting the below stack trace

Branch: testnet3-direct-cuda

error: failed to run custom build command for `sppark v0.1.2 ([https://github.com/supranational/sppark?rev=48f6ac6#48f6ac60)`](https://github.com/supranational/sppark?rev=48f6ac6#48f6ac60))

Caused by:
  process didn't exit successfully: `/home/aditya/aleo-prover/target/release/build/sppark-329937d95720d5f1/build-script-build` (exit status: 1)
  --- stdout
  cargo:rerun-if-changed=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/ec
  cargo:rerun-if-changed=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/ff
  cargo:rerun-if-changed=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/ntt
  cargo:rerun-if-changed=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/msm
  cargo:rerun-if-changed=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util
  cargo:ROOT=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6
  TARGET = Some("x86_64-unknown-linux-gnu")
  OPT_LEVEL = Some("3")
  HOST = Some("x86_64-unknown-linux-gnu")
  cargo:rerun-if-env-changed=CXX_x86_64-unknown-linux-gnu
  CXX_x86_64-unknown-linux-gnu = None
  cargo:rerun-if-env-changed=CXX_x86_64_unknown_linux_gnu
  CXX_x86_64_unknown_linux_gnu = None
  cargo:rerun-if-env-changed=HOST_CXX
  HOST_CXX = None
  cargo:rerun-if-env-changed=CXX
  CXX = None
  cargo:rerun-if-env-changed=NVCC_x86_64-unknown-linux-gnu
  NVCC_x86_64-unknown-linux-gnu = None
  cargo:rerun-if-env-changed=NVCC_x86_64_unknown_linux_gnu
  NVCC_x86_64_unknown_linux_gnu = None
  cargo:rerun-if-env-changed=HOST_NVCC
  HOST_NVCC = None
  cargo:rerun-if-env-changed=NVCC
  NVCC = None
  cargo:rerun-if-env-changed=CXXFLAGS_x86_64-unknown-linux-gnu
  CXXFLAGS_x86_64-unknown-linux-gnu = None
  cargo:rerun-if-env-changed=CXXFLAGS_x86_64_unknown_linux_gnu
  CXXFLAGS_x86_64_unknown_linux_gnu = None
  cargo:rerun-if-env-changed=HOST_CXXFLAGS
  HOST_CXXFLAGS = None
  cargo:rerun-if-env-changed=CXXFLAGS
  CXXFLAGS = None
  cargo:rerun-if-env-changed=CRATE_CC_NO_DEFAULTS
  CRATE_CC_NO_DEFAULTS = None
  DEBUG = Some("false")
  CARGO_CFG_TARGET_FEATURE = Some("fxsr,sse,sse2")
  running: "nvcc" "-ccbin=c++" "-Xcompiler" "-O3" "-Xcompiler" "-ffunction-sections" "-Xcompiler" "-fdata-sections" "-Xcompiler" "-fPIC" "-m64" "-I" "/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6" "-Xcompiler" "-Wall" "-Xcompiler" "-Wextra" "-o" "/home/aditya/aleo-prover/target/release/build/sppark-ce7f4abd18d08224/out/src/lib.o" "-c" "--device-c" "src/lib.cpp"
  cargo:warning=In file included from /home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh:9,
  cargo:warning=                 from src/lib.cpp:2:
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh: In member function ‘void* stream_t::Dmalloc(size_t) const’:
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh:29:17: error: ‘cudaMallocAsync’ was not declared in this scope; did you mean ‘cudaMallocArray’?
  cargo:warning=   29 |         CUDA_OK(cudaMallocAsync(&d_ptr, sz, stream));
  cargo:warning=      |                 ^~~~~~~~~~~~~~~
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/exception.cuh:32:24: note: in definition of macro ‘CUDA_OK’
  cargo:warning=   32 |     cudaError_t code = expr;                                \
  cargo:warning=      |                        ^~~~
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh: In member function ‘void stream_t::Dfree(void*) const’:
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh:33:17: error: ‘cudaFreeAsync’ was not declared in this scope; did you mean ‘cudaFreeArray’?
  cargo:warning=   33 |     {   CUDA_OK(cudaFreeAsync(d_ptr, stream));   }
  cargo:warning=      |                 ^~~~~~~~~~~~~
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/exception.cuh:32:24: note: in definition of macro ‘CUDA_OK’
  cargo:warning=   32 |     cudaError_t code = expr;                                \
  cargo:warning=      |                        ^~~~
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh: In constructor ‘pin_t<T>::pin_t(const T*, size_t)’:
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/gpu_t.cuh:230:59: error: ‘cudaHostRegisterReadOnly’ was not declared in this scope; did you mean ‘cudaHostRegisterDefault’?
  cargo:warning=  230 |                                  cudaHostRegisterPortable|cudaHostRegisterReadOnly));
  cargo:warning=      |                                                           ^~~~~~~~~~~~~~~~~~~~~~~~
  cargo:warning=/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6/util/exception.cuh:32:24: note: in definition of macro ‘CUDA_OK’
  cargo:warning=   32 |     cudaError_t code = expr;                                \
  cargo:warning=      |                        ^~~~
  exit status: 1

  --- stderr


  error occurred: Command "nvcc" "-ccbin=c++" "-Xcompiler" "-O3" "-Xcompiler" "-ffunction-sections" "-Xcompiler" "-fdata-sections" "-Xcompiler" "-fPIC" "-m64" "-I" "/home/aditya/.cargo/git/checkouts/sppark-766e0a6fee265121/48f6ac6" "-Xcompiler" "-Wall" "-Xcompiler" "-Wextra" "-o" "/home/aditya/aleo-prover/target/release/build/sppark-ce7f4abd18d08224/out/src/lib.o" "-c" "--device-c" "src/lib.cpp" with args "nvcc" did not execute successfully (status code exit status: 1).


warning: build failed, waiting for other jobs to finish...

Warnings

Are its okay? Ubuntu 20

2022-12-06T22:47:50.851172Z  INFO aleo_prover::prover: New proof target: 40254385
2022-12-06T22:47:50.851198Z  INFO aleo_prover::prover: Received new work: epoch 630
2022-12-06T22:47:50.851222Z  WARN aleo_prover::prover: This version of the prover is only using the first GPU

Running command: "nvcc" "/root/.aleo/resources/cuda/asm_cuda.cu" "/root/.aleo/resources/cuda/blst_377_ops.cu" "/root/.aleo/resources/cuda/msm.cu" "--generate-code=arch=compute_60,code=sm_60" "--generate-code=arch=compute_70,code=sm_70" "--generate-code=arch=compute_75,code=sm_75" "--generate-code=arch=compute_80,code=sm_80" "--generate-code=arch=compute_86,code=sm_86" "-fatbin" "-dlink" "-o" "/root/.aleo/resources/cuda/msm.fatbin"
/root/.aleo/resources/cuda/asm_cuda.cu(599): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(702): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(599): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(702): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(599): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(702): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(599): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(702): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(599): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(702): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(599): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/asm_cuda.cu(702): warning #549-D: variable "r" is used before its value is set

/root/.aleo/resources/cuda/blst_377_ops.cu(63): warning #174-D: expression has no effect

/root/.aleo/resources/cuda/blst_377_ops.cu(63): warning #174-D: expression has no effect

/root/.aleo/resources/cuda/blst_377_ops.cu(63): warning #174-D: expression has no effect

/root/.aleo/resources/cuda/blst_377_ops.cu(63): warning #174-D: expression has no effect

/root/.aleo/resources/cuda/blst_377_ops.cu(63): warning #174-D: expression has no effect

2022-12-06T22:48:04.209325Z  INFO aleo_prover::prover: New proof target: 40176294
/root/.aleo/resources/cuda/blst_377_ops.cu(63): warning #174-D: expression has no effect


Using 'Tesla V100-SXM2-16GB' as CUDA device with 16945709056 bytes of memory
2022-12-06T22:48:29.220636Z  INFO aleo_prover::prover: New proof target: 40211739
2022-12-06T22:48:39.140920Z  INFO aleo_prover::prover: Total solutions: 970 (1m: --- c/s, 5m: --- c/s, 15m: --- c/s, 30m: --- c/s, 60m: --- c/s)
2022-12-06T22:48:54.225033Z  INFO aleo_prover::prover: New proof target: 40150609
2022-12-06T22:49:19.214605Z  INFO aleo_prover::prover: New proof target: 40316194
2022-12-06T22:49:39.142668Z  INFO aleo_prover::prover: Total solutions: 2948 (1m: 32.97 c/s, 5m: --- c/s, 15m: --- c/s, 30m: --- c/s, 60m: --- c/s)

what pool can I use for --pool?

for the --pool argument, what pool can I use please?

Disconnected from beacon，how can i do it

there is some time error： Disconnected from beacon
2022-12-02T01:17:04.989108Z ERROR aleo_prover::client_direct: Disconnected from beacon
2022-12-02T01:17:09.893921Z INFO aleo_prover::prover: Total solutions: 97142 (1m: 42.67 c/s, 5m: 42.68 c/s, 15m: 42.67 c/s, 30m: 42.65 c/s, 60m: --- c/s)
2022-12-02T01:17:09.990959Z INFO aleo_prover::client_direct: Connecting to server...
2022-12-02T01:17:10.145969Z INFO aleo_prover::client_direct: Connected to 138.197.190.94:4133
2022-12-02T01:17:11.009864Z INFO aleo_prover::prover: New proof target: 718072
2022-12-02T01:17:30.274085Z INFO aleo_prover::prover: New proof target: 721351
2022-12-02T01:17:43.953187Z INFO aleo_prover::client_direct: New connection from: 223.80.76.219:22316
2022-12-02T01:17:46.370615Z INFO aleo_prover::client_direct: New connection from: 23.226.73.106:33464
2022-12-02T01:17:55.231205Z INFO aleo_prover::prover: New proof target: 722914
2022-12-02T01:18:09.894895Z INFO aleo_prover::prover: Total solutions: 99704 (1m: 42.70 c/s, 5m: 42.68 c/s, 15m: 42.67 c/s, 30m: 42.65 c/s, 60m: --- c/s)
2022-12-02T01:18:20.256575Z INFO aleo_prover::prover: New proof target: 725741
2022-12-02T01:18:45.259039Z INFO aleo_prover::prover: New proof target: 724960
2022-12-02T01:18:51.212294Z INFO aleo_prover::client_direct: New connection from: 121.182.54.20:44864
2022-12-02T01:19:08.580370Z INFO aleo_prover::client_direct: New connection from: 59.23.202.8:32992
2022-12-02T01:19:09.895382Z INFO aleo_prover::prover: Total solutions: 102264 (1m: 42.67 c/s, 5m: 42.69 c/s, 15m: 42.67 c/s, 30m: 42.65 c/s, 60m: --- c/s)
2022-12-02T01:19:10.246396Z INFO aleo_prover::prover: New proof target: 726376
2022-12-02T01:19:15.835127Z INFO aleo_prover::client_direct: New connection from: 43.155.159.190:57192
2022-12-02T01:19:35.245042Z INFO aleo_prover::prover: New proof target: 725121
2022-12-02T01:19:38.269948Z INFO aleo_prover::client_direct: New connection from: 43.130.196.163:56886
2022-12-02T01:20:00.149194Z ERROR aleo_prover::client_direct: Disconnected from beacon
2022-12-02T01:20:05.150707Z INFO aleo_prover::client_direct: Connecting to server...
2022-12-02T01:20:05.309388Z INFO aleo_prover::client_direct: Connected to 46.101.114.158:4133
2022-12-02T01:20:06.210966Z INFO aleo_prover::prover: New proof target: 726692
2022-12-02T01:20:09.896378Z INFO aleo_prover::prover: Total solutions: 104825 (1m: 42.68 c/s, 5m: 42.69 c/s, 15m: 42.67 c/s, 30m: 42.66 c/s, 60m: --- c/s)
2022-12-02T01:20:25.252812Z INFO aleo_prover::prover: New proof target: 727002
2022-12-02T01:20:33.919791Z INFO aleo_prover::client_direct: New connection from: 5.75.225.60:39456
2022-12-02T01:20:50.273738Z INFO aleo_prover::prover: New proof target: 728744
2022-12-02T01:20:58.218131Z INFO aleo_prover::client_direct: New connection from: 101.71.224.248:36714
2022-12-02T01:21:09.897904Z INFO aleo_prover::prover: Total solutions: 107387 (1m: 42.70 c/s, 5m: 42.68 c/s, 15m: 42.67 c/s, 30m: 42.66 c/s, 60m: --- c/s)
2022-12-02T01:21:15.224064Z INFO aleo_prover::prover: New proof target: 734295
2022-12-02T01:21:40.227738Z INFO aleo_prover::prover: New proof target: 735886
2022-12-02T01:21:43.174365Z INFO aleo_prover::client_direct: New connection from: 59.23.202.115:51318
2022-12-02T01:21:45.979206Z INFO aleo_prover::client_direct: New connection from: 49.51.99.244:41746

error: no matching package named `snarkos-node-messages` found

when i join node aleo to pool it show like that, pls support me fix
cargo build --release
error: no matching package named snarkos-node-messages found
location searched: https://github.com/AleoHQ/snarkOS.git?rev=8f7f6d9#8f7f6d99
required by package aleo-prover v0.5.1 (/root/aleo-prover)

CUDA failed

Error loading cuda program: IO(Os { code: 2, kind: NotFound, message: "No such file or directory" })
CUDA failed, moving to the next MSM method
CUDA failed, moving to the next MSM method
CUDA failed, moving to the next MSM method

Cuda failed

The cuda's version is 11.8 and gpu is 3080. So, Is my cuda version wrong?

CUDA build failed

using CUDA 11.2 on Ubuntu 18.04

error: linking with `cc` failed: exit status: 1
  |
  = note: "cc" "-m64" "/tmp/rustc34h9Yw/symbols.o" "/root/aleo-prover/target/release/deps/aleo_prover-18d199d49d2a8ded.aleo_prover.1d97f3f0-cgu.0.rcgu.o" "-Wl,--as-needed" "-L" "/root/aleo-prover/target/release/deps" "-L" "/root/aleo-prover/target/release/build/snarkvm-cuda-ecfceb3bcf9c7dd3/out" "-L" "/root/aleo-prover/target/release/build/blst-a1efdb917a5ef45b/out" "-L" "/root/aleo-prover/target/release/build/curl-sys-57f21fcae3bbf520/out/build" "-L" "/root/aleo-prover/target/release/build/libz-sys-299ca258f4d02532/out/lib" "-L" "/root/aleo-prover/target/release/build/libz-sys-299ca258f4d02532/out/lib" "-L" "/root/aleo-prover/target/release/build/ring-e88af84875cf3f54/out" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/tmp/rustc34h9Yw/libring-c300d20d950cad5b.rlib" "/tmp/rustc34h9Yw/libsnarkvm_cuda-abdc56e5a0f6a673.rlib" "/tmp/rustc34h9Yw/libblst-da5eb185f18af887.rlib" "/tmp/rustc34h9Yw/libcurl_sys-3bf80d05cdb1333e.rlib" "/tmp/rustc34h9Yw/liblibz_sys-97c515cd179fdaae.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-272ca28f0b8538d5.rlib" "-Wl,-Bdynamic" "-lssl" "-lcrypto" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-znoexecstack" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/root/aleo-prover/target/release/deps/aleo_prover-18d199d49d2a8ded" "-Wl,--gc-sections" "-pie" "-Wl,-zrelro,-znow" "-Wl,-O1" "-nodefaultlibs"
  = note: /root/aleo-prover/target/release/deps/aleo_prover-18d199d49d2a8ded.aleo_prover.1d97f3f0-cgu.0.rcgu.o: In function `rayon_core::thread_pool::ThreadPool::install::{{closure}}':
          aleo_prover.1d97f3f0-cgu.0:(.text._ZN10rayon_core11thread_pool10ThreadPool7install28_$u7b$$u7b$closure$u7d$$u7d$17h2a6910cc806e82e5E+0x192): undefined reference to `snarkvm_ntt'
          /root/aleo-prover/target/release/deps/aleo_prover-18d199d49d2a8ded.aleo_prover.1d97f3f0-cgu.0.rcgu.o: In function `snarkvm_algorithms::msm::variable_base::VariableBase::msm':
          aleo_prover.1d97f3f0-cgu.0:(.text._ZN18snarkvm_algorithms3msm13variable_base12VariableBase3msm17hd2f277f0ea0033ebE+0x53): undefined reference to `snarkvm_msm'
          collect2: error: ld returned 1 exit status

  = help: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#cargorustc-link-libkindname)

Linux Version?

How can I make it use multiple GPUs ?

2022-12-06T10:09:02.616521Z INFO aleo_prover::prover: Received new work: epoch 617 2022-12-06T10:09:02.616541Z WARN aleo_prover::prover: This version of the prover is only using the first GPU

I am on tetsnet3-direct-cuda branch and even after passing -g 0 -g 1 it's giving me the above log message, is there any other version of prover which utilizes all gpus ?

Also its only using 3% of my gpu memory from what I can see.