GithubHelp home page GithubHelp logo

Train script doesnt run about plenoctree HOT 4 OPEN

grgkopanas avatar grgkopanas commented on May 18, 2024
Train script doesnt run

from plenoctree.

Comments (4)

grgkopanas avatar grgkopanas commented on May 18, 2024

I also tried to manully install all dependencies by following the guidelines of each respective pacakage (jax, flax, tensorflow etc)
and ended up in another error which is deeper in the code:

I0119 11:16:00.161019 140446576289600 checkpoints.py:249] Found no checkpoint files in ckpts/chair
/home/gkopanas/.conda/envs/plenoctrees4/lib/python3.8/site-packages/jax/_src/lib/xla_bridge.py:413: UserWarning: jax.host_id has been renamed to jax.process_index. This alias will eventually be removed; please update your code.
  warnings.warn(
* Prefetch
/home/gkopanas/.conda/envs/plenoctrees4/lib/python3.8/site-packages/jax/interpreters/xla.py:799: UserWarning: Some donated buffers were not usable: f32[1024,3]{1,0}, f32[1024,3]{1,0}, f32[1024,3]{1,0}, f32[1024,3]{1,0}
  warnings.warn("Some donated buffers were not usable: {}".format(
Traceback (most recent call last):
  File "/home/gkopanas/.conda/envs/plenoctrees4/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/gkopanas/.conda/envs/plenoctrees4/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/data/graphdeco/user/gkopanas/plenoctree/nerf_sh/train.py", line 314, in <module>
    app.run(main)
  File "/home/gkopanas/.conda/envs/plenoctrees4/lib/python3.8/site-packages/absl/app.py", line 312, in run
    _run_main(main, args)
  File "/home/gkopanas/.conda/envs/plenoctrees4/lib/python3.8/site-packages/absl/app.py", line 258, in _run_main
    sys.exit(main(argv))
  File "/data/graphdeco/user/gkopanas/plenoctree/nerf_sh/train.py", line 198, in main
    state, stats, keys = train_pstep(keys, state, batch, lr)
ValueError: INTERNAL: Failed to launch CUDA kernel: fusion_201 with block dimensions: 1024x1x1 and grid dimensions: 576x1x1: CUDA_ERROR_ILLEGAL_ADDRESS: an illegal memory access was encountered

from plenoctree.

Holmes-Alan avatar Holmes-Alan commented on May 18, 2024

Have you resolved the problem?

from plenoctree.

drcfts avatar drcfts commented on May 18, 2024

Were you or @Holmes-Alan able to solve this problem?

from plenoctree.

chenyuntc avatar chenyuntc commented on May 18, 2024

The key is to setup jax env

from plenoctree.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.