GithubHelp home page GithubHelp logo

mcg-nju / link Goto Github PK

View Code? Open in Web Editor NEW
81.0 7.0 6.0 535 KB

[CVPR 2023] LinK: Linear Kernel for LiDAR-based 3D Perception

License: MIT License

Python 84.74% C++ 5.24% Cuda 9.09% Shell 0.38% C 0.55%
detection point-cloud segmentation nuscenes semantickitti large-kernels autonomous-driving

link's Issues

some questions about training

Hi,

Thank you for the great work!

I tried to use pcdet to run Link, I modified SpMiddleResNetFHDELKv3 model. It works, but I had some questions during the debug process.

  1. Funtion small_to_large_v2: (line 84 in ts_elk.py). F.spdevoxelize requires only 3 input elements. So can I change the new_feat = F.spdevoxelize(f, idx_query, weights, kernel_size) to new_feat = F.spdevoxelize(f, idx_query, weights)?
  2. I had nan in training process. When I debug it, I found that here divides by 0 (Funtion small_to_large_v2: new_feat = new_feat[:,:-1] / (new_feat[:,-1:]) ). Can I add a small value here (e.g. 1e-8) ?

When I finished training, I found that Link was a little better (1 mAP) than CenterPoint(3d spconv). Is this normal? Is it possible that the changes I made above are causing poor performance?

Problems in the Evaluation and Submission of segmentation

Thanks for this excellent piece of work! I encountered "Warning: could not find environment variable "-x", mpirun was unable to find the specified executable file, and therefore did not launch the job. Warning: could not find environment variable "-x", mpirun was unable to find the specified executable file, and therefore did not launch the job. This error was first reported for process rank 0; it may have occurred for other processes as well", but I have already run the chmod +x evaluate.sh command, and I would like to know how to create a hyperlink to the semantickitti dataset if it is placed in a different location, and is hyperlink necessary?

how to visualize eval result

when I run the follow command:

python -m torch.distributed.launch --nproc_per_node=4 --master_port 23456 ./tools/train.py \
  configs/nusc/voxelnet/nusc_centerpoint_voxelnet_0075voxel_fix_bn_z_elkv3.py \
  --work_dir work_dirs/0075cbgs_cos3x7_group2_15+5 \
  --resume_from work_dirs/0075cbgs_cos3x7_group2/epoch_15.pth

I get a prediction.pkl in work_dir work_dirs/0075cbgs_cos3x7_group2_15+5 directory, I want visualize the result, but I find the ./detection/tools/visual.py can not work well, so where can I find the scrip to visualize predict result.

Problems encountered when installing torchsparse

As mentioned in the paper, training with 3090 is feasible. Installing CUDA10.2 in 3090 is difficult. So I'm using CUDA11.3, Python3.7.10, pytorch1.10.1. The previous steps performed according to installation, and detectioin was added to PYTHONPATH, but when executing the last step, "pip install./torchsparse-u/", the error is as follows

Processing ./torchsparse-u
Preparing metadata (setup.py) ... done
Building wheels for collected packages: torchsparse
Building wheel for torchsparse (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [112 lines of output]
...
subprocess.CalledProcessError: Command '['which', 'c++']' returned non-zero exit status 1.
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for torchsparse
Running setup.py clean for torchsparse
Failed to build torchsparse
ERROR: Could not build wheels for torchsparse, which is required to install pyproject.toml-based projects

What might be the cause of this problem? Could you please give some reference configuration advice on using CUDA11.3 installation project environment on 3090?Besides,is the requirement.txt exactly the same as the requirement.txt in CenterPoint?

about modified Torchsparse

Hi,could you please tell the differences between torchsparse1.14.0 and the modified Torchsparse ? cause there is a new version Torchsparse that is easier to install , when i want to use your torchsparse I need to change my gcc version to lower version.

问一个问题

只刷点云,刷了nuscenes数据集,效果还可以,这样投稿能中吗?我看你还专门刷了kitti,有谁告诉你的,请指点一下,我论文刚写完,准备投稿

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.