Code for nuScenes Dataset about centerformer

[edwardzhou130]

Thanks for your interest in our work. The result we provided in the supplemental materials was from a simple version of CenterFormer, which only aims to demonstrate the improvement of our transformer structure. I still need to test it with some features in our paper (deformable attention/ multi-frame fusion) and find a more suitable training setting. I will add the codes for nuScenes once I complete those experiments.

[edwardzhou130]

@rockywind You can refer to CenterPoint's configs for the training in nuScenes. What I did was simply switch the neck and bbox head to CenterFormer.
Some notes: 1) Some modules and parameters that work well in Waymo may not work in nuScenes due to the difference in the data and evaluation method, like the IoU loss.

centerformer/configs/waymo/voxelnet/waymo_centerformer.py

Line 59 in 0408b29

iou_loss=True,

2) Our released code currently does not support multi-task in the bbox head.

[rockywind]

@edwardzhou130
您好，有个问题请教一下哈。
怎么用nuscene数据集去调试，centerformer代码。手中暂时没有waymo数据集

[rockywind]

@edwardzhou130
您好，按照这个教程安装，运行会报这个错。

  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/detectors/voxelnet_dynamic.py", line 20, in __init__
    super(VoxelNet_dynamic, self).__init__(
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/detectors/single_stage.py", line 24, in __init__
    self.backbone = builder.build_backbone(backbone)
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/builder.py", line 35, in build_backbone
    return build(cfg, BACKBONES)
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/builder.py", line 21, in build
    return build_from_cfg(cfg, registry, default_args)
  File "/DATA2/xiaoquan.wang/centerformer/det3d/utils/registry.py", line 65, in build_from_cfg
    raise KeyError(
KeyError: 'SpMiddleResNetFHD is not in the backbone registry'

[dk-liang]

@edwardzhou130 您好，按照这个教程安装，运行会报这个错。

  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/detectors/voxelnet_dynamic.py", line 20, in __init__
    super(VoxelNet_dynamic, self).__init__(
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/detectors/single_stage.py", line 24, in __init__
    self.backbone = builder.build_backbone(backbone)
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/builder.py", line 35, in build_backbone
    return build(cfg, BACKBONES)
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/builder.py", line 21, in build
    return build_from_cfg(cfg, registry, default_args)
  File "/DATA2/xiaoquan.wang/centerformer/det3d/utils/registry.py", line 65, in build_from_cfg
    raise KeyError(
KeyError: 'SpMiddleResNetFHD is not in the backbone registry'

You need to install spconv1.2.1

[rockywind]

@dk-liang @edwardzhou130
十分感谢。安装好spconv1.2.1,根据这个教程。安装过程没有报错
会出现这个错误。

    from .scn import SpMiddleResNetFHD
  File "/DATA2/xiaoquan.wang/centerformer/det3d/models/backbones/scn.py", line 3, in <module>
    from spconv import SparseConv3d, SubMConv3d
ImportError: cannot import name 'SparseConv3d' from 'spconv' (/home/zongmu/anaconda3/envs/centerformer/lib/python3.9/site-packages/spconv/__init__.py)

[edwardzhou130]

@rockywind Looks like your spconv was not installed correctly.