Comments (4)
Thanks for your interest! First, we have not used av2_map_dataset.py, we use av2_offlinemap_dataset.py. Second, we pass e2g to this function here. The disturbing args are inherited from nuScenes map dataset. So the implementation is right. Sorry for the misleading.
from maptr.
Thank you for your feedback!
I still have two more questions 1. where is the av2_offlinemap_dataset.py you mentioned? According to maptr_tiny_r50_av2_24e.py
I think the dataset used in training and testing Argoverse2 should be the class CustomAV2LocalMapDataset
in av2_map_dataset.py
, am I right?
2. in this line of code in 1136 in av2_map_dataset.py
,
lidar2cam_rt = cam_info['extrinsics']
I'm afraid you still think ego=lidar,and directly assign the camera extrinsics to lidar2cam_rt, is it correct to do so? I think this will affect the GKT calculation.
Additionally, I can see this function:
anns_results = self.vector_map.gen_vectorized_samples(location, map_elements, e2g_translation, e2g_rotation)
It's OK.
Thanks again.
from maptr.
Thank you for your feedback! I still have two more questions 1. where is the av2_offlinemap_dataset.py you mentioned? According to
maptr_tiny_r50_av2_24e.py
I think the dataset used in training and testing Argoverse2 should be the classCustomAV2LocalMapDataset
inav2_map_dataset.py
, am I right? 2. in this line of code in 1136 inav2_map_dataset.py
,
lidar2cam_rt = cam_info['extrinsics']
I'm afraid you still think ego=lidar,and directly assign the camera extrinsics to lidar2cam_rt, is it correct to do so? I think this will affect the GKT calculation.
Additionally, I can see this function:
anns_results = self.vector_map.gen_vectorized_samples(location, map_elements, e2g_translation, e2g_rotation)
It's OK. Thanks again.
av2_offlinemap_dataset.py is in maptrv2 branch. In both v1 and v2 branch, we treat the lidar coordinate system as ego coordinate system in av2 dataset, since we do not use lidar point cloud. In practice, We crop the map using ego coordinate system, the camera extrinsic is also in ego coordinate system. So the implementation is aligned, which is also proved in our visualizations.
from maptr.
OK, I totally get it, thank you very much for the clarification. So lidar2cam actually means ego2img.
But I found another problem. It's about the process of generating the 'lidar2img' transformation matrix in img_metas during training.
In av2_map_dataset.py at line 1048,we first get the input_dict['lidar2img']
:
input_dict = self.get_data_info(index)
I think this is the appropriate transform matrix as far as images of 2048 x 1550 size are concerned. But then during the train_pipeline in CustomLoadMultiViewImageFromFiles
and PadMultiViewImage
, we pad the image, at which point the camera's internal parameters must have changed, but I don't see relative code for the lidar2cam matrix to change accordingly.
Thanks again.
from maptr.
Related Issues (20)
- training not proceed after checkpoint saving
- Inquiry Regarding Argoverse2 Dataset Configuration and load_interval Settings
- How can I add trafficlight status in MapTR?
- About the reg_branch in MaptrV2Head HOT 1
- 如何在nuscenes的mini数据集上跑出可视化结果
- nuScenes dataset for MapTRv2 evatuation HOT 2
- can't reproduction evaluation results HOT 2
- 如何使用自己的数据进行训练
- the normal training loss profile
- whats the difference between maptr_tiny_r50_24e_t4 and maptr_tiny_r50_24e?
- intrinsics in transform_3d.py
- Install error HOT 2
- depth supervision code in maptrv2 is not valid? code bug?
- Can not install mmdetection3d HOT 2
- Train on multi-node machine
- Something about layer init parameters
- bev size
- 我安装好环境后出现了初始化报错的问题
- Can't find the definition of hard_voxelize
- queue length都是1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from maptr.