global_translate_noise in CenterForm is different from that in CenterPoint. about centerformer

[edwardzhou130]

1. In the newer version of Centerpoint, the global translation augmentation is also used: https://github.com/tianweiy/CenterPoint/blob/c4b4e0fc97ec6d42d6a31f559816d3305abdf750/configs/waymo/voxelnet/waymo_centerpoint_voxelnet_three_sweeps_20e_iou_pred.py#L116
2. I used np.random.uniform based on other published papers and haven't tried np.random.normal. I don't think this will cause a big difference, but it could be worthwhile to try.

[Liaoqing-up]

some sonfused...
Do these data augmenting strategies ensure consistency between sequential frames? How exactly is the copy-paste strategy designed between sequential frames?

[edwardzhou130]

some sonfused... Do these data augmenting strategies ensure consistency between sequential frames? How exactly is the copy-paste strategy designed between sequential frames?

The pasted object will be added to all frames in the same way (same location and augmentation noises etc.). I just assume it is a static object in the scene.

centerformer/det3d/datasets/pipelines/preprocess_multiframe.py

Lines 136 to 141 in 5a949b8

	if res["type"] in ["WaymoDataset_multi_frame"]:
	for idx, pre_points in enumerate(previous_frame):
	pre_points = np.concatenate([sampled_points, pre_points], axis=0)
	points_num.append(pre_points.shape[0])
	points = np.concatenate([points, pre_points], axis=0)
	points_timeframe.append(time_frame[idx+1])

[Liaoqing-up]

some sonfused... Do these data augmenting strategies ensure consistency between sequential frames? How exactly is the copy-paste strategy designed between sequential frames?

The pasted object will be added to all frames in the same way (same location and augmentation noises etc.). I just assume it is a static object in the scene.

centerformer/det3d/datasets/pipelines/preprocess_multiframe.py

Lines 136 to 141 in 5a949b8

	if res["type"] in ["WaymoDataset_multi_frame"]:
	for idx, pre_points in enumerate(previous_frame):
	pre_points = np.concatenate([sampled_points, pre_points], axis=0)
	points_num.append(pre_points.shape[0])
	points = np.concatenate([points, pre_points], axis=0)
	points_timeframe.append(time_frame[idx+1])

I see, but if the network has velocity prediction branch, the static object assumption may confused the network, or maybe you have already set the velocity of the paste objects in gt_target to 0? By the way, why not use the velocity of the obejct label to figure out where the obejct is in the history frame and paste on it? Is it worth a try?