Visualization is better if the data is not classified about ab3dmot

[xinshuoweng]

Hey, that is a good point! Actually, this is different from what I tried before. When I do matching for all categories together I get worse performance. This is because different object categories have different sizes, motion dynamics, so need to use a different set of matching threshold/metrics to achieve optimal performance.

But, to answer your question, you can simply merge all data into a single folder and then do matching altogether. But you should not assign the type of all data to 1 based on our current evaluation code, which only runs evaluation per category (matching with GT objects having the same category) so the category data for each tracklet is needed. This is why you get bad performance after running an evaluation.

[yanshuaibupt]

I did the evaluation on all kitti training data, and the result is: car: sAMOTA=0.93, pedestrian: sAMOTA=0.74, all: mean MOTA=0.9108 (using motmetrics evaluation on all 21 trainset). I consider that different sizes of objects do not affect the 3D IOU value, because they are in the same 3D coordinate! A person and a car can never overlap theoretically.

[xinshuoweng]

From these numbers, it seems worse than separating evaluation as well, especially for the pedestrian. But I am not sure what evaluation criteria you are using and also the evaluation is done on all 21 rather than only the validation sequence so the results may vary. To be clear, my original point is not that we will get different 3D IoU values when tracking all categories. Instead, the point was that the optimal matching threshold for different categories might be different, which can be found below for example:

AB3DMOT/AB3DMOT_libs/model.py

Lines 53 to 57 in 933e4af

	elif cfg.det_name == 'pointrcnn': # tuned for PointRCNN detections
	if cat == 'Car': algm, metric, thres, min_hits, max_age = 'hungar', 'giou_3d', -0.2, 3, 2
	elif cat == 'Pedestrian': algm, metric, thres, min_hits, max_age = 'greedy', 'giou_3d', -0.4, 1, 4
	elif cat == 'Cyclist': algm, metric, thres, min_hits, max_age = 'hungar', 'dist_3d', 2, 3, 4
	else: assert False, 'error'