Problem with file organization and data format when evaluating on 3d mot about ab3dmot

[DeriZSY]

Problem solved.
A few tips for evaluating MOT results using this benchmark:

The correct file organization should be: ~/AB3DMOT/results/{result_folder}/data/{seq_name}.txt, where {result_folder} is the parameter in the command.

For example when running python evaluation/evaluate_kitti3dmot.py car_3d_det_val, {result_folder} is car_3d_det_val. And {seq_name} is simply name of the sequences, for example '0000.txt'. The key thing is that the folder to look for the result is hardcoded in the code at here, where variable t_sha is the same as {result_folder} mentioned above.

Another problem is that by default, you must evaluate all sequences at the same time, otherwise, it will return a 'problem with data format' indication.

If you only want to evaluate part of the sequences, you can hardcode the sequence you want before this line. For example, if you only want to evaluate sequence 17, you should add self.sequence_name = ['0017'] before the line indicated above.

@xinshuoweng I suggest that you make some modifications or at least clarify this in README coz it's quite unreasonable. For example, there is no 'Car' category in sequence 17 thus cannot be evaluated. What's more, some learning-based MOT methods will split the training set further into sequences for training and evaluation thus will not evaluate all sequences at once.

[xinshuoweng]

Correct findings! Although I have already pointed out how to run the code in the readme files (e.g., python main.py car_3d_det_val).

For evaluating different sequences, as you have already found out, it is very simple to change and modify for different sequences. In my cases, I have to evaluate all the sequences and is thus reasonable to have the provided evaluation script and that is also the default for the KITTI dataset. If you are not doing default, you have to modify the code.