Hey!
I have finetuned a network on VOC 2007, which was initially trained on COCO Dataset.
I am now trying to evaluate the training on the validation set. When I run the command,
python tools/test_net.py --dataset voc2007 --cfg configs/baselines/e2e_mask_rcnn_R-50-FPN_1x.yaml --load_ckpt {path/to/your/checkpoint},
I get this:
INFO task_evaluation.py: 61: Evaluating bounding boxes is done!
INFO task_evaluation.py: 104: Evaluating segmentations
Traceback (most recent call last):
File "tools/test_net.py", line 125, in
check_expected_results=True)
File "/home/deep/data/asif/Detectron/Detectron.pytorch/lib/core/test_engine.py", line 128, in run_inference
all_results = result_getter()
File "/home/deep/data/asif/Detectron/Detectron.pytorch/lib/core/test_engine.py", line 108, in result_getter
multi_gpu=multi_gpu_testing
File "/home/deep/data/asif/Detectron/Detectron.pytorch/lib/core/test_engine.py", line 163, in test_net_on_dataset
dataset, all_boxes, all_segms, all_keyps, output_dir
File "/home/deep/data/asif/Detectron/Detectron.pytorch/lib/datasets/task_evaluation.py", line 63, in evaluate_all
results = evaluate_masks(dataset, all_boxes, all_segms, output_dir)
File "/home/deep/data/asif/Detectron/Detectron.pytorch/lib/datasets/task_evaluation.py", line 128, in evaluate_masks
'No evaluator for dataset: {}'.format(dataset.name)
NotImplementedError: No evaluator for dataset: voc_2007_test
This appears from the task_evaluation file where no implementation for voc evaluation in masks. Is there a work around?
Since, voc is already in json format I guessed it is still possible to evaluate segmentations in the task_evaluation script! How to do this?