nizhf / hoi-prediction-gaze-transformer Goto Github PK

When running python run.py --source path/to/video --out path/to/output_folder --future 0 --hoi-thres 0.3 --print
Some errors occurred:

Traceback (most recent call last):
File "D:\pythonWorkPlace\HOI-Tracking\hoi-prediction-gaze-transformer-main\run.py", line 424, in
main(opt)
File "D:\codingSoftware\Anaconda\envs\hoi_gaze_cpu\lib\site-packages\torch\autograd\grad_mode.py", line 28, in decorate_context
return func(*args, **kwargs)
File "D:\pythonWorkPlace\HOI-Tracking\hoi-prediction-gaze-transformer-main\run.py", line 184, in main
object_tracking_module.warmup(frame.to(device), frame0)
File "D:\pythonWorkPlace\HOI-Tracking\hoi-prediction-gaze-transformer-main\modules\object_tracking\object_tracking.py", line 81, in warmup
self.object_tracker.track(frame, original_frame)
File "D:\pythonWorkPlace\HOI-Tracking\hoi-prediction-gaze-transformer-main\modules\object_tracking\yolov5_deepsort.py", line 166, in track
bbox_detected, label_detected, confidence_detected = self.yolov5_object_detector.detect(frame, original_frame)
File "D:\pythonWorkPlace\HOI-Tracking\hoi-prediction-gaze-transformer-main\modules\object_tracking\yolov5_deepsort.py", line 70, in detect
pred = non_max_suppression(pred, self.conf_thres, self.iou_thres, classes=self.classes, time_limit=1.0)
File "D:\pythonWorkPlace\HOI-Tracking\hoi-prediction-gaze-transformer-main\modules\object_tracking\yolov5_deepsort.py", line 227, in non_max_suppression
bs = prediction.shape[0] # batch size
AttributeError: 'list' object has no attribute 'shape'

Thanks a lot for open source your work! I'm having some trouble with the annotation file, as stated in the ST-HOI paper, VidHOI have 557 different combination of <person, predicate, object>, however in your repo vidhoi_related/dataset_info_train.json and vidhoi_related/dataset_info_train.json (and I also counted myself), there are more than 1000 combination HOIs, so how do we explain this conflict? How should I use this information?
To be more specific, what does 'triplet_train_hist', 'triplet_val_hist', 'triplet_val_unique' means? Any help is greatly appreciated!

The file is not in this download site~
(https://drive.google.com/drive/folders/0B94KbEj1tO9nfi05YmlvS1ctdWRxVVhISVQ5b2FQN293MTRhMzFNY1p4QWY0TzhQVkR4ekk?resourcekey=0-TwBoRuVnDeRZCpgzACYPsA)
Could you please help me find this json doc? Maybe det_val_frame_annots.json(existed) is not equal to val_frame_annots.json?

Hi!
When I tried to train a model, the error occurred:
FileNotFoundError: [Errno 2] No such file or directory: 'VidOR/VidHOI_gaze/train_frame_gazes_gt_bbox.dat'
Could you please share the related data?

I'd like to train a model of Detection Mode, but your training code is maybe only for Oracle Mode.

Hello Owner,

When I am using the code:

!conda install mamba -c conda-forge # install mamba in base environment
!mamba create -n hoi_torch110 python=3.9 -c conda-forge
!conda activate hoi_torch110
!mamba install pytorch==1.10.0 torchvision==0.11.0 torchaudio==0.10.0 torchtext==0.11.0 cudatoolkit=11.3 matplotlib numpy opencv Pillow PyYAML requests scipy tqdm tensorboard wandb pandas seaborn Cython easydict gdown scikit-learn imageio notebook ipywidgets black -c pytorch -c conda-forge

Its not getting executed as torchvision==0.11.0 is yanked means its not available so there is no use of torch version 1.10.0 so its not getting executed in google colab, please suggest me a different code for this.

Warm Regards,
Tanishq Agarwal

Is the training set and validation set somewhere/VidOR/video/? What about the numbering conflict？