|
12 | 12 |
|
13 | 13 | This is the simplest implementation of Roboflow [zero-shot-object-tracking](https://github.com/roboflow-ai/zero-shot-object-tracking); which incorporates CLIP as a feature extractor in DeepSORT. [CLIP](https://openai.com/blog/clip/) is a zero-shot classification model; which is pretrained under vision-langauge supervision with a lot of data. |
14 | 14 |
|
15 | | -The benefit of this approach is that it can track a lof of classes out-of-the-box without needing to re-train the feature extractor (re-identification model) in DeepSORT. Its performance will not be as good as traditional re-identification model; which is trained for specific purpose. |
| 15 | +The benefit of this approach is that it can track a lof of classes out-of-the-box without needing to re-train the feature extractor (re-identification model) in DeepSORT. Its performance may not be as good as traditional re-identification model; which is trained for specific purpose. |
16 | 16 |
|
17 | 17 |
|
18 | 18 | ## Requirements |
@@ -59,26 +59,28 @@ $ python track.py --source VIDEO_PATH --yolo-model-path checkpoints/yolov5s.pt - |
59 | 59 | * Save the tracking results of MOT16 with the following command: |
60 | 60 |
|
61 | 61 | ```bash |
62 | | -$ python eval_mot.py --root MOT_DATASET_ROOT_DIR --yolo-model-path checkpoints/yolov5m.pt |
| 62 | +$ python eval_mot.py --root MOT16_ROOT_DIR --yolo-model-path checkpoints/yolov5m.pt |
63 | 63 | ``` |
64 | 64 |
|
65 | 65 | * Evaluate with TrackEval: |
66 | 66 |
|
67 | 67 | ```bash |
68 | 68 | $ python TrackEval/scripts/run_mot_challenge.py |
69 | 69 | --BENCHMARK MOT16 |
70 | | - --GT_FOLDER /home/sithu/datasets/simple-object-tracking/data/gt/mot_challenge/ |
71 | | - --TRACKERS_FOLDER /home/sithu/datasets/simple-object-tracking/data/trackers/mot_challenge/ |
| 70 | + --GT_FOLDER PROJECT_ROOT/data/gt/mot_challenge/ |
| 71 | + --TRACKERS_FOLDER PROJECT_ROOT/data/trackers/mot_challenge/ |
72 | 72 | --TRACKERS_TO_EVAL mot_det |
73 | 73 | --SPLIT_TO_EVAL train |
74 | 74 | --USE_PARALLEL True |
75 | 75 | --NUM_PARALLEL_CORES 4 |
76 | 76 | --PRINT_ONLY_COMBINED True |
77 | 77 | ``` |
78 | 78 |
|
| 79 | +> Notes: `FOLDER` parameters in `run_mot_challenge.py` must be an absolute path. |
| 80 | +
|
79 | 81 | Detector | Feature Extractor | MOTA | HOTA | IDF1 | IDs | MT | ML | FP | FN |
80 | 82 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
81 | | -YOLOv5m-COCO | CLIP <br>(ViT-B/32) | 35.289 | 35.029 | 38.334 | 335 | 117 | 191 | 7061 | 63865 |
| 83 | +YOLOv5m<br>(COCO) | CLIP<br>(ViT-B/32) | 35.289 | 35.029 | 38.334 | 335 | 117 | 191 | 7061 | 63865 |
82 | 84 |
|
83 | 85 |
|
84 | 86 | ## References |
|
0 commit comments