Tracking support

[SkalskiP]

Search before asking

• I have searched the Supervision issues and found no similar feature requests.

Description

Expected API

• Try to implement ByteTrack in such a way that more trackers can be added in the future
• Roboflow Inference Server requires:
  • possibility to reset the tracker
  • the possibility of initiating a tracker providing the state

from abc import ABC, abstractmethod


class BaseTracker(ABC):

    @abstractmethod
    def update(self, detections: Detections) -> Detections:
        pass

class BYTETracker(BaseTracker):
   
    def __init__(self, state: dict):
        pass

    @classmethod
    def init(cls, config: dict) -> BYTETracker
        pass

    def update(self, detections: Detections) -> Detections:
        pass

Resources

• ByteTrack official implementation - link
• ByteTrack YOLOv8 implementation - link

Use case

• supervision is expected to power tracking in the Roboflow Inference Server
• we want to enable supervision users to track objects regardless of the detection model they use easily

Additional

• The code should be placed in the newly created supervision.track package
• Provide a Jupyter Notebook that allows testing of ByteTrack on an example video
• We don't require 100% test coverage but if possible try to add unit tests

[hardikdava]

Hi @SkalskiP 👋, I am going to love this feature. By the way, I have already done this in separate project of mine. Let me know if I can help you to contribute on this one.

[SkalskiP]

Hi, @hardikdava 👋🏻! This one is allocated for one of Roboflow's engineers. But I want the two of us to review the code.

Could you share the link to your implementation? Or is it private?

By the way, I have a full week allocated for supervision support. 🔥

[hardikdava]

@SkalskiP I am afraid my project is private. But you can reference this. We can get inspiration from this and for a quick start just make detection format conversion. Later, it can be optimized for a speed.

[SkalskiP]

@hardikdava that is another excellent resource!

[hardikdava]

@SkalskiP on a side note, if you merger #170 and #171 regarding annotators, then it will be easier for @paulguerrie to verify tracker algorithm.

[SkalskiP]

@hardikdava I'm working on my GitHub todo list right now :)

[SkalskiP]

Tracker is merged into develop with #256 PR. Closing the task.