HITrack

3D scene on a monocular video


Keywords
HITrack
License
MIT
Install
pip install HITrack==1.0.4

Documentation

HITrack

HITrack or Human Inertial Tracking is a pipeline consisting of 3 human recognition state-of-the-art neural networks (yolov7, VitPose and MHFormer) linked together by specially designed Inertial Tracking to produce a 3D scene on a monocular image.

Quick start

pip install HITrack
from HITrack import HITrack
hit = HITrack('videos/dance.mp4')

# 2D keypoints + tracking
hit.compute_2d()

# merging recovered tracks and broken tracks manually
hit.recover_2d({1:6, 2:5, 3:4})

# 2D to 3D by tracking
hit.compute_3d()

# 3D to scene
hit.compute_scene()

# visualising any of these steps
hit.visualize('3D_scene', compress=True, original_sound=True)

License

This project is licensed under the terms of the MIT license.