Livetraj: Real-Time trajectory tracking over live video streams

Tom Z J Fu, Jianbing Ding, Yin Yang, Zhenjie Zhang, Richard T B Ma, Yong Pei, Marianne Winslett, Bingbing Ni

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)


We present LiveTraj, a novel system for tracking trajectories in a live video stream in real time, backed by a cloud platform. Although trajectory tracking is a well-studied topic in computer vision, so far most attention has been devoted to improving the accuracy of trajectory tracking, rather than the efficiency. To our knowledge, LiveTraj is the first that achieves real-Time efficiency in trajectory tracking, which can be a key enabler in many important applications such as video surveillance, action recognition and robotics. LiveTraj is based on a state-of-The-Art approach to (offline) trajectory tracking; its main innovation is to adapt this base solution to run on an elastic cloud platform to achieve real-Time tracking speed at an affordable cost. The video demo shows the offline base solution and LiveTraj side by side, both running on a video stream containing human actions. Besides demonstrating the real-Time efficiency of LiveTraj, our video demo also exhibits important system parameters to the audience such as latency and cloud resource usage for different components of the system. Further, if the conference venue provides sufficiently fast Internet connection to our cloud platform, we also plan to demonstrate LiveTraj on-site, during which we will show LiveTraj identifying and tracking trajectories from a live video stream captured by a camera.

Original languageEnglish
Title of host publicationMM 2015 - Proceedings of the 2015 ACM Multimedia Conference
PublisherAssociation for Computing Machinery, Inc
Number of pages4
ISBN (Electronic)9781450334594
Publication statusPublished - 13 Oct 2015
Externally publishedYes
Event23rd ACM International Conference on Multimedia, MM 2015 - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015


Other23rd ACM International Conference on Multimedia, MM 2015



  • Elastic cloud.
  • Real-Time video analysis
  • Trajectory tracking

ASJC Scopus subject areas

  • Media Technology
  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Fu, T. Z. J., Ding, J., Yang, Y., Zhang, Z., Ma, R. T. B., Pei, Y., Winslett, M., & Ni, B. (2015). Livetraj: Real-Time trajectory tracking over live video streams. In MM 2015 - Proceedings of the 2015 ACM Multimedia Conference (pp. 777-780). Association for Computing Machinery, Inc.