I am a Robotics PhD student in CMU with Kris Kitani since 2020.
Prior to CMU, I received bachelor degree from Shanghai Jiao Tong University in 2020, advised by Cewu Lu. I visited UC Berkeley in 2019, advised by Fisher Yu and Trevor Darrell. I also visited Yang Gao's group at Tsinghua University during COVID in 2020. I have interned in Adobe Research, Meta Reality Labs, Tencent and Bytedance AI Lab etc. My research is supported by Meta PhD Fellowship since 2023.
I am interested in the human shape (pose estimation), motion (tracking, forecasting, generation) and behavior (human-scene, human-object, human-human interaction) in the 3D and physical world. My research focus is estimating and generating human motion from interactions (w/ humans, objects or environment).
Github |
Google Scholar |
Linkedin |
DBLP |
Resume (usually out-dated)
Email: jinkuncao [AT] gmail.com / jinkunc [AT] andrew.cmu.edu
News
- [2024/9]: Three papers accepted to NeurIPS 2024 and one paper accepted to NeurIPS DB Track 2024. See you in Vancouver! (Hopefully I could get a visa)
- [2024/3]: Concluded my tracking research in a thesis. My recent research is more about the generation of human shape, motion and behavior.
- [2024/2]: SimXR for pose estimation and simulation from head-mounted cameras is accepted by CVPR 2024. Congrats to Zen!
- [2024/2]: CSC-Tracker for multi-object tracking is accepted by ICRA 2024. Stay tuned for more details!
- [2024/1]: Two papers are accepted by ICLR as Spotlights. Check UniHSI and PULSE for details!
- [2023/7]: One paper about humanoid control is accpeted to ICCV. Congrats, Zen! Looking forward to the trip to Paris.
- [2023/4]: Awarded Meta PhD Research Fellowship since 2023. Thank you Meta!
- [2023/2]: Deep OC-SORT is available on arxiv and Github, ranking 1st on MOT17, MOT20 and DanceTrack among published papers.
- [2023/2]: Two papers are accepted to CVPR 2023 (including OC-SORT). See you at Vancouver.
- [2022/9]: A paper is accepted to BMVC'2022 for multi-object tracking. The paper is coming to the public soon.
- [2022/9]: MED paper is accepted by NeurIPS'2022. We study the disentanglement property of high-dimensional representation models and introduce contrastive learning methods into disentanglement benchmarks. Stay tuned for a heavily revised veresion of paper.
- [2022/8]: OC-SORT is supported by mmtracking now. Try it for more flexible and advanced features!
- [2022/3]: The code of OC-SORT is released. It achieves SOTA performance on multiple MOT datasets in a pure motion-based fashion.
- [2022/3]: We are organizing "Multiple Object Tracking in Complex Environments Workshop” in ECCV'2022, Tel Aviv, Israel.
- [2022/2]: DanceTrack is accepted in CVPR'2022. We propose a challenging multi-object tracking dataset.
Selected Publications
* indicates equal contribution
Multi-Object Tracking by Hierarchical Visual Representations
ICRA 2024 [arxiv]
Perpetual Humanoid Control for Real-time Simulated Avatars
ICCV 2023 [project page] [arxiv] [code]
Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking
CVPR 2023 [arxiv] [code] [mmtracking]
Track Targets by Dense Spatio-Temporal Position Encoding
BMVC 2022 [Oral] [arxiv]
DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motion
CVPR 2022 [arxiv] [code] [project page] [codalab]
Manuscripts
* indicates equal contribution
Grasping Diverse Objects with Simulated Humanoids
2024 [project]
Multi-Modal Hand-Object Interaction Generation
2024 [arxiv]
Mixed Gaussian Flow for Diverse Trajectory Prediction
2024 [arxiv]
Services
- Conference Reviewer:
- Computer Vision: ICCV (21, 23), ECCV (20, 22, 24), CVPR (22, 23, 24), ISMAR (23, 24)
- Robotics: ICRA (22, 23, 24), IROS (22)
- Machine Learning: NeurIPS (22, 23), AAAI (22, 23, 24), ICML (23, 24), ICLR (24)
- Journal Reviewer: RA-L, IEEE Trans. Multimedia, TNNLS, TCSVT, Pattern Recoginition, TMLR
- Workshop Organizer: