XPENG RoboticsSep 2022 – Dec 2022

Human–Object Interaction on Custom Data

A custom human-object interaction dataset and model training workflow.

Project Snapshot

Signal Details
Timeline Sep 2022 to Dec 2022
Organization XPENG Robotics
Focus Human Object Interaction for our Custom HOI Data
Stack Custom implementation and project-specific tooling

Contributions

  • Modified VGG Image Annotator to label triplets: subject, interaction / relationship, and object.
  • Manually labeled custom HOI data for the target domain.
  • Trained an STIP-based model for custom human-object interaction recognition.