Journal article · 2026 · Open access

ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors

Zihao Huang, Tianqi Liu, Zhaoxi Chen, Shaocong Xu, Saining Zhang, Linqi Xiao, Zhiguo Cao, Wei Li (7081), Hao Zhao, Ziwei Liu

IEEE Transactions on Pattern Analysis and Machine Intelligence, PP, 1–15 · Published 27 October 2026 · DOI 10.1109/tpami.2026.3747767

Open full textCite this paper

In brief

“ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors” is a 2026 journal article by Zihao Huang and 9 co-authors, published in IEEE Transactions on Pattern Analysis and Machine Intelligence. OpenAlex counts 2 citations as of 18 November 2026, which puts it in the top 6% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at IEEE Transactions on Pattern Analysis and Machine Intelligence.

Citations
2
Most cited in
2026 (2)
Field-weighted impact
2.87
References
72
Authors
10

Abstract

Synthesizing physically plausible articulated human-object interactions (HOI) without 3D/4D supervision remains a fundamental challenge. Recent zero-shot approaches use generative priors for 4D human-object interaction synthesis, but recovering explicit articulated object geometry from monocular video remains challenging. We formulate articulated HOI synthesis as a 4D reconstruction problem from monocular video priors. Given a video generated by a diffusion model and initial 3D assets, we reconstruct a full 4D articulated scene without 3D motion supervision. This reconstruction-based approach treats the generated 2D video as supervision for an inverse rendering problem, recovering geometrically consistent and physically plausible 4D scenes that naturally respect contact, articulation, and temporal coherence. We introduce ArtHOI, a zero-shot system that integrates two stages for articulated human-object interaction synthesis. 1) Flow-based part segmentation maps optical-flow cues and SAM masks to 3D Gaussian parts, using quasi-static binding to separate moving and static regions. 2) Decoupled reconstruction first recovers articulated object geometry and then refines human motion using contact targets derived from the fixed object reconstruction. ArtHOI bridges video-based generation and geometry-aware reconstruction, producing interactions that are both semantically aligned and physically grounded. Across diverse articulated scenes (e.g., opening fridges, cabinets, microwaves), ArtHOI reconstructs explicit part articulation and uses the reconstructed geometry to guide human motion refinement. The project page is available at https://arthoi.github.io/.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Huang, Z., Liu, T., Chen, Z., Xu, S., Zhang, S., Xiao, L., Cao, Z., (7081), W. L., Zhao, H., & Liu, Z. (2026). ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors. IEEE Transactions on Pattern Analysis and Machine Intelligence, PP, 1–15. https://doi.org/10.1109/tpami.2026.3747767

MLA 9

Huang, Zihao, et al. “ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors.” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PP, 2026, pp. 1–15. https://doi.org/10.1109/tpami.2026.3747767.

Chicago

Huang, Zihao, Tianqi Liu, Zhaoxi Chen, Shaocong Xu, Saining Zhang, Linqi Xiao, Zhiguo Cao, Wei Li (7081), Hao Zhao, and Ziwei Liu. 2026. “ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors.” IEEE Transactions on Pattern Analysis and Machine Intelligence PP: 1–15. https://doi.org/10.1109/tpami.2026.3747767.

Harvard

Huang, Z. et al. (2026) ‘ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors’, IEEE Transactions on Pattern Analysis and Machine Intelligence, PP, pp. 1–15. doi:10.1109/tpami.2026.3747767.

IEEE

Z. Huang et al., “ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PP, pp. 1–15, 2026, doi: 10.1109/tpami.2026.3747767.

BibTeX

@article{huang2026arthoi,
  title     = {{ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors}},
  author    = {Huang, Zihao and Liu, Tianqi and Chen, Zhaoxi and Xu, Shaocong and Zhang, Saining and Xiao, Linqi and Cao, Zhiguo and (7081), Wei Li and Zhao, Hao and Liu, Ziwei},
  journal   = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year      = {2026},
  volume    = {PP},
  pages     = {1--15},
  doi       = {10.1109/tpami.2026.3747767},
  url       = {https://doi.org/10.1109/tpami.2026.3747767}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis

  • 4D reconstruction
  • inverse rendering
  • optical flow
  • part segmentation

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Huang, Z., Liu, T., Chen, Z., Xu, S., Zhang, S., Xiao, L., Cao, Z., (7081), W. L., Zhao, H., & Liu, Z. (2026). ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction From Video Priors. IEEE Transactions on Pattern Analysis and Machine Intelligence, PP, 1–15. https://doi.org/10.1109/tpami.2026.3747767

How many times has this paper been cited?

2 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at IEEE Transactions on Pattern Analysis and Machine Intelligence: sign in and open the full text from this page.

Who wrote this paper?

Zihao Huang, Tianqi Liu, Zhaoxi Chen, Shaocong Xu, Saining Zhang, Linqi Xiao, Zhiguo Cao, Wei Li (7081), Hao Zhao, Ziwei Liu.

What is the DOI of this paper?

10.1109/tpami.2026.3747767, permanently at https://doi.org/10.1109/tpami.2026.3747767. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.