Yiwei Hu

Research Scientist

Adobe Research

Biography

I am a research scientist at Adobe Research. I received my Ph.D. from Yale University, under the supervision by Prof. Holly Rushmeier and Prof. Julie Dorsey. Prior to Yale, I received my bachelor’s degree from Zhejiang University, advised by Prof. Rui Wang.

My research focuses on 2D and 3D graphics, with a special interest in generative models for content creation at Adobe. We shipped multiple 2D/3D workflows in Adobe Substance 3D, Firefly Service, Firefly Boards and Project Aqua, involving generative 3D asset creation and composition etc. A new brand new “Rotate Object” was recently released into Adobe Photoshop. I am exploring more interesting content creation methods, models and workflows. I am open to collaborations and welcome strong Ph.D. students interested in research internships at Adobe Research.

Interests

Computer Graphics
Digital Content Creation

Education

PhD in Computer Graphics, 2023

Yale University
BSc in Computer Science, 2018

Zhejiang University

Publications

Yuheng Liu, Xin Lin, Xinke Li, Baihan Yang, Chen Wang, Kalyan Sunkavalli, Yannick Hold-Geoffroy, Hao Tan, Kai Zhang, Xiaohui Xie, Zifan Shi, Yiwei Hu (2026). OmniRoam: World Wandering via Long-Horizon Panoramic Video Generation. SIGGRAPH 2026.

PDF Project

Chen Wang, Hao Tan, Wang Yifan, Zhiqin Chen, Yuheng Liu, Kalyan Sunkavalli, Sai Bi, Lingjie Liu, Yiwei Hu (2026). tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstruction. CVPR 2026.

PDF Project

Ye Fang, Tong Wu, Valentin Deschaintre, Duygu Ceylan, Iliyan Georgiev, Chun-Hao Paul Huang, Yiwei Hu, Xuelin Chen, Tuanfeng Yang Wang (2026). V-RGBX: Video Editing with Accurate Controls over Intrinsic Properties. CVPR 2026.

PDF Project

Zixiong Wang, Jian Yang, Yiwei Hu, Miloš Hašan, Beibei Wang (2026). HiMat: DiT-based Ultra-High Resolution SVBRDF Generation. Computer Graphics Forum, Proc. of Eurographics (EG 2026).

PDF

Xilong Zhou, Pedro Figueiredo, Miloš Hašan, Valentine Deschaintre, Paul Guerrero, Yiwei Hu, Nima Kalantari (2026). RealMat: Realistic Materials with Diffusion and Reinforcement Learning. Computer Graphics Forum 2026.

Project

Yuanhao Cai, He Zhang, Xi Chen, Jinbo Xing, Yiwei Hu, Yuqian Zhou, Kai Zhang, Zhifei Zhang, Soo Ye Kim, Tianyu Wang, Yulun Zhang, Xiaokang Yang, Zhe Lin, Alan Yuille (2025). OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditions. NeurIPS 2025.

Project

Jieting Xu, Ziyi Xu, Guoyuan An, Yiwei Hu, Rengan Xie, Zhijian Liu, Dianbing Xi, Wenjun Song, Yuchi Huo, Rui Wang (2025). AniTex: light-geometry consistent PBR Material Generation for Animatable Objects. SIGGRAPH ASIA 2025.

PDF

Zhaoyang Zhang, Yannick Hold-Geoffroy, Miloš Hašan, Ziwen Chen, Fujun Luan, Julie Dorsey, Yiwei Hu (2025). Generating 360 Video is What You Need For a 3D Scene. SIGGRAPH ASIA 2025.

Project

Xiaohe Ma, Valentin Deschaintre, Miloš Hašan, Fujun Luan, Kun Zhou, Hongzhi Wu, Yiwei Hu (2025). MaterialPicker: Multi-Modal DiT-Based Material Generation. ACM Transactions on Graphics (SIGGRAPH 2025).

Project

Zhengfei Kuang, Tianyuan Zhang, Kai Zhang, Hao Tan, Sai Bi, Yiwei Hu, Zexiang Xu, Miloš Hašan, Gordon Wetzstein, Fujun Luan (2025). Buffer Anytime: Zero-Shot Video Depth and Normal from Image Priors. CVPR 2025.

PDF Project

Hanzhe Hu, Tianwei Yin, Fujun Luan, Yiwei Hu, Hao Tan, Zexiang Xu, Sai Bi, Shubham Tulsiani, Kai Zhang (2025). Turbo3D: Ultra-fast Text-to-3D Generation. CVPR 2025.

PDF Project

Tianyuan Zhang, Zhengfei Kuang, Haian Jin, Zexiang Xu, Sai Bi, Hao Tan, He Zhang, Yiwei Hu, Miloš Hašan, William T. Freeman, Kai Zhang, Fujun Luan (2025). RelitLRM: Generative Relightable Radiance for Large Reconstruction Models. ICLR 2025.

PDF Project

Beichen Li, Yiwei Hu, Paul Guerrero, Miloš Hašan, Liang Shi, Valentin Deschaintre, Wojciech Matusik (2024). Procedural Material Generation with Reinforcement Learning. ACM Transactions on Graphics (SIGGRAPH ASIA 2024).

PDF Code DOI

Zheng Zeng, Valentin Deschaintre, Iliyan Georgiev, Yannick Hold-Geoffroy, Yiwei Hu, Fujun Luan, Ling-Qi Yan, Miloš Hašan (2024). RGB↔X: Image Decomposition and Synthesis Using Material- and Lighting-aware Diffusion Models. SIGGRAPH 2024.

PDF Project

Julia Guerrero-Viu, Miloš Hašan, Arthur Roullier, Midhun Harikumar, Yiwei Hu, Paul Guerrero, Diego Gutierre, Belen Masia, Valentin Deschaintre (2024). TexSliders: Diffusion-Based Texture Editing in CLIP Space. SIGGRAPH 2024.

PDF Cite Project

Yiwei Hu, Paul Guerrero, Miloš Hašan, Holly Rushmeier, Valentin Deschaintre (2023). Generating Procedural Materials from Text or Image Prompts. SIGGRAPH 2023.

PDF Cite Project DOI

Yiwei Hu, Yazhen Yuan, Rui Wang, Zhuo Yang, Hujun Bao (2022). Multirate Shading with Piecewise Interpolatory Approximation. Computer Graphics Forum, Proc. of Pacific Graphics (PG 2022).

PDF Cite Project DOI

Yiwei Hu, Paul Guerrero, Miloš Hašan, Holly Rushmeier, Valentin Deschaintre (2022). Node Graph Optimization Using Differentiable Proxies. SIGGRAPH 2022.

PDF Cite Project DOI

Yiwei Hu, Miloš Hašan, Paul Guerrero, Holly Rushmeier, Valentin Deschaintre (2022). Controlling Material Appearance by Examples. Computer Graphics Forum, Proc. of Eurographics Symposium on Rendering (EGSR 2022).

PDF Cite Project DOI

Yiwei Hu, Chengan He, Valentin Deschaintre, Julie Dorsey, Holly Rushmeier (2022). An Inverse Procedural Modeling Pipeline for SVBRDF Maps. ACM Transactions on Graphics (Presented at SIGGRAPH 2022).

PDF Cite Project DOI

Yiwei Hu, Julie Dorsey, Holly Rushmeier (2019). A Novel Framework for Inverse Procedural Texture Modeling. ACM Transactions on Graphics (SIGGRAPH ASIA 2019).

PDF Cite Project DOI

Zhiling Zhou, Ning Guo, Jianan Cui, Xiaxia Meng, Yiwei Hu, Han Bao, Xiang Li, Quanzheng Li (2019). Novel Radiomic Features Based on Graph Theory for PET Image Analysis. IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

PDF Cite DOI