Jia-Mu Sun

I am a PhD student at University of California, San Diego, advised by Prof. Ravi Ramamoorthi. Previously, I obtained master's degree at University of Chinese Academy of Sciences under the advise of Prof. Lin Gao. I received bachelor's degree from Huazhong University of Science and Technology.

My interests lie in computer graphics(rendering, geometry).

Email  /  DBLP  /  Google Scholar  /  CV

profile photo

Shot by Kevin Jiang at La Jolla, October 2024.

Publications

project image

NU-NeRF: Neural Reconstruction of Nested Transparent Objects with Uncontrolled Capture Environment


Jia-Mu Sun, Tong Wu, Ling-Qi Yan, Lin Gao*
ACM Transactions on Graphics (SIGGRAPH Asia 2024)
project /

Use a two-stage manner to reconstruct nested scenes with complex transparent effects without the need of additional inpus like mask.

project image

Real-time Large-scale Deformation of Gaussian Splatting


Lin Gao*, Jie Yang, Bo-Tao Zhang, Jia-Mu Sun, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai.
ACM Transactions on Graphics (SIGGRAPH Asia 2024)
project /

Utilize underlying mesh to guide the splitting, merging and deformation of gaussian splatting-based scene representation.

project image

DMiT: Deformable Mipmapped Tri-Plane Representation for Dynamic Scenes


Jing-Wen Yang, Jia-Mu Sun, Yongliang Yang, Jie Yang, Ying Shan, Yan-Pei Cao, Lin Gao*
European Conference on Computer Vision (ECCV), 2024

Use mipmapped triplane and joint geometry and deformation refinement to enhance anti-aliasing and novel view synthesis of dynamic scenes.

project image

Recent advances in implicit representation-based 3D shape generation


Jia-Mu Sun, Tong Wu, Lin Gao*
Visual Intelligence, 2024
paper /

A comprehensive survey about implicit representation-based shape generation works published before August 2023.

project image

HAISOR: Human-Aware Indoor Scene Optimization via Deep Reinforcement Learning


Jia-Mu Sun, Jie Yang, Kaichun Mo, Yu-Kun Lai, Leonidas J. Guibas, Lin Gao*
ACM Transactions on Graphics, 2024
paper /

Use Deep Reinforcement Learning and Monte Carlo Search Tree to solve scene optimization problems incorporating human behaviour that is not differentiable.

project image

SOL-NeRF: Sunlight Modeling for Outdoor Scene Decomposition and Relighting


Jia-Mu Sun, Tong Wu, Yong-Liang Yang, Yu-Kun Lai, Lin Gao*
ACM SIGGRAPH Asia 2023
paper / project /

Utilizing various priors and a novel sunlight modeling strategy to reconstruct and decompose outdoor scenes.

project image

DE-NeRF: DEcoupled Neural Radiance Fields for View-Consistent Appearance Editing and High-Frequency Environmental Relighting


Tong Wu, Jia-Mu Sun, Yu-Kun Lai, Lin Gao*
ACM SIGGRAPH 2023
paper / video / project /

Decompoing and editing radiance field by utilizing mesh-based features and hybrid lighting representation.

project image

SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometry


Lin Gao, Jia-Mu Sun, Kaichun Mo, Yu-Kun Lai, Leonidas J. Guibas, Jie Yang
IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2023
paper / video /

Holistic understanding and generation of indoor 3D scenes using recursive hierarchical networks.


Experience

project image

Tencent, Guangzhou


Game Engine Engineer(Intern), Weixin Group
June 2020 - August 2020

Education

project image

University of California, San Diego


Computer Science and Enginnering
September 2024 - Now
PhD Student
project image

University of Chinese Academy of Sciences


Computer Science and Technology
September 2021 - July 2024
Master of Engineering
project image

Huazhong University of Science and Technology


Computer Science and Technology
September 2017 - July 2021
Bachelor of Engineering


Personal Interests



I am a dedicated gamer. If I cannot play video game, I will die (literally). You can find me at Steam, PSN(spdf78ij) and Nintendo account(SW-5628-1619-3780). Feel free to add me as a friend(If it is possible, please email me or add a note upon friend request). If you happen to play music games, you can add me at OSU, where I mainly play OSU!mania. I also play old-fashioned arcade music games like Beatmania IIDX.

Besides, I play the piano and clarinet. I was in the symphony orchestra as a clarinet player at high school and college (and, of course, I am a fan of classical music). Unfortunately, I have not practiced both instruments in about 2-3 years after I started researching. Now I am actively planning to pick up them again.

I also composed some music(if they can be called music), most of them game soundtracks for indie games back in college, or some random thoughts, and they can be found here at Netease cloud music platform. I may switch to soundcloud if I resume composing.

When it comes to electronic music, I am a huge fan of Trance music, but other genres like hardcore or synthwave are also OK.

Design and source code from Jon Barron's website