Research (Selected Topics)
Causal Discovery & Inference
Causal discovery and inference involve the challenge of learning causal structures from observational data and making inferences about causal effects based on these structures. This task is foundational across diverse scientific and engineering disciplines. Our current focus revolves around developing computational methods capable of uncovering causal relationships within intricate real-world datasets, all while ensuring theoretical robustness and reliability.
Causal discovery from imperfectly sampled time series data [ICML'15][ICML'15][UAI'17][NeurIPS'19]
Causal discovery from nonstationary data [ICML'19]
Causal discovery from data with measurement error [UAI'18]
Causal discovery from data with missing values [AAAI'20][NeurIPS'22]
Federated causal discovery [TMLR'23]
Scalable search [NeurIPS'22][CLeaR'24]
Causal effect estimation [ICLR'24]
Causal Representation Learning
Powered by deep neural networks, representation learning extracts high-level representations from raw data and enables accurate predictions in many applications. However, existing representation learning techniques can not outperform humans in transferring/generalizing to new environments and tasks. In addition, the blackbox representations face challenges in the social aspects of AI, such as fairness, reliablity, and transparency. Our research goal is to learn causal representations, often via causal generative models, that enable efficient transfer learning, out-of-distribution generalization, and socially responsible learning.
Domain adaptation/generalization [AAAI'15][ICML'16][AAAI'18][ECCV'18] [AISTATS'19][ICML'20][ICML'20] [NeurIPS'20][NeurIPS'20][NeurIPS'21]
Fair representation learning [CLeaR'22][NeurIPS'22][ICLR'24]
Robust machine learning [NeurIPS'21][ICLR'22] [ICLR'23][ICML'23]
Generalization in reinforcement learning [ICLR'22]
Non-Transferable Representation Learning [ICLR'24]
Generative Models
Generative models, including GPT, GANs, and diffusion models, wield significant neural network capabilities to faithfully replicate intricate distributions found in real data. Our research emphasis lies in crafting generative models that are not only data-efficient but also computationally efficient. Moreover, delving into the realm of causal generative models, our core interest centers on developing models that mimic the data generation process while affording controllable and nuanced generations. Lastly, our curiosity extends to exploring generative models tailored for diverse data types, spanning images, text, 3D human motion, and beyond.
Fundamental models [NeurIPS'19][NeurIPS'23]
Image generation [CVPR'19][ICCV'21][CVPR'22][CVPR'22][ICLR'24]
3D medical image generation [IEEE JBHI]
Font generation [CVPR'22]
3D Vision
The realm of 3D vision is dedicated to modeling and comprehending the visual world, with a primary focus on deducing three-dimensional structures from two-dimensional images. Our research explores machine learning approaches for various facets of 3D vision, including depth estimation, novel view synthesis, feature matching, SLAM, and 3D model retrieval.
3D model retrieval [NeurIPS'20]
3D dataset [IJCV'21]