2026
Preprint · 2026 (under submission)
OpenVLHarness: Real World Visual Agentic Tool-Use with Multimodal Memory
Yu Zhou*, Cheng-Fu Yang*, Rui Sun*, Di Wu*, Sibo Peng, Mingyang Zhang, Zhen Yang, Ruiyi Zhang, Nanyun Peng, Zhe Gan, Kai-Wei Chang
ICML 2026 · Spotlight
Learning Structured Reasoning via Tractable Trajectory Control
Po-Nien Kung, Zhen Yang, Jeffrey Luo, Cheng-Fu Yang, Haikang Deng, Zi-Yi Dou, Yinfei Yang, Nanyun Peng, Zhe Gan, Kai-Wei Chang
CVPR 2026
Pushing the Frontier of Audiovisual Perception with Large-Scale Multimodal Correspondence Learning
Apoorv Vyas*, Heng-Jui Chang*, Cheng-Fu Yang*, Po-Yao Huang*, Luya Gao*, Julius Richter*, Sanyuan Chen, Matthew Le, Piotr Dollár, Christoph Feichtenhofer, Ann Lee, Wei-Ning Hsu
2025
COLM 2025
Customize Multi-modal RAI Guardrails with Precedent-based Predictions
Cheng-Fu Yang, Christos Christodoulopoulos, Thanh Tran, Weitong Ruan, Rahul Gupta, Kai-Wei Chang
ICCV 2025
Verbalized Representation Learning for Interpretable Few-Shot Generalization
Cheng-Fu Yang, Da Yin, Wenbo Hu, Heng Ji, Nanyun Peng, Bolei Zhou, Kai-Wei Chang
2024
NeurIPS OWA Workshop 2024
Planning as Inpainting: A Generative Framework for Realistic Embodied Path Planning
Cheng-Fu Yang, Haoyang Xu, Te-Lin Wu, Xiaofeng Gao, Kai-Wei Chang, Feng Gao
EMNLP 2024
LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning
Silin Meng, Yiwei Wang, Cheng-Fu Yang, Nanyun Peng, Kai-Wei Chang
EMNLP 2024
Re-ReST: Reflection-Reinforced Self-Training for Language Agents
Zi-Yi Dou, Cheng-Fu Yang, Xueqing Wu, Kai-Wei Chang, Nanyun Peng
2023
EMNLP 2023
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following
Cheng-Fu Yang, Yen-Chun Chen, Jianwei Yang, Xiyang Dai, Lu Yuan, Yu-Chiang Frank Wang, Kai-Wei Chang
AAAI 2023
Target-free Text-guided Image Manipulation
Wan-Cyuan Fan, Cheng-Fu Yang, Chiao-An Yang, Yu-Chiang Frank Wang
2022
NeurIPS 2022
Paraphrasing Is All You Need for Novel Object Captioning
Cheng-Fu Yang, Yao-Hung Hubert Tsai, Wan-Cyuan Fan, Ruslan Salakhutdinov, Louis-Philippe Morency, Yu-Chiang Frank Wang
AAAI 2022
Cross-Modal Mutual Learning for Audio-Visual Speech Recognition and Manipulation
Chih-Chun Yang, Cheng-Fu Yang, Wan-Cyuan Fan, Yu-Chiang Frank Wang
CVPR 2022
Scene Graph Expansion for Semantics-Guided Image Outpainting
Chiao-An Yang, Cheng-Yo Tan, Wan-Cyuan Fan, Cheng-Fu Yang, Meng-Lin Wu, Yu-Chiang Frank Wang
2021
CVPR 2021
LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity
Cheng-Fu Yang*, Wan-Cyuan Fan*, Fu-En Yang, Yu-Chiang Frank Wang