William Jongwon Han

About Me

I am a 3rd year PhD candidate for the Safe AI Lab at Carnegie Mellon University, advised by Prof. Ding Zhao.
I received my BA in Psychological Science at the University of California, Irvine.

My research interest is broadly in multimodal learning, particularly with physiological signals. I work with vision and language as well.
More recently, I am super interested in multimodal and representation learning with electrocardiograms (ECGs) and text.

Selected Publications and Preprints

• Retrieval-Augmented Generation for Electrocardiogram-Language Models
  Xiaoyu Song^*, William Han^*, Tony Chen, Chaojing Duan, Michael Rosenberg, Emerson Liu, Ding Zhao
  arxiv
  
  
• Signal, Image, or Symbolic: Exploring the Best Input Representation for Electrocardiogram-Language Models Through a Unified Framework
  William Han, Chaojing Duan, Zhepeng Cen, Yihang Yao, Xiaoyu Song, Atharva Mhaskar, Dylan Leong, Michael Rosenberg, Emerson Liu, Ding Zhao
  arxiv
  
  
• ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling
  William Han, Chaojing Duan, Michael Rosenberg, Emerson Liu, Ding Zhao
  MLHC 2025 / arxiv
  
  
• Interpretation of Intracardiac Electrograms Through Textual Representations
  William Han, Diana Gomez, Avi Alok, Chaojing Duan, Michael Rosenberg, Douglas Weber, Emerson Liu, Ding Zhao
  CHIL 2024 / arxiv
  
  
• Automated Cardiovascular Record Retrieval by Multimodal Learning between Electrocardiogram and Clinical Report
  Jielin Qiu^*, Jiacheng Zhu^*, Shiqi Liu, William Han, Jingqi Zhang, Chaojing Duan, Michael Rosenberg, Emerson Liu, Douglas Weber, Ding Zhao
  ML4H 2023 / arxiv
  
  
• Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models?
  Jielin Qiu^*, William Han^*, Jiacheng Zhu, Mengdi Xu, Michael Rosenberg, Emerson Liu, Douglas Weber, Ding Zhao
  EACL 2023 Findings / arxiv
  

Other Publications and Preprints

• Behavior Injection: Preparing Language Models for Reinforcement Learning
  Zhepeng Cen^*, Yihang Yao^*, William Han, Zuxin Liu, Ding Zhao
  NeurIPS 2025 / arxiv
  
  
• Safety is Not Only About Refusal: Reasoning-Enhanced Fine-tuning for Interpretable LLM Safety
  Yuyou Zhang, Miao Li, William Han, Yihang Yao, Zhepeng Cen, Ding Zhao
  ACL 2025 Findings / arxiv
  
  
• Feature-EndoGaussian: Feature Distilled Gaussian Splatting in Surgical Deformable Scene Reconstruction
  Kai Li^*, Junhao Wang^*, William Han, Ding Zhao
  ML4H 2025 / arxiv
  
  
• Your Language Model May Think Too Rigidly: Achieving Reasoning Consistency with Symmetry-Enhanced Training
  Yihang Yao^*, Zhepeng Cen^*, Miao Li, William Han, Yuyou Zhang, Emerson Liu, Zuxin Liu, Chuang Gan, Ding Zhao
  ACL 2025 Findings / arxiv
  
  
• Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications
  Xilun Zhang^*, Shiqi Liu^*, Peide Huang, William Han, Yiqi Lyu, Mengdi Xu, Ding Zhao
  RA-L 2025 / arxiv
  
  
• Evaluating Durability: Benchmark Insights into Multimodal Watermarking
  Jielin Qiu^*, William Han^*, Xuandong Zhao, Shangbang Long, Christos Faloutsos, Lei Li
  DMLR 2024 / arxiv
  
  
• Entity6K: A Large Open-Domain Evaluation Dataset for Real-World Entity Recognition
  Jielin Qiu, William Han, Winfred Wang, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Christos Faloutsos, Lei Li, Lijuan Wang
  arxiv
  
  
• Embodied Executable Policy Learning with Language-based Scene Summarization
  Jielin Qiu^*, Mengdi Xu^*, William Han^*, Seungwhan Moon, Ding Zhao
  NAACL 2024 / arxiv
  
  
• MultiSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos
  Jielin Qiu, Jiacheng Zhu, William Han, Aditesh Kumar, Karthik Mittal, Claire Jin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Bo Li, Ding Zhao, Lijuan Wang
  CVPR 2024 (highlight, 11.9%) / arxiv
  
  
• Can Brain Signals Reveal Inner Alignment with Human Languages?
  William Han^*, Jielin Qiu^*, Jiacheng Zhu, Mengdi Xu, Douglas Weber, Bo Li, Ding Zhao
  EMNLP 2023 Findings / arxiv
  

Services

Reviewer: CVPR, NeurIPS, ICML, EMNLP, ICLR, ACL, CHIL

Organization:
Research Roundtable Junior Chair at Machine Learning for Health 2023