William Jongwon Han

About Me

I am a 2nd year PhD candidate for the Safe AI Lab at Carnegie Mellon University, advised by Prof. Ding Zhao.
I received my BA in Psychological Science at the University of California, Irvine.

My research interest is broadly in multimodal learning, particularly with
physiological signals, for applications in cognitive science, embodied artificial intelligence (AI), and healthcare.
I work with vision and language as well.
More recently, I am super interested in multimodal and representation learning with electrocardiograms (ECGs) and text.

Selected Publications and Preprints

• ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling
  William Han, Chaojing Duan, Michael Rosenberg, Emerson Liu, Ding Zhao
  arxiv
  
  
• Interpretation of Intracardiac Electrograms Through Textual Representations
  William Han, Diana Gomez, Avi Alok, Chaojing Duan, Michael Rosenberg, Douglas Weber, Emerson Liu, Ding Zhao
  CHIL 2024 / arxiv
  
  
• Automated Cardiovascular Record Retrieval by Multimodal Learning between Electrocardiogram and Clinical Report
  Jielin Qiu^*, Jiacheng Zhu^*, Shiqi Liu, William Han, Jingqi Zhang, Chaojing Duan, Michael Rosenberg, Emerson Liu, Douglas Weber, Ding Zhao
  ML4H 2023 / arxiv
  
  
• Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models?
  Jielin Qiu^*, William Han^*, Jiacheng Zhu, Mengdi Xu, Michael Rosenberg, Emerson Liu, Douglas Weber, Ding Zhao
  EACL 2023 Findings / arxiv
  

Other Publications and Preprints

• Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications
  Xilun Zhang^*, Shiqi Liu^*, Peide Huang, William Han, Yiqi Lyu, Mengdi Xu, Ding Zhao
  RA-L 2025 / arxiv
  
  
• Evaluating Durability: Benchmark Insights into Multimodal Watermarking
  Jielin Qiu^*, William Han^*, Xuandong Zhao, Shangbang Long, Christos Faloutsos, Lei Li
  DMLR 2024 / arxiv
  
  
• Entity6K: A Large Open-Domain Evaluation Dataset for Real-World Entity Recognition
  Jielin Qiu, William Han, Winfred Wang, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Christos Faloutsos, Lei Li, Lijuan Wang
  arxiv
  
  
• Embodied Executable Policy Learning with Language-based Scene Summarization
  Jielin Qiu^*, Mengdi Xu^*, William Han^*, Seungwhan Moon, Ding Zhao
  NAACL 2024 / arxiv
  
  
• MultiSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos
  Jielin Qiu, Jiacheng Zhu, William Han, Aditesh Kumar, Karthik Mittal, Claire Jin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Bo Li, Ding Zhao, Lijuan Wang
  CVPR 2024 (highlight, 11.9%) / arxiv
  
  
• Can Brain Signals Reveal Inner Alignment with Human Languages?
  William Han^*, Jielin Qiu^*, Jiacheng Zhu, Mengdi Xu, Douglas Weber, Bo Li, Ding Zhao
  EMNLP 2023 Findings / arxiv
  

Services

Reviewer: CVPR, NeurIPS, ICML, EMNLP, ICLR, ACL, CHIL

Organization:
Research Roundtable Junior Chair at Machine Learning for Health 2023