Biography

I am a second-year PhD student in Computation, Cognition, and Language (NLP) at Language Technology Lab, University of Cambridge. I am supervised by Prof. Anna Korhonen and Dr. Ivan Vulić. I am also a Student Researcher at Google Cloud AI Research. Previously, I interned at Gemini (RADML) and CAIR Teams at Google DeepMind (formerly Google Research).

Before starting my PhD, I was an undergraduate student reading Engineering Science at University of Oxford. I received my second Master degree in MSc Machine Learning, UCL NLP Lab. I graduated top of my class.

I am always interested in modular, efficient, and reward-driven responsible intelligence.

Recent News

Academic Services

Reviewer/program committee member at ACL (2023-24), EMNLP (2022-24), ICML (2024, external), NeurIPS (2024), NeurIPS R0-FoMo (2023).

Interests
  • Large Language Models
  • Parameter-Efficient Fine-Tuning
  • Prompt Optimization
  • Modularity
Education

  • PhD in Computation, Cognition, and Language, Oct 2022 -

    University of Cambridge

  • MSc in Machine Learning, 2020 - 2021

    University College London

  • BA, MEng in Engineering Science, 2015 - 2019

    University of Oxford

Publications

Quickly discover relevant content by filtering publications.
Yinhong Liu, Han Zhou, Zhijiang Guo, Ehsan Shareghi, Ivan Vulić, Anna Korhonen, Nigel Collier (2024). Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators. The First Conference on Language Modeling (COLM).

PDF Cite Code Abstract

Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen (2024). Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments. arXiv preprint arXiv:2406.11370.

PDF Cite Code Abstract

Chengzu Li, Caiqi Zhang, Han Zhou, Nigel Collier, Anna Korhonen, Ivan Vulić (2024). TopViewRS: Vision-Language Models as Top-View Spatial Reasoners. arXiv preprint arXiv:2406.02537.

PDF Cite Code Abstract Project Page

Han Zhou, Xingchen Wan, Lev Proleev, Diana Mincu, Jilin Chen, Katherine Heller, Subhrajit Roy (2024). Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering. International Conference on Learning Representations (ICLR).

PDF Cite Abstract (Google Research) OpenReview Blog (Google AI) Talk (NeurIPS Spotlight)

Han Zhou, Xingchen Wan, Ivan Vulić, Anna Korhonen (2024). AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning. Transactions of the Association for Computational Linguistics (TACL).

PDF Cite Code Abstract MIT Press ACL Anthology

Chengzu Li, Han Zhou, Goran Glavaš, Anna Korhonen, Ivan Vulić (2023). Can Large Language Models Achieve Calibration with In-Context Learning?. ICLR 2024 Workshop on Reliable and Responsible Foundation Models.

PDF Cite Code Abstract OpenReview

Han Zhou, Xingchen Wan, Ivan Vulić, Anna Korhonen (2023). Survival of the Most Influential Prompts: Efficient Black-Box Prompt Search via Clustering and Pruning. Findings of the Association for Computational Linguistics (EMNLP).

PDF Cite Code Abstract OpenReview ACL Anthology

Songbo Hu, Han Zhou, Zhangdie Yuan, Milan Gritta, Guchun Zhang, Ignacio Iacobacci, Anna Korhonen, Ivan Vulić (2023). A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems. The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP).

PDF Cite Code Abstract OpenReview ACL Anthology

Songbo Hu, Han Zhou, Mete Hergul, Milan Gritta, Guchun Zhang, Ignacio Iacobacci, Ivan Vulić, Anna Korhonen (2023). Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems. Transactions of the Association for Computational Linguistics (TACL).

PDF Cite Dataset Abstract MIT Press ACL Anthology

Qingcheng Zeng, Lucas Garay, Peilin Zhou, Dading Chong, Yining Hua, Jiageng Wu, Yikang Pan, Han Zhou, Rob Voigt, Jie Yang (2023). GreenPLM: Cross-Lingual Transfer of Monolingual Large Language Models at Almost No Cost. The 32nd International Joint Conference on Artificial Intelligence (IJCAI).

PDF Cite Code Abstract IJCAI 2023

Han Zhou, Ignacio Iacobacci, Pasquale Minervini (2023). XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Tracking. Findings of the Association for Computational Linguistics (EACL).

PDF Cite Code Abstract ACL Anthology

Experience

 
 
 
 
 
Google Research, Cloud AI Team
Student Researcher
Google Research, Cloud AI Team
Jul 2024 – Dec 2024 San Francisco, US
 
 
 
 
 
Google Research, Responsible AI Team
Student Researcher
Google Research, Responsible AI Team
Jun 2023 – Dec 2023 London, UK
 
 
 
 
 
Language Technology Lab
Research Intern
Language Technology Lab
Mar 2022 – Sep 2022 Cambridge, UK
 
 
 
 
 
UCL NLP Lab
Research Student
UCL NLP Lab
May 2021 – Oct 2021 London, UK
 
 
 
 
 
Tencent
Game Designer
Tencent
Jul 2019 – Aug 2020 Shenzhen, China
 
 
 
 
 
RACE
Research Intern
RACE
Jul 2018 – Sep 2018 Culham, UK
 
 
 
 
 
Battery Intelligence Lab
Research Intern
Battery Intelligence Lab
Jul 2017 – Sep 2017 Oxford, UK

Accomplish­ments

Google
Awarded to advance research with Google Gemma Models.
Google
Awarded to present at International Conference on Learning Representations (ICLR 2024).
UKRI ERC
Fully funded PhD studentship for research towards globally equitable language technologies.
University College London
Awarded to rank 1 for MSc Machine Learning in the academic year at UCL.
University of Oxford
Awarded to the distinct Engineering Science student at Oxford.

Research Interests

AutoML Calibration Computer Vision Human Alignment In-Context Learning Large Language Models Multi-Lingual Learning Natural Language Processing Parameter-Efficient Fine-Tuning Prompt Engineering Reasoning Responsible AI Task-Oriented Dialogues Vision Language Models

Contact

  • hz416 [at] cam.ac.uk (Cambridge)
  • LTL, University of Cambridge, UK