avatar

Jiatong Yu

MSc in Computer Science
Princeton University
jiatongy@princeton.edu


About

I’m a master’s student at Princeton Department of Computer Science, advised by Prof. Sanjeev Arora. I’m part of the Princeton Language and Intelligence Group. I obtained my Bachelor’s degree at Computer Science from Princeton University and had the fortune to work with Prof. Danqi Chen and Prof. Kai Li.

I work on understanding and developing recipes for language model behavior at scale. Model behavior includes instruction following, skill association, self-correction, to name a fiew. Unlike factual knowledge, these cognitive behaviors are somewhat implicit in the pretraining data and should be studied and improved in isolation. I’m particularly excited to seeing when and where does behavior learning occur. These days, I’m working on synthetic data as a potential approach to answer some of these questions.

News

Publications

  1. Vedant Shah, Dingli Yu, Kaifeng Lyu, Simon Park, Jiatong Yu, Yinghui He, Nan Rosemary Ke, Michael Mozer, Yoshua Bengio, Sanjeev Arora, Anirudh Goyal
    4th MATH-AI Workshop at NeurIPS, 2024

  2. Zhiyuan Zeng, Jiatong Yu, Tianyu Gao, Yu Meng, Tanya Goyal, Danqi Chen
    The Twelfth International Conference on Learning Representations (ICLR), 2024.

  3. Tianyu Gao, Howard Yen, Jiatong Yu, Danqi Chen Jiatong Yu, Danqi Chen
    The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023.