Publications

Why Can’t Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls

Xiaoyan Bai, Itamar Pres, Yuntian Deng, Chenhao Tan, Stuart Shieber, Fernanda Viégas, Martin Wattenberg, and Andrew Lee

Better World Models Can Lead to Better Post-Training Performance

Prakhar Gupta, Henry Conklin, Sarah-Jane Leslie, and Andrew Lee

Beyond Toxic Neurons: A Mechanistic Analysis of DPO for Toxicity Reduction

Yushi Yang, Filip Sondej, Harry Mayne, Andrew Lee, and Adam Mahdi

The Geometry of Self-Verification in a Task-Specific Reasoning Model

Andrew Lee, Lihao Sun, Chris Wendler, Fernanda Viégas, and Martin Wattenberg

Shared Global and Local Geometry of Language Model Embeddings

Andrew Lee, Melanie Weber, Fernanda Viégas, and Martin Wattenberg

Eeyore: Realistic Depression Simulation via Supervised and Preference Optimization

Siyang Liu, Bianca Brie, Wenda Li, Laura Biester, Andrew Lee, James Pennebaker, and Rada Mihalcea

ICLR: In-Context Learning of Representations

*Core Francisco Park, *Andrew Lee, *Ekdeep Singh Lubana, *Yongyi Yang, Maya Okawa, Kento Nishi, Martin Wattenberg, and Hidenori Tanaka

Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space

Core Francisco Park, Maya Okawa, Andrew Lee, Ekdeep Singh Lubana, and Hidenori Tanaka

A mechanistic understanding of alignment algorithms: A case study on dpo and toxicity

Andrew Lee, Xiaoyan Bai, Itamar Pres, Martin Wattenberg, Jonathan K Kummerfeld, and Rada Mihalcea

Some things are more CRINGE than others: Preference Optimization with the Pairwise Cringe Loss

Jing Xu, Andrew Lee, Sainbayar Sukhbaatar, and Jason Weston

Emergent linear representations in world models of self-supervised sequence models

*Neel Nanda, *Andrew Lee, and Martin Wattenberg

Empathy Identification Systems are not Accurately Accounting for Context

Andrew Lee, Jonathan Kummerfeld, Larry An, and Rada Mihalcea

A PhD Student’s Perspective on Research in NLP in the Era of Very Large Language Models

Oana Ignat, Zhijing Jin, Artem Abzaliev, Laura Biester, Santiago Castro, Naihao Deng, Xinyi Gao, Aylin Gunal, Jacky He, Ashkan Kazemi, and others

Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Engines

Andrew Lee, David Wu, Emily Dinan, and Mike Lewis

Augmenting Task-Oriented Dialogue Systems with Relation Extraction

Andrew Lee, Zhenguo Chen, Kevin Leach, and Jonathan K. Kummerfeld

Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health

Andrew Lee, Jonathan Kummerfeld, Lawrence An, and Rada Mihalcea

An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction

Stefan Larson, Anish Mahendran, Joseph J Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K Kummerfeld, Kevin Leach, Michael A Laurenzano, Lingjia Tang, and Jason Mars

Outlier Detection for Improved Data Quality and Diversity in Dialog Systems

Stefan Larson, Anish Mahendran, Andrew Lee, Jonathan K Kummerfeld, Parker Hill, Michael A Laurenzano, Johann Hauswald, Lingjia Tang, and Jason Mars