Papers

You can also see my profiles on Google Scholar and Semantic Scholar.

2024

Bayesian scaling laws for in-context learning.

Aryaman Arora, Dan Jurafsky, Christopher Potts, Noah D. Goodman.
arXiv:2410.16531

Causal abstraction: A theoretical foundation for mechanistic interpretability.

Atticus Geiger, Duligur Ibeling, Amir Zur, Maheep Chaudhary, Sonakshi Chauhan, Jing Huang, Aryaman Arora, Zhengxuan Wu, Noah Goodman, Christopher Potts, Thomas Icard.
arXiv:2301.04709

ReFT: Representation finetuning for language models.

Zhengxuan Wu*, Aryaman Arora*, Zheng Wang, Atticus Geiger, Dan Jurafsky, Christopher D. Manning, Christopher Potts.
NeurIPS Spotlight

CausalGym: Benchmarking causal interpretability methods on linguistic tasks.

Aryaman Arora, Dan Jurafsky, Christopher Potts.
ACL Outstanding Paper Senior Area Chair Award

pyvene: A library for understanding and improving PyTorch models via interventions.

Zhengxuan Wu, Atticus Geiger, Aryaman Arora, Jing Huang, Zheng Wang, Noah D. Goodman, Christopher D. Manning, Christopher Potts.
NAACL: System Demonstrations

IruMozhi: Automatically classifying diglossia in Tamil.

Kabilan Prasanna, Aryaman Arora.
NAACL: Findings

Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokens.

Nay San, Georgios Paraskevopoulos, Aryaman Arora, Xiluo He, Prabhjot Kaur, Oliver Adams, Dan Jurafsky.
SIGTYP

A reply to Makelov et al. (2023)’s “interpretability illusion” arguments.

Zhengxuan Wu, Atticus Geiger, Jing Huang, Aryaman Arora, Thomas Icard, Christopher Potts, and Noah D. Goodman.
arXiv:2401.12631

2023

Towards vision-language mechanistic interpretability: A causal tracing tool for BLIP.

Vedant Palit*, Rohan Pandey*, Aryaman Arora, Paul Pu Liang.
5th Workshop on Closing the Loop Between Vision and Language (CLVL)

SIGMORPHON–UniMorph 2023 Shared Task 0: Typologically diverse morphological inflection.

Omer Goldman, Khuyagbaatar Batsuren, Salam Khalifa, Aryaman Arora, Garrett Nicolai, Reut Tsarfaty, Ekaterina Vylomova.
SIGMORPHON

Jambu: A historical linguistic database for South Asian languages.

Aryaman Arora, Adam Farris, Samopriya Basu, Suresh Kolichala.
SIGMORPHON

Unified syntactic annotation of English in the CGEL framework.

Brett Reynolds, Aryaman Arora, Nathan Schneider.
LAW

CGELBank Annotation Manual v1.0.

Brett Reynolds, Nathan Schneider, Aryaman Arora.
arXiv:2305.17347

Investigating induction heads in a small transformer language model.

Aryaman Arora.
MASC-SLL, Arlington, VA, USA

Localizing model behavior with path patching.

Nicholas Goldowsky-Dill, Chris MacLeod, Lucas Sato, Aryaman Arora.
arXiv:2304.05969

2022

Information theory in linguistics: Methods and applications.

Ryan Cotterell, Richard Futrell, Kyle Mahowald, Clara Meister, Tiago Pimentel, Adina Williams, Aryaman Arora.
COLING (Tutorials)

CGELBank: CGEL as a framework for English syntax annotation.

Brett Reynolds, Aryaman Arora, Nathan Schneider.
arXiv:2210.00394

SIGMORPHON–UniMorph 2022 Shared Task 0: Generalization and typologically diverse morphological inflection.

Jordan Kodner, …, Aryaman Arora, …, Ekaterina Vylomova.
SIGMORPHON

The SIGMORPHON 2022 Shared Task on Morpheme Segmentation.

Khuyagbaatar Batsuren, Gábor Bella, Aryaman Arora, …, Ryan Cotterell, Ekaterina Vylomova.
SIGMORPHON

Universal Dependencies for Punjabi.

Aryaman Arora.
LREC

MASALA: Modelling and analysing the semantics of adpositions in linguistic annotation of Hindi.

Aryaman Arora, Nitin Venkateswaran, Nathan Schneider.
LREC

UniMorph 4.0: Universal Morphology.

Khuyagbaatar Batsuren*, Omer Goldman*, …, Aryaman Arora, …, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova.
LREC

A CGEL-formalism English treebank.

Aryaman Arora, Nathan Schneider, Brett Reynolds.
MASC-SLL, Philadelphia, PA, USA

Estimating the entropy of linguistic distributions.

Aryaman Arora, Clara Meister, Ryan Cotterell.
ACL

Computational historical linguistics and language diversity in South Asia.

Aryaman Arora, Adam Farris, Samopriya Basu, Suresh Kolichala.
ACL

DIPI: Dependency parsing for Ashokan Prakrit historical dialectology.

Adam Farris*, Aryaman Arora*.
Towards a comparative historical dialectology: evidence from morphology and syntax, Deutschen Gesellschaft für Sprachwissenschaft, Tübingen, Germany