On the Benefits of Rank in Attention Layers
Noah Amsel, Gilad Yehudai, and Joan Bruna
arXiv Preprint, 2024
[preprint] [slides] [poster] [code]
Publications
Nearly Optimal Approximation of Matrix Functions by the Lanczos Method
Noah Amsel, Tyler Chen, Anne Greenbaum, Cameron N Musco, and Christopher Musco
The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024
[journal] [poster] [code]
Fixed-sparsity matrix approximation from matrix-vector products
Noah Amsel, Tyler Chen, Feyza Duman Keles, Diana Halikias, Cameron Musco, and Christopher Musco
arXiv Preprint, 2024
[preprint]
Spectral top-down recovery of latent tree models
Yariv Aizenbud, Ariel Jaffe, Meng Wang, Amber Hu, Noah Amsel, Boaz Nadler, Joseph T Chang, and Yuval Kluger
Information and Inference: A Journal of the IMA, 2023
[journal] [pdf] [code]
Spectral Neighbor Joining for Reconstruction of Latent Tree Models
Ariel Jaffe, Noah Amsel, Yariv Aizenbud, Boaz Nadler, Joseph T. Chang, and Yuval Kluger
SIAM Journal on Mathematics of Data Science (SIMODS), 2021
[journal] [pdf] [code]
Designing Data Center Networks Using Bottleneck Structures
Jordi Ros-Giralt, Noah Amsel, Sruthi Yellamraju, James Ezick, Richard Lethin, Yuang Jiang, Aosong Feng, Leandros Tassiulas, Zhenguo Wu, Min Yee Teh, and Keren Bergman
Proceedings of the 2021 ACM SIGCOMM 2021 Conference, 2021
[journal] [pdf] [video] [code]
Computing Bottleneck Structures at Scale for High-Precision Network Performance Analysis
Noah Amsel, Jordi Ros-Giralt, Sruthi Yellamraju, James Ezick, Brendan von Hofe, Alison Ryan, and Richard Lethin
2020 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS), 2020
[journal] [pdf] [slides]
Finding Hierarchical Structure in Neural Stacks Using Unsupervised Parsing
William Merrill, Lenny Khazan, Noah Amsel, Yiding Hao, Simon Mendelsohn, and Robert Frank
Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2019
[journal] [pdf] [code]
Context-Free Transductions with Neural Stacks
Yiding Hao, William Merrill, Dana Angluin, Robert Frank, Noah Amsel, Andrew Benz, and Simon Mendelsohn
Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2018
[journal] [pdf] [code]