The Low-Rank Bottleneck in Attention

Date:

Contributed Talk at New York Academy of Sciences Annual Machine Learning Symposium, New York Academy of Sciences

Presented our work on attention rank at this annual meeting.