What Does the Rank Buy? A Spectral and Distributional Analysis of Low-Rank Adaptation
arXiv:2609.32002v1 Announce Type: new Abstract: The rank $r$ in LoRA is widely treated as a capacity control: a smaller rank is assumed to yield a simpler model that generalizes better. We show that, under hard per-factor norm...
Read more: https://arxiv.org/abs/2609.32002
Scan with your phone
Scan with your phone