Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models
arXiv:2609.13680v1 Announce Type: new Abstract: Fine-tuning instruct models often improves target performance while inducing behavioral drift from the reference model, which can degrade existing capabilities. Rather than treating this...
Read more: https://arxiv.org/abs/2609.13680
Scan with your phone
Scan with your phone