Efficient Iterative Retrieval with Heterogeneous Batching
arXiv:2609.25405v1 Announce Type: new Abstract: Modern information retrieval increasingly employs both embedding and generative models to handle complex queries. However, current serving systems suffer from low throughput and poor GPU...
Read more: https://arxiv.org/abs/2609.25405
Scan with your phone
Scan with your phone