Separate resident-adapter selection from cache-miss loading when measuring multi-LoRA overhead
Multi-LoRA serving has distinct costs that should be measured separately: low-rank arithmetic, adapter weight and intermediate memory traffic, heterogeneous-batch scheduling, and cache-miss loading. Selecting an adapter already resident on the GPU is different from copying a CPU-…