The Embedding Report.

Entities · Models

vLLM

3 articles tagged with this entity.

Kara: Efficient Reasoning LLM Serving via Sliding-Window KV Cache Compression

via export.arxiv.org · Global · 15d ago
Tangram: Unlocking Non-Uniform KV Cache Compression for Efficient Multi-turn LLM Serving

via export.arxiv.org · Global · 32d ago
The Silent Hyperparameter: Quantifying the Impact of Inference Backends on LLM Reproducibility

via export.arxiv.org · Global · 59d ago