KV cache is 1 bit per channel: efficient large language model inference with coupled quantization

An official website of the United States government Here's how you know

Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

This content will become publicly available on June 5, 2026

KV cache is 1 bit per channel: efficient large language model inference with coupled quantization

Author(s) / Creator(s):: Zhang, Tianyi; Yi, Jonah; Xu, Zhaozhuo; Shrivastava, Anshumali