GitHub

Oaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantization

Oaken is an accleration solution that achieves high accuracy and high performance simultaneously through co-designing algorithm and hardware, leveraging online ...
IEEE

A Quantization-Aware DL-Based Channel Estimation Algorithm for OFDM Systems

Abstract: This paper proposes a quantization-aware deep learning (DL)-based channel estimation algorithm for orthogonal frequency-division multiplexing (OFDM) systems under varying effective number of ...
IEEE

BRIC: Bottom-Up Residual Vector Quantization for Learned Image Compression

Abstract: This paper presents Bottom-up Residual vector quantization for learned Image Compression (BRIC). This novel deep learning-based image compression method quantizes latent representations ...
GitHub

SimVQ: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer

imagenet └── train/ ├── n01440764 ├── n01440764_10026.JPEG ├── n01440764_10027.JPEG ├── ... ├── n01443537 ...