A Self-Pruning Transformer: Extreme KV-Cache Compression w/Universal Attention(arxiv.org)6 points by matt_d 12 hours ago | 0 commentsNo comments yet