KV Cache Is Becoming the Memory Hierarchy of Inference | Dark Hacker News