LLM Quantization Project Part 1: What Even Is an LLM?

4 points by LabsLucas 83 days ago | 2 comments

LabsLucas 83 days ago |

Note: This is Part 1 of 3 in our LLM Quantization series.

Part 1: What Even is an LLM? Part 2: Why do LLMs Need So Much VRAM? (coming soon) Part 3: How Do We Compress an LLM? (coming soon)

jupr 83 days ago |

Makes me think somewhere out there exists a tiny micro SD card worth potentially billions of dollars.

LabsLucas 83 days ago |

Note: This is Part 1 of 3 in our LLM Quantization series.

Part 1: What Even is an LLM? Part 2: Why do LLMs Need So Much VRAM? (coming soon) Part 3: How Do We Compress an LLM? (coming soon)

jupr 83 days ago |

Makes me think somewhere out there exists a tiny micro SD card worth potentially billions of dollars.