We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost
Show HN: 60% higher tokens per second for 70B custom LLMs(baseten.co)1 points by mikejulietbravo 1 year ago | 0 commentsWe optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced costNo comments yet