I wish I could pay for a guarantee of performance, really quantization, which seems so simple but because it can 2-4x decrease their costs, LLM API providers keep quantizing and distilling without telling anyone. It’s a longer journey: to be an enterprise API. Which by the way, is a terrible business to be in.
To OP:
> Show HN is for something you've made that other people can play with. HN users can try it out, give you feedback, and ask questions in the thread.
> The project must be something you've worked on personally and which you're around to discuss.
While this is a cool demo that shows what LLMs can do I am a bit surprised how polished and advanced it looks (even PDF upload) for a quick start. Anyway I love that it's open source so we can learn from it.
https://github.com/anthropics/anthropic-quickstarts/blob/9d5...
On a second glance I'd say that the visualizations are pretty limited but good enough for a demo.
I would be curious to understand why you are looking for an alternative?
Currently, the "Added to project" button that remains for n seconds and you have to wait for to add another file (sometimes Claude generates 4-5 files per chat) is such an annoyance that I guess they should stick to training and nothing else.
I currently work for a company where most our value add lies in the data collection, cleaning and running of proprietary algorithms. A UI like this would be a game changer for us and something that Anthropic couldn’t easily replicate due to all the IP in our data pipeline.
Also, most people are not computer experts; if you show them something can be done using your website, they will continue to do it using your website long after others have added the same functionality.
Please correct me if I am wrong. Thanks!
Here's the part you're looking for: https://github.com/anthropics/anthropic-quickstarts/blob/mai...
Yes, the response might be in a standard format. But a well formed response can still be bad/broken.
Another way to think about it, is it can "pass QA" one day, and "fail QA" the next day even if the API response is identically formatted/structured.
What am I missing?
For example, try to let it turn multiple items in a table cell into a bulleted list. It just outputs a mess of literal HTML tags.
I am more familiar with React - am looking for a React example that achieves similar UI, any working examples I can take inspiration from?
gpt-4o can change, but gpt-4o-2024-05-13 will always use the 2024-05-13 snapshot.
I get the feeling they frequently deploy hot patches for edge cases. I hate to call them edge cases because they are actually “real cases” - things like adjusting system prompts so one day it might happy answer “Fill in the blank: F _ _ _ you”.
To truly freeze a model, you would need to freeze its weights, freeze its system prompts (no one sees those), and avoid any and all action that might impact its output. Perhaps would even need the default temperature to be 0 so it’s truly a deterministic API, with the option to add in some temperature to the responses.
Until then, I consider those “versions” but only reference the model weights and not the abstractions around the model
