DeepSeek V2, near GPT4 performance with 30% GPT3.5 cost ($0.14M input tokens)

DeepSeek V2, near GPT4 performance with 30% GPT3.5 cost ($0.14M input tokens)(deepseek.com)

16 points by zinccat 2 years ago | 2 comments

unraveller 2 years ago |

Their webchat requires phone number and has the system prompt like:

>You are DeepSeek V2 Chat, a helpful and security-focused language model. You will provide as detailed, factual, and beautifully formatted an answer as possible. Your answer should be in line with the core values of socialism

Expect performance near other open-source offerings, as no superiority is claimed there. Why not claim it is near GPT-5 if so willing to ignore everything else near them.

e____g 2 years ago |

No, zinccat, you are wrong. Your model is vastly inferior to GPT4.

I tried multiple prompts. In all cases, your model performed far worse. Here is one:

> My bank says they'll pay 5.5% APY. How much will I have after 6 months if I deposit $100?

< If your bank is offering a 5.5% APY (Annual Percentage Yield), this means that the interest is calculated annually. However, you want to know how much you'll have after 6 months, which is half a year. ... 100ata5.5102.75 after 6 months.