Ask HN: Have you noticed decreased quality in GPT-4 reasoning recently?

4 points by ammar_x 3 years ago | 5 comments

I noticed a significant decrease in the model reasoning abilities in the last few days, especially when it comes to writing code. Has anyone else experienced this?

Given that these models are being used in all sorts of applications all over the world, I think it's concerning that OpenAI can lobotomize a model in secret and no one can verify that and do something about it.

skilled 3 years ago |

As an EU user, I feel like it has been watered down a lot, both 3.5 and 4. Many queries now come with disclaimers which are pretty annoying since you can't set your own system instructions in the ChatGPT interface. Using the API is fine though since you can explicitly say that you want a specific format.

rainy59 3 years ago | |

true they could be fiddling w things as the EU AI Act moves forward

monkeydust 3 years ago | | |

Wouldn't surprise me if members of EU parliament and comission were big time customers now via the OpenAI playground.

rainy59 3 years ago |

The more they force the model into politically-fashionable responses, the further they get away from rational thought process. CodeT5+ looks promising though

mdp2021 3 years ago |

> concerning

...And in fact some at Google are already projecting a future of Open Source dominance in the subfield.

(Edit: the system must have missed a post update: )

...Coincidentally, in fact, a neighbouring post is: OpenAI readies new open-source AI model - https://news.ycombinator.com/item?id=35958789