Tell HN: Declaration of Independence is 100% AI, according to AI Checker

16 points by whatamidoingyo 177 days ago | 3 comments

My wife is a freelance writer/translator, and so many of her clients check her work with so-called AI Checkers, often making her rewrite her work until it scores below 30% (even if it was 100% her work in the first place).

If you're relying on these tools, please know that they're not accurate. At all. In fact, they're a waste of time. As an example, I pasted the first three paragraphs of the Declaration of Independence into one of these checkers, and the result: 100% AI generated via ChatGPT.

Edit: removed link to AI Checker site, as I don't want this to look like an ad. If you want to check, google "AI Checker", and test yourself.

WheelsAtLarge 177 days ago |

I would think so. I'm sure it's one of the documents used to train the LLMs. It does not surprise me that a checker would think it was AI generated. I bet if you put any popular document, the same will happen.

True, people are putting too much trust into the checkers.

dbaman 177 days ago | |

But is that first point really true?

If a document is used to train an LLM, that means that an AI checker would be more likely to give a false positive that the document is written by AI?

I guess it depends on the AI checker.

I would think that that LLM, after generating the fragment "When in the course of.." would just be a bit more likely to generate "human" as the next word, yes?

gus_massa 177 days ago |

Slightly related: During 2020 there was a problem with AI proctors that had too many false positives.