Gmail AI hallucinates, distorts email contents

Gmail AI hallucinates, distorts email contents(t-online.de)

31 points by disentanglement 309 days ago | 8 comments

ggm 309 days ago |

I smell class action. The first time smart mail hallucinates something like an appointment cancellation or flight changes which leads to a real world loss, across a big enough surface of users, lawyers are going to be circling.

If this causes corporate loss, it's even more likely. GSuite is behind a lot of things.

croes 309 days ago | |

I bet they have disclaimer in the ToS

maxbond 309 days ago | | |

I didn't find one about generative AI, but I suppose this is it:

    To the extent allowed by applicable law:
    - Google is liable only for its breaches of these terms or applicable service-specific additional terms
    - Google isn’t liable for:
      - loss of profits, revenues, business opportunities, goodwill, or anticipated savings
      - indirect or consequential losses
      - punitive damages

https://policies.google.com/terms (this is titled "Google Terms of Service" & is presumably broader but is what I got by going to Gmail and clicking "Terms".)

The terms may be different for corporate users.

ggm 309 days ago | | |

Disclaimers are only as strong as the bank balance behind or defending the assault. Loss of custom typically follows a breakdown in trust as well. I suspect anyone seeking to fall back on ToS would find reasons to discuss matters round a table rather than test the strength at the bar.

I'm not a lawyer.

pixelbash 309 days ago | | |

Wouldn't that turn out to be a candle in a hurricane situation given the level of risk involved?

rvz 309 days ago |

So does "AI overviews".

I guarrantee you that you're now having to waste more time double checking even the sources hallucinated from these AI systems.

To the extent allowed by applicable law: - Google is liable only for its breaches of these terms or applicable service-specific additional terms - Google isn’t liable for: - loss of profits, revenues, business opportunities, goodwill, or anticipated savings - indirect or consequential losses - punitive damages