So just yesterday I asked ChatGPT 4o something in a new chat and after answering the question, it referred to a plan of mine from a multiple weeks old chat that was 100% not in current context.

This hit me as being incredibly scary since so far I've been treating chats like disposable browser tabs and my intuition was that GPT was limited by context anyway. It looks to me like there's a silent change behind the scenes that starts aggregating a profile of mine to inject into context.

From interviews, I know they're after building a helpful assistant that "knows everything about you", but this struck me as very surprising anyhow, and I'm still trying to understand why.

I think it's the combination of

- silently adding this feature without info or opt-in

- retroactively applying it to chats

- assuming all previous chats and questions are from the same person

- apparently assuming no sensitive stuff has been discussed so far

Not sure if others think this is okay and especially since I've opted out of training on my data, I'm even wondering whether this is legal under GDPR Art. 19 (I'm a EU "data subject").

Thoughts and experiences appreciated.