So it was easier than I thought. Bot just scraped public page with hidden fields, not a secret page or to-be-published page from database.
Somehow in Google search one of the unguessable pages is indexed. We have used Claude and Gemini to assist with some design aspects.
I'm thinking some aggressive data ingestion/indexing is happening by all the bots in the quest for frontier models.
[1] https://developers.cloudflare.com/cache/advanced-configurati...
Do you use a CMS or other tools that auto generate sitemap.xml? Perhaps you unknowingly told Google about those sub-pages.
Finding domains is easy, everybody uses CTL to find them.
If you don't use wildcard certs all of your subdomains can be scraped from the certificate transparency logs. Additionally, any domain+cert using HSTS with preload enabled end up in a big list at Google to speed up the initial connection from browser to site.
HSTS preload is not for speed. It's to protect against SSL stripping on first connection. Modern browsers already try port 443 first or in parallel with 80.
But I think the other explanations take care of pages: cloudflare hints, chrome reporting addresses visited, etc.
It’s a different story if it’s a subdomain though, OP wasn’t clear.
Also that browser setting to check urls are safe sends them out “sometimes“.
This is on the devs and feels like a very basic leak which could have exploited in the non LLM world as well.
Imagine a private individual just scraped the website (or simply clicked 'view source') for no reason in particular and then told people about it... They'd be labeled an uber-haxxor, face a civil lawsuit asking for ridiculous damages while being threatened with a prison sentence over CFAA violations. Hell, that might even drive some people to suicide.
Sucks it happened. But we all know that is not the typical scenario.
In the early days one of the high profile soaps in the UK published their "catch up" summaries for the week ahead which you could get just by editing the date in the URL. But back then not so many people were looking, so they were doing it for months...
https://news.ycombinator.com/item?id=48902814
See also
Zhihu (Chinese Reddit): https://www.zhihu.com/question/2060133066643879544/answer/20...
Reddit: https://www.reddit.com/r/math/comments/1urv4id/comment/oxak6...
google translate link:
https://mp-weixin-qq-com.translate.goog/s/DPsMKToa_sbi_Nx3X1...
Second, fitting that codex enters the picture.
The last time the fields medals were announced llms were still very nascent :)
And I am convinced this is the last time pure human fields medalists will be announced.
The next batch’s winners are all going to have llms as coauthors.
Interestingly, if true, it will also be the first time an MIT PhD graduate has won the Fields Medal.
Such as waste of energy to argue on
Amusing to see someone complaining about not using their definition of "proper language" when they themselves are not using proper language.
They call the signal „popularity“ and it is a successor of the Google Toolbar signal.
https://www.justice.gov/opa/pr/department-justice-wins-signi...
Why are you using weird quotes?
Edit: also private browsing isn’t exactly private when you’re logged in to the browser.
Especially if you have autocomplete-while-searching type of features on.
They control the entire browser surface, technically they can know everything, even TLS and E2E encrypted data, that they silently phone home…
If you think this is silly, consider that Microsoft Recall had been observing everything on people’s entire SCREENS and phoning home much of it. That is how a guy was caught recently: https://x.com/t3chfalcon/status/2074134314145489195
And it is actually much worse than even that:
https://community.qbix.com/t/increasing-state-of-surveillanc...
And maybe have access to EVERY site actually, with “forgot password” type stuff in addition to providing oauth tokens…
https://arstechnica.com/information-technology/2023/05/micro...
Boy do I have news for you.
Creating Sitemaps, sharing it somewere public, putting the url in some 3th party service, server logs, some indirect path in javascript.
But if you never mention that url, it will not be found if not leaked by your server.
Back in the day, you could read a stories on Slashdot practically every other week that usually went something like this: Company/institution does something stupid, somebody finds out, tries to be a good citizen and tells them. The organization then throws a tamper tantrum in the media, fires the legal department on all cylinders, screaming "hacker!" and throwing the book at them. The most egregious cases usually happened in the US, the CFAA happens to be a particularly strong book to throw.
People eventually got the hint and either talked to the press instead, or organizations like the CCC (at least in this part of the world) and let them deal with the organization and not talk to them directly.
At least in my perception/memory, it started improving over the 2010s, but stories like this are now starting to pop up again in recent years. I guess we have a new crop of computer enthusiasts who need to learn the same lessons again.
Of the top of my head, the CTF group in Malta comes to mind who gave a talk at (last years?) CCCongress. A badly worded E-mail asking about a bug bounty resulted in several arrests, house searches and ultimately a presidential pardon (https://timesofmalta.com/article/pardon-issued-students-lect...).
Eh, it's typical enough that most cyber security researchers are cautious. The laws around 'hacking' can be rather stupidly written while judges and juries aren't the smartest bunch.
Some Indian restaurants near me sell Aloo Saag, others sell Alu Sag.
Esp. in this case with Wang having a special meaning in China.
For some reason people are downvoting you, but yea, one day we'll likely see a lawsuit where they do exactly that.