Free full BGP feed. IPv4 and IPv6 (2020)(lukasz.bromirski.net) |
Free full BGP feed. IPv4 and IPv6 (2020)(lukasz.bromirski.net) |
Are rdns records always populated? I thought they were optional and many sites didn't bother
The collectors seem to be overloaded so made a temporary mirror of the one for AMS In AMS. [1] I only mirrored the latest files. Feel free to beat it up. The .gz files decompress to just under 4GB
DNS data: Root server data is available via AXFR ("dig . AXFR @f.root-servers.net") but this isn't what you're referencing.
Second level TLD server data is available is available at CZDS. (https://czds.icann.org/home) but some TLDs don't participate, but this also isn't what you're referencing.
What I think you want: There is no canonical list of all zones that exist - there is no "central repository" once you pass the root zone downwards - that's a feature, not a bug. Some organizations have partial views based on large recursive resolver data (DomainTools, Google, Cisco, Cloudflare, Quad9) but access to that data is limited to vetted researchers or more typically only available at a cost (disclaimer: I work for Quad9.) Smaller versions of recursive data sets exist, but are usually significantly limited by geography and demographics of the user community that generates the data set.
BGP route data: This exists in many forms in realtime like the site referenced above, though historic data is difficult to track. No matter what the source or latency, there is bias in the data set because BGP pathing is unique to each ASN that collects it - no two views of the table are identical, and any data set is as "best guess" at state conditions at that time.
Here are some possible data sets for BGP:
Packet Clearing House (PCH) provides a set of snapshots going back 20+ years (though it seems to be offline at the moment): https://www.pch.net/resources/Routing_Data/
Cymru has a live version you can query via various APIs (including ironically via DNS): https://www.team-cymru.com/ip-asn-mapping
Routeviews from University of Oregon also has a data set that is widely used by researchers: https://www.routeviews.org/routeviews/
No I was fantasizing that I could get these two things. They are two separate things. If I had a nickle for every time I said something off topic I could by everyone a cup of coffee.
When I needed this for some work stuff, it was pretty easy to find table dumps and work with them? I don't remember where it was, but I'm sure you can find some. After an acquisition, we had our own ASN and I was able to get table dumps from our own infrastructure.
> Same goes for the anycast root DNS servers. To have a full dump from them could be interesting. Not to be confused with the root.zone [1] I mean the whole kit and caboodle.
What do you think the root servers have that's not in the root.zone? I think you can AXFR from the root servers, too, but it should be the same thing as from the https site.
Every glue record for every domain name. The glue is the valuable goo. Without the goo everyone goes back to /etc/hosts which I am not opposed to.
It might be nice to get a zone transfer for every tld, but that's not possible for the public. (I understand there's some way to get many of them, but $$$$)
As an example: Unless you know my domains ahead of time you'll never be able to come up with what domains are hosted on my IPs because I don't bother to configure rDNS. So those IPs will look like they host no servers (or only some if you only had a partial list of my domains) rather than all of them on those IPs.
Anyways, for free data sources trying to get a partial view of this you can check out Rapid7's Sonar or Common Crawl. Each should have the pieces needed to construct this kind of view from the data.
But it seems you've to go through their sales team and all for the data.
I can't find CommonCrawl making their DNS resolution available.
I should add that I have been adding name servers to the root servers since 1998. I've just never managed one of the root servers and I guess nobody on HN has either.
If you query your domain at the root servers, they will refer you to the tld servers, run by your registry.
Then when you query your domain at the tld servers, they return your selected nameservers along with their addresses, if in their bailiwick.
I need to clean up the formatting a bit but this is a walk through. [1] I think I know where your confusion is but I will wait for your reply.
[1] - https://blawg.nochan.net/b/Internet-Crap/20260530-DNS-Recurs...
Those are not root servers. They are tld servers, run by the registry for the tld your domain is under.
The root servers serve the root. Root hints just tell you where those are. The zone file you listed has the whole root zone.
a.root-servers.net is a root server.
a.gtld-servers.net is a tld server (controlled by verisign, iirc?). several tlds use gtld-servers, but that doesn't make them root servers.
I never mentioned registrars, only registries.
> Nobody here is on a regisrar that manages the TLD root servers.
I have a .is domain. For .is and some of the other country code tlds, you contract directly with the entity managing the TLD and its servers.
Tldr, a cool domain name isn't enough to make a switch happen.