Dont Worry Government, I Got This Porn Filter Sorted

sehrope 12 years ago |

> Any request that is denied by OpenDNS is then allowed by our DNS server, and any request allowed by OpenDNS is blocked by us.

The most interesting part of this to me is using multiple DNS providers to determine which category the site is in. It's both simple and effective.

If they actually go ahead with this plan in the UK and it's implemented similarly (eg. via DNS rather than IP blocking), somebody should make a list of what's blocked. Go through the top N sites and for each run a DNS lookup from both a filtering DNS server and also a couple non-filtered ones (ex: Google DNS[1]) then compare the results[2].

Bonus points if someone builds a way to crowd source the data so that it gets logged from multiple DNS servers round the world.

[1]: https://developers.google.com/speed/public-dns/

[2]: This would need to do more than a plain A == B as each address could resolve to multiple IP addresses.

rmc 12 years ago | |

They can't and don't do it with just a DNS, it'll have to be DNS + HTTP URL. Otherwise porn hosted on one large shared hosting would block everything. (e.g. imagine if the Amazon EC2 DNS got blocked).

The current UK ISP filter (the one that already filtered Wikipedia), used DNS & HTTP. IP addresses that needed filtering were redirected to their HTTP server by sending back their IP address, and then a HTTP proxy was used to filter specific URLs. This allowed them to block certain URLs. It was initally detected because lots of wikipedians noticed a lot of edits (basically lots of the UK) coming from a small amount of IP addresses (the IP addresses of the proxies)

cmircea 12 years ago | | |

They CANNOT use HTTP filtering as that would break on HTTPS.

icebraining 12 years ago | | |

Nope, the domain is always visible on HTTPS, due to SNI. They can just block it.

mrweasel 12 years ago | | |

Older Win XP machines doesn't support SNI, so you could get around it with an older machine. Of cause that's a problem that will go away over time.

icebraining 12 years ago | | |

To connect to an HTTPS site without SNI, the IP can only host a single domain, so they can just block the whole (IP:443) combination without affecting any other site.

rmc 12 years ago | | |

I think Cleanfeed didn't block HTTPS. When have you ever heard of a public, governmental programme that didn't have a stupid flaw? :P

bigiain 12 years ago | | |

Yeah, and he government would never make that mistake…

http://www.smh.com.au/technology/technology-news/how-asics-a...

mrweasel 12 years ago | |

The Danish Internet filtering works by messing with the DNS at the ISP level. If you don't want to get filtered, just switch to a non-ISP DNS, or run your own. Sadly it was implemented with little or no public debate, very very few got upset and most of us just switch DNS. I think the UK is in a much better position because they at least have the debate public and loud.

Tehnix 12 years ago | |

I was actually also admiring the simplicity of his solution, to take advantage of services that are already in place doing the exact opposite of his.

Tip of the hat to the author...

nly 12 years ago | |

Cleanfeed (the UKs child porn filter) is supposed to be IP blocking/NAT based, coupled with web proxies. Given the scope of the filtering this time around though, it may be done by DNS. Let's hope so.

mike-cardwell 12 years ago | | |

I remember when they used this system to block an image on Wikipedia. Much hilarity ensued: http://wiki.openrightsgroup.org/wiki/Cleanfeed#Wikipedia_.2F...

cabalamat 12 years ago | |

> Bonus points if someone builds a way to crowd source the data so that it gets logged from multiple DNS servers round the world.

What you want is a website that answers: Does Country-C block Website-W? A user gives it a URL and it has VPNs surfacing in lots of different countries and it tries them all, and displays in which countries the URL is blocked.

The website also stores and records all blocked/unblocked websites, and allows this data to be downloaded.

Genmutant 12 years ago | | |

There is something like that for the great wall of china: http://www.greatfirewallofchina.org/

cabalamat 12 years ago | | |

Yes. Although that site keeps no history, doesn't allow you to download a list of blocked sites, and only works for China.

And it bizarrely replaces its headers with Flash.

joeblau 12 years ago |

Pretty comical video, one quick tip. If you typed a command on the terminal and you get the "Operation not permitted." You can run the last command prepending sudo like this:

  sudo !!

calpaterson 12 years ago |

The section with William Hague (UK Foreign Secretary) at the end of the video is priceless.

vukmir 12 years ago |

... ask not what your country can do for you — ask what you can do for your country ... JFK would be proud.

gautamsomani 12 years ago | |

hehehe. Good one.

gojomo 12 years ago |

Awesome. Advanced assignment: build a search engine which for each jurisdiction only contains results blocked-in-Google-by-legal-threats in that jurisdiction.

kordless 12 years ago |

No comments? I guess Hacker News gets blocked when you install it. :)

pvnick 12 years ago |

Step 1: Put your dic (delete)

pns.py

I was cracking up. Brilliant!

milesokeefe 12 years ago |

He should have made the server run on port 69.

Hello71 12 years ago |

  sudo ss -lpu 'sport = 53'

allinzen 12 years ago |

Brilliant! Now only if there was a cat filter that only showed cats and cat related material.

nickik 12 years ago | |

I thought that filter was called a web browser.

harrytuttle 12 years ago |

Absolutely wonderful. Well done!

laurent123456 12 years ago |

Slightly NSFW, could someone add the tag to the title?

lewq 12 years ago |

+1 for using Twisted