Could you elaborate on this? If you can provide better "specifications" I'll implement this and add it to the library.
-DOWNLOAD HN pages locally OR to another site
This is to make a permanent copy of the site and its discussions locally, so you'll have the knowledge of the articles and discussion forever.
Either download the linked site itself, or just the link, folowed by comments. Automatically grab comment updates once a day for a week, or whenever discussion statistically tapers off.
In other words, here are the options:
-Submission titles, dates, and links to HN page
This is to provide a searchable database for HN links, and perhaps (if this were done on a separate website) you could implement a "favorites" system for people to login and bookmark those topics of discussion they liked most, ala Server Fault.
Downside: I don't know how long HN articles persist. If they disappear, this is largely useless.
-Linked sites themselves, URL to HN page, and comments
Much more permanent; a complete mirror of source sites and HN discussions, searchable. Similar login/favorites iface could be put in place.
Downside: More information is cached, more complicated scraping (source sites and HN).