Skip to content

Archiving the Internet for myself

I would really like to get setup with an archiving setup - I frequently want to find something that I've read previously and duckduckgo/google is only so good - I save useful bookmarks in a very generous way to firefox bookmarks and pinboard w/ archive utility, and I occasionally use the web clipper or the Save to the Wayback Machine web extension, but I want to set something up like gwern's archiving setup which most usefully to me involves piping firefox history into a deduped local archive of the websites you visit + a filter-urls utility to make sure less useful stuff like searches are saved. Another very useful tool is either searching my twitter feed with the "only people I follow" switch on, and searching my rss feed on Feedbin.

I might end up using my Raspberry PI 3b+ for this, it can finally get some use!

I just found Robust Links which seems like a good place to start for making the stuff I link to available in a vaguely accessible way. You can click on the dropdown to get the backup link.

Now just to figure out how to integrate that into hugo? so that the backup can happen in a cached way at build time rather than requiring me to go to Robust Links and manually create a "robust link".