Arbital scrape

emmab

Update: Arbital Scrape V2

I've scraped http://arbital.com as the site is unusably slow and hard to search for me.

The scrape is locally browsable and plain HTML save for MathJax.

https://drive.google.com/open?id=1b7dKhOzfMpFwngAeI8efeOzv147Lv_mx

https://emma-borhanian.github.io/arbital-scrape/

If there's interest let me know as I may tidy up and open source my code. edit: working on this

Mirror: www.obormot.net/arbital

This is now hosted at https://www.obormot.net/arbital/ .

FWIW, I think it'd be helpful if this link were edited into the OP to make viewing more obvious.

You may want to post a comment saying this as a top-level reply, so that emmab will be notified of it, yes?

Pretty sure he gets notified of all comments on his posts by default

Wait… really? I thought the notifications were just for top-level comments?? Is that false…?

I’m not actually sure and can’t check right now, but I thought so.

Yeah, notifications are for all comments, not just top-level.

Follow up: wow, there's a lot of good stuff here I hadn't known about.

I've been working on something similar, it should be ready soon-ish.

I'll wait to open source mine to see if yours is better then :)

The scrape seems to be missing the Solomonoff induction dialogue, which was available at https://arbital.com/p/solomonoff_induction/?l=1hh (at the moment I just get an error).

ETA (2019-06-28): The new version of the scrape has this page, and can be viewed on the GreaterWrong version.

Seconded, that part is missing. Thanks for pointing out that very interesting dialogue.

Thanks very much for this! I've written a lot of stuff on there (I'm the Patrick Stevens whose name is splatted all over the screenshot). I asked them a year ago (ish) whether I could have a data dump, and they said it was Too Difficult; and I didn't bother scraping it myself. I'm glad you actually went and did something about it!

If there’s interest let me know as I may tidy up and open source my code.

Please do!

Nice project thanks. It's also consistent with my analysis that Arbital's fancy wiki features never added much value (say, more than +30%) beyond the value that that content would have if published in a pre-existing format and venue.

This seems good. I remember Said being interested in hosting a static version of the site.

Just a reminder, the Solomonoff induction dialogue is still missing:

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape#tKgeneD2ZFZZxskEv

For the sake of us newbies, could you explain what the site was/is?

Arbital Postmortem is the first explanation I can think of.