A new year has come. It's 2024 and note-taking isn’t cool anymore. The once-blooming space has had its moment. Moreover, the almighty Roam Research isn’t the only king anymore.
The hype is officially over.
At this time of year, when many are busy reflecting on the past year while excitingly looking into the future, I realized it's a good opportunity to look back at Roam’s madness timeline. The company that took Twitterverse and Silicon Valley by storm is now long after its breakthrough.
Roam was one of those phenomena that happen every other few years. Its appearance in our lives not only made the “tools for thought” niche fashionable. It marked a new era in the land of note-taking apps. In conjunction with a flourishing movement of internet intellectuals[1], it...
I'm still on Roam and using it every day. For me, it's not "a lot of work", it's what's necessary to keep track of my thoughts to the point that I feel like my mental workspace is clean. I've journaled a lot since I was a kid. I think better in writing.
This is my permanent diary. I will probably have it for the rest of my life, if they keep supporting it. Twenty years from now, I'll want to know what I was doing today!
I also log literally all links of "general interest" in my browsing history in my public Roam. does anyone care? Probably not, but it ...
Introduces the idea of cognitive work as a parallel to physical work, and explains why concentrated sources of cognitive work may pose a risk to human safety.
Acknowledgements. Thanks to Echo Zhou and John Wentworth for feedback and suggestions.
Some of these ideas were presented originally in a talk in November 2024 at the Australian AI Safety Forum slides for which are here: Technical AI Safety (Aus Safety Forum 24) and the video is available on YouTube.
This post is the "serious" half of a pair, for the fun version see Causal Undertow.
This essay explores the idea of cognitive work, by which we mean directed changes in the information content of the world that are unlikely to occur by chance. Just as power plants together with machines are sources of physical work, so too datacenters together...
The analogous laws are just information theory.
Re: a model trained on random labels. This seems somewhat analogous to building a power plant out of dark matter; to derive physical work it isn't enough to have some degrees of freedom somewhere that have a lot of energy, one also needs a chain of couplings between those degrees of freedom and the degrees of freedom you want to act on. Similarly, if I want to use a model to reduce my uncertainty about something, I need to construct a chain of random variables with nonzero mutual information linking the ...
In light of reading through Raemon's shortform feed, I'm making my own. Here will be smaller ideas that are on my mind.
I've talked to Michael Vassar many times in person. I'm somewhat confident he has taken LSD based on him saying so (although if this turned out wrong I wouldn't be too surprised, my memory is hazy)
I would take bets at 9:1 odds that Michael has taken large amounts of psychedelics. I would also take bets at similar odds that he promotes the use of psychedelics.
Marcus Hutter on AIXI and ASI safety
links 12/9/24
A fool learns from their own mistakes
The wise learn from the mistakes of others.
– Otto von Bismarck
A problem as old as time: The youth won't listen to your hard-earned wisdom.
This post is about learning to listen to, and communicate wisdom. It is very long – I considered breaking it up into a sequence, but, each piece felt necessary. I recommend reading slowly and taking breaks.
To begin, here are three illustrative vignettes:
You warn the young grad student "pace yourself, or you'll burn out." The grad student hears "pace yourself, or you'll be kinda tired and unproductive for like a week." They're excited about their work, and/or have internalized authority figures yelling at them if they aren't giving their all.
They don't pace themselves. They burn out.
(FYI this is George from the essay, in case people were confused)
This is a personal post: I'm not speaking for SecureBio or BIDA.
I help organize a contra dance that requires high filtration masks (N95 etc) at half of our dances. When we restarted in 2022 we required masks at all our dances, before switching to half in 2023. We just ran a survey of our dancers, and while there are people who would like to not have to wear masks there are also a lot of people who are only willing to come if they know all the dancers will be masked. [1]
Last week I attended a conference for work with a lot of people thinking about biosecurity, which has me wondering about ways we could have a hall as safe as one where the dancers are all wearing N95s but without the ways N95s make it...
Put particles in the air and measure how quickly they're depleted. ex: Evaluating a Corsi-Rosenthal Filter Cube
After the release of Ben Pace's extended interview with me about my views on religion, I felt inspired to publish more of my thinking about religion in a format that's more detailed, compact, and organized. This post is the second publication in my series of intended posts about religion.
Thanks to Ben Pace, Chris Lakin, Richard Ngo, Damon Pourtahmaseb-Sasi, Marcello Herreshoff, Renshin Lauren Lee, Mark Miller, Roger Thisdell, and Imam Ammar Amonette for their feedback on this post, and thanks to Kaj Sotala, Tomáš Gavenčiak, Paul Colognese, and David Spivak for reviewing earlier versions of this post. Thanks especially to Renshin Lauren Lee, Roger Thisdell, and Imam Ammar Amonette for their input on my claims about perennialism, and Mark Miller for vetting my claims about predictive processing.
In my previous...
terminal values in the first place, as opposed to active blind spots masquerading as terminal values.
Can't one's terminal values be exactly (mechanistically implemented as) active blind spots?
I predict that you would say something like "The difference is that active blind spots can be removed/healed/refactored 'just' by (some kind of) learning, so they're not unchanging as one's terminal values would be assumed to be."?
Yeah, that's a good point. I certainly don't claim that Michael is to blame for her actions.