Arguably EA/Rationality needed much simpler and less nuanced messaging on how to deal with aI capabilities companies. We really should have gone with 'absolutely do not help or work for companies increasing ai capabilities. Only work directly on safety.' Nuance is cool and all but the nuanced messaging arguably just ended up enabling Anthropic and OpenAI.
FWIW Im very angry about what happened and I think the speedup was around five years in expectation.
If this goes through I would strongly advise you to buy MSFT stock. I bought a ton when the possible deal was announced.
Any kind of contact sport is lunacy. Even non-contact sports like track can hurt your joints if you aren't careful. Basketball is bad for your knees, etc. I would tell my kids if they want to exercise: swim or jog on sand. If they want to have fun play video games or have sex (bang in your bedroom at any age). I don't believe in being coercive but I hope my child would trust me enough they wouldn't even consider playing football or heading a soccer ball.
https://twitter.com/DickgirlsR/status/1599693592125394945
MSFT - 10%
INTEL - 10%
Nvidia - 15%
SMSN - 15%
Goog - 15%
ASML - 15%
TSMC - 20%
Updated my 'diversified' portfolio for this:
MSFT - 10%
INTEL - 10%
Nvidia - 15%
SMSN - 15%
Goog - 15%
ASML - 15%
TSMC - 20%
It doesn't seem to be the safest to be too sure how the future will go. Id recommend hedging for whatever possibilities you can.
I have been saying similar things and really wish we had gotten started sooner. It's a very promising approach.
As of 2022 the fire alarm is ringing. I think there is a decent chance I will be dead in ten years. Whatever I want to do I need to do it soon. It has been very motivational:
-- Restored my relationship of ~10 years (we broke up in 2021 and got back together in 2022)
-- Actually learned to work on crypto apps. Wrote some cool code. Previously I just did crypto finance. I've always thought crypto was sweet and wanted to contribute but didn't push myself to start writing dapp code.
-- Started ramping up animal activism (animals matter in the future. If I only h...
My favorite explanation of what it means to be a friend is "Pigs on the Wing"
You know that I care
What happens to youAnd I know that you care
For me tooSo I don't feel alone on the weight of the stone
Now that I've found somewhere safe to bury my bone
And any fool knows a dog needs a home
A shelter from pigs on the wingPink Floyd, Animals
Possibly my favorite written passage is the last verse of "Wish You Here". I thought about it all the time when I was separated from my best friend.
...How I wish, how I wish you were here
We're just two lost souls
Swimming in a fish
The second post is really quite good. But I am not sure it's the best fit for what I wrote. It's not like I wrote about racism or how much people suffer in solitary confinement. I am expressing some truly niche views that are only popular among a tiny minority. For fundamentally I think my emotional reaction is grounded in some very basic cruxes. As far as I can tell turkeys served for food really do suffer terribly. I think one is just Eulering themself if they start rejecting 'suffering is bad'.
I think the first post is an interesting critique. Res...
I am expressing some truly niche views that are only popular among a tiny minority.
This isn't really evidence against the second post being applicable. Every mainstream morality today must have started as a niche view among a tiny minority. A lot of humans probably have a status-gaining strategy of trying to be a successful moral vanguard. There are lots of examples of people playing status games in a tiny group. The Status Game has a chapter on Heaven's Gate, for example. Or maybe a better comparison is to the anti-vaxx movement, which must have once b...
...All of which is to say that I spend a decent chunk of the time being the guy in the room who is most aware of the fuckery swirling around me, and therefore the guy who is most bothered by it. It's like being a native French speaker and dropping in on a high school French class in a South Carolina public school, or like being someone who just learned how to tell good kerning from bad keming. I spend a lot of time wincing, and I spend a lot of time not being able to fix The Thing That's Happening because the inferential gaps are so large that I'd have
Duncan hosted 2+ long FB threads at the time where a lot of people shared their experiences with Brent, and I think were some of the main ways that Berkeley rationalists oriented to the situation and shared information, and overall I think it was far better than the counterfactual of Duncan not having hosted those threads. I recall, but cannot easily find, Kelsey Piper also saying she was surprised how well the threads went, and I think Duncan's contributions there and framing and moderation were a substantial part of what went well.
...It is public record he
Humans don't swim very well wearing lots of clothing. Take off your suit before going into the water.
I actually keep thinking this in the back of my own mind every time I run into this parable, so thank you for stating it out loud. (I expect if a child brought it up, the Watcher credited them for noticing further consequences, then asked to assume the Less Convenient Possible World where this is not the case.)
Animal rights obsessed vegan checking in:
I am extremely worried gpt3 is concious! To be honest i am worried about whether my laptop is concious! A lot of people worried about animal suffering are also worried about algorithms suffering.
This reaction has been predictable for years IMO. As usual, a reasonable response required people to go public. There is no internal accountability process. Luckily things have been made public.
Releasing GPT-3 non-trivially increased the odds of doomsday. So yeah they are not good actors.
Can you elaborate on that? It seems non-obvious; I feel like I could tell a different story
... like, OpenAI has much fewer resources than Deepmind, so if Deepmind released GPT-3 first, and if it is the case that scaling up a language model far enough gives you AGI, there would have been less time in between knowing what AGI will look like and having AGI.
Many people have proposed this model with respect to animals but it isn't true. This old post covers a particular saliant time it came up in the rationalist community. https://agentyduck.blogspot.com/2014/11/how-i-feel-about-emotional-appeals.html
Vegans: If the meat eaters believed what you did about animal sentience, most of them would be vegans, and they would be horrified by their many previous murders. Your heart-wrenching videos aren't convincing to them because they aren't already convinced that animals can feel.
...I think the people who changed m
In my experience, people seem to coordinate ok when they genuinely share the same goals. A lot of friends of mine have mostly shared the goal of 'make six to eight figures on crypto'. Truly enormous amounts of money was loaned on trust. Several deals were made when the price was still unclear (just get me 30K on Biden) and people never asked for receipts. No one was ever stiffed out of their money. As far as I know, there has not been a single serious dispute.
Many of the people involved don't even like each other! And yet huge amounts of money changed hand...
I don't know how it will all play out in the end. I hope kindness wins and I agree the effect you discuss is real. But it is not obvious that our empathy increases faster than our capacity to do harm. Right now, for each human there are about seven birds/mammals on farms. This is quite the catastrophe. Perhaps that problem will eventually be solved by lab meat. But right now animal product consumption is still going up worldwide. And many worse things can be created and maybe those will endure.
People can be shockingly cruel to their own family. Scott's Who...
I don't particularly blame humans for this world being full of suffering. We didn't invent parasitoid wasps. But we have certainly not used our current powers very responsibly. We did invent factory farms. And most of us do not particularly care.
I am very afraid more powerful humans/human-aligned beings will invent even worse horrors. And if we tolerate factory farming it seems possible we will tolerate the new horrors. So I cannot be confident that humans gaining more power, even if it was equitably distributed among humans, would actually be a good...
But don't you share the impression that with increased wealth humans generally care more about the suffering of others? The story I tell myself is that humans have many basic needs (e.g. food, safety, housing) that historically conflicted with 'higher' desires like self-expression, helping others or improving the world. And with increased wealth, humans relatively universally become more caring. Or maybe more cynically, with increased wealth we can and do invest more resources into signalling that we are caring good reasonable people, i.e. the kinds of peo...
It is not obvious at all that 'AI aligned with its human creators' is actually better than Clippy. Even AI aligned with human CEV might not beat Clippy. I would much rather die than live forever in a world with untold numbers of tortured ems, suffering subroutines, or other mistreated digital beings.
Few humans are actively sadistic. But most humans are quite indifferent to suffering. The best illustration of this is our attitude toward animals. If there is an economic or ideological reason to torment digital beings we will probably torture them. The ...
It is not obvious at all that 'AI aligned with its human creators' is actually better than Clippy.
It's pretty obvious to me, but then I am a human being. I would like to live in the sort of world that human beings would like to live in.
These leverage tokens do not behave how they should. Very few if any people should use them. But Binance did not lose use funds. If you were doing perp-spot arbitrage on Binance you were not at any risk.
note: the future-spot arb has indeed dried up.
People, by default, do not care very much about the suffering of the powerless. This is a very general pattern: De facto torture of the old and dying (Who by Very Slow Decay), Animal in factory farms, prisoners in solitary, Scott's rant about school being child prison, etc.
There is no real need to explain a specific example of a very general trend. In fact it is the opposite that needs explanation. We actually have made progress in various ways (for example slavery is greatly reduced, though the USA still has prisoner slaves). But compassion toward t...
I am holding some eth. Hope this timeline happens. But color me skeptical. 20k eth seems doable though. I think we probably cross 20k if eth 2.0 and optimism both perform well.
Cardano has been very Too weak Too Slow. They have a giant valuation but they still haven't launched smart contracts! The coin launched in 2017, so they had plenty of time to work. Despite this they have the fourth-highest valuation! (excluding stablecoins). This situation seems crazy to me on fundamentals. Of course, they probably will pump once smart contracts launch. But despite having most of my net worth in crypto I am not buying Cardano.
Explicit YOLO ALL IN numbers for my biggest bags. Until we hit these numbers I am not shoving everything:
Sol - 8
Matic - 0.3
FTT - 7.5
ETH - 500
BTC - 12K
Remember in 2018 ETH went 1400->89 and it wasn't all downhill. Lower highs, lower lows. Be ready for the opportunity.
The early Pro Tour seemed amazing. When I followed the pro your ten years ago it was still extremely interesting. But I started interest years before the MPL. They have continually de-emphasized draft. They killed Rochestor draft in ~2005. Then they got rid of the all draft pro tours in 2008. In 2020 they completely removed draft from 'players tours'.
De-emphasizing draft was bad enough. But the real death kneel was when they moved the Pro/Player's Tours so far back from set release. I am not sure exactly when they started doing this but it feels like...
I have been saying this on other forums (where more people listen to me) for over a week but I might as well post it here too:
I have been pushing crypto quite hard. I do NOT recommend buying crypto until momentum reverses. If taxes and bankroll were not relevant I would say buying and selling are probably close to equivalent with a slight preference to selling. Of course, this means I put a decent probability on a quick recovery but I am not betting on it. Make sure you have at least some dry powder for the deep bear market if it comes. I hope you took som...
The people who make ad blockers have improved my life enormously. It's worth noting Facebook timeline ads are not particularly annoying. Maybe forcing sites to mask their ads as content is a good thing.
It only assumes there are a lot of domains in which you would be happy to make progress. In addition success is at least somewhat fungible across domains. And it is much easier to cut red tape once you already resources and a track record (possibly in a different domain).
Don't start out in a red-tape domain unless you are ready to fight off the people trying to slow you down. This requires a lot of money, connections, and lawyers and you still might lose. Put your talents to work in an easier domain, at least to start.
If you are a smart person I suggest working in domains where the regulators have not yet shut down progress. In many domains, if you want to make progress most of your obstacles are going to be other humans. It is refreshingly easy to make progress if you only have to face the ice.
Everyone shits on younger people (say 14-22). But the younger people I interact with have a lot of great ideas and good perspectives. I am always happy to have a chance to learn from them. Why so much hate?
Crypto is not doing the hottest. But another part of the story is BTC is losing dominance. Though who knows what is about to happen.
The magnitudes are much smaller on both sides of a recent situation. My father died three weeks ago. The family somehow ended up spending over 40K on death expenses (funeral, mausoleum slot, flowers, etc). My mom ended up spending six hundred and fifty dollars on a single rose arrangement in the shape of a big heart. The time to convince my family of effective altruism is not right after my father died. But I found spending so much money on a dead man, or more charitably expensive rites for the living, horrifying to see up close. Six hundred and fifty doll...
Years of accumulated experience and metis point the other way, at least for this audience. Anyone who has spent time in rationalist or rationalist adjacent spaces knows that a huge percentage of rationalists* are trans. After many years of being an active rationalist* I literally know dozens of trans people in or adjacent to the community. If a rationalist is struggling with whether to transition they should try transitioning. A huge number of rationalists think trying hormones was the best decision they ever made, very few seriously regret it. If a ration...
The coronavirus response has been so bad I no longer doubt many Sci-Fi premises. Before I often said to myself "you have tech that can do X and you still have problem Y. Ridiculous!". But apparently, we can make a coronavirus vaccine in two days. But we still had over a year of lockdowns and millions of deaths. One in six hundred people in the USA have died of the virus but we blocked a vaccine because one in a million people who take it MIGHT develop treatable blood clots.
My standards for 'realistic' dysfunction have gotten a lot lower.
There are several groups now because people wanted to keep some topics seperated. Sadly I don't think any of them are open to the public.
Which epistemic values? I am posting these trades in public (not always on lesswrong itself but in adjacent spaces which are easy enough to check if needed). If they blow up I will suffer the reputational consequences. The inverse should occur if they work out well. Do you want to bet on whether FTX.com losses a substantial amount of user funds in the next year? What odds do you give?
The opportunities don't seem gone to me. Though I doubt we see anything as good as 2011 bitcoin. Many rationalists bought Solana around January 7th when it unlocks. I posted a...
So update as of November 23rd, 2022...
FTX is bankrupt, with at least an $8 billion hole on their balance sheet. Customer funds gone, many people lost 6 and even 7 figure balances.
So... what were those odds on "FTX.com losses a substantial amount of user funds" again?
The more info that comes out, the more it looks like the entire thing was fraudulent from the beginning. They even have a software back-door that allows them to transfer funds without alerting auditors, which it looks like they used many times with FTX customer deposits.
Additionally...
Cel...
1 - The historical returns would obviously have been ludicrously high. I assume advice will be worse going forward. There has not been all that much investing advice on lesswrong and some of it was to buy crypto relatively early. If some of your investments 200-2000x you don't need to be right about much else. And it is not like all the other advice would have gone terribly. Tech stocks are doing great. Some of the advice was also boring stuff like 'buy index funds'. Do you think there are hundreds of examples of investment ideas on lesswrong that went to ...
How many LWers bought Bitcoin in 2011 and ended up with poor returns due to the demise of Mt. Gox?
I almost ended up losing a little of my money that way, but was stopped when my KYC evidence was rejected for no clear reason. I ended up doing well by buying Ripples a couple of years later, but I don't know whether I would have done that if I had lost money in my first attempt.
A good friend of mine, who I know is making absurd returns on altcoins, is still bummed about that losing his entire investment on that options trade. Losing 100% is pretty demoralizing I guess.
FWIW this is around the amount of progress I was expecting in 2016. For better or worse I updated very hard toward very short timelines once alphago was released in 2015. Amusingly at the time I figured we had 10-20 years until strong AGI, which gives an average of 2030. I prefer to say strong AGI since as far as I'm concerned publicly available AGI was released in late 2022.