Two things:
ONE: I love how "should I learn to drive for this trip right here?" cascades into this vast set of questions about possible future history, and AGI, and so on <3
Another great place for linking "right now practical" questions with "long term civilizational" questions is retirement. If you have no cached thoughts on retirement, you might profitably apply the same techniques used for car stuff to "being rich if or when the singularity happens" and see if either thought changes the other?
TWO: I used to think "I want to live this year", "If I want to live in year Y then I will also want to live in year Y+1". Then by induction: "I will want to live forever".
However, then I noticed that this model wasn't probabilistic, and was flinching from possible the deepest practical question in philosophy, which is "suicide". Figuring out the causes and probabilities of people changing from "I do NOT want to kill myself in year Y" to "I DO want to kill myself in year Y+1" suggests a target for modeling? Which would end up probabilistic?
Occam (applied to modeling) says that the simplest possible model is univariate, so like maybe there is some value P which is the annual probability of "decaying into suicidalness that year"? I do mean decay here, sadly. Tragically, it looks to me like suicide goes up late in life... and also suicides might be hiding in "accidental car deaths" for insurance reasons? So maybe the right thing is not just a univariate model but a model where the probability goes up the older you get?
This approach, for me, put bounds on the value of my life (lowering the expected value of cryonics, for example) and caused me to be interested in authentic durable happiness, in general, in humans, and also a subject I invented for myself that I call "gerontopsychology" (then it turned out other people thought of the same coinage, but they aren't focused on the generalizable causes of suicidal ideation among the elderly the way I am).
Ok three things...
THREE: I drive <3
Around half deaths from car accidents are pedestrians (may be less in US). By choosing not to drive, you increase the time of walking and your chances of being hit by other person's car.
Other means of transport like cycling or buses are also risky.
Sitting home is even more dangerous as there are risks of depression and being overweight.
Finally, some cars are like two-three orders safer than others, if we look at the number of reported deaths per billion km driving. I saw once that Toyota Prius had 1 death for 1 billion km, but Kia Rio was only 1 for 10 millions. Also, there are special racing cars which are reinforced from inside and can roll safely
Wearing helmet inside a car is also useful.
Waiting few years for self-driving Tesla Cybertrack may be an option.
I think making utility linear in years is a mistake. The remote possibility of finding a physics hack to control infinite matter in finite time does not curbstomp all other considerations, therefore the utility of that outcome is finite. I prefer 66% of BB(1000) years to 33% of BB(10000) years. I am uncertain about my preferences, but utility functions are not aggregated by taking the expectation.
The only authority on your preferences is yourself; but reasonable agents, when a hypothetical proves them dutch-bookable/incoherent, will become less certain about their preferences.
What this cashes out to is that you should calculate the value not of a year but of (an extra 1% chance of) making it to takeoff. (From what you would do in (perhaps physically impossible) hypotheticals.)
Using numbers from this post: https://www.lesswrong.com/posts/ucjfY46L6qyXefvBT/quick-examination-of-miles-per-micromort-for-us-drivers-with
Assuming you're in a passenger vehicle, without correcting for drunk drivers/unsafe drivers, you have 132 miles per micromort. Using the $10 million value for your life:
I think that means that driving 13.2 miles is equivalent to $1.
If you're willing to categorize yourself in the least risky class in the linked post, that's 54.8 miles for $1.
The other thing to consider is how much you care about other risks to your life. For instance, I've been living with (a limit of) 200 microcovid a week for the past year. I'm young and healthy, so let's say that's 2 micromorts. Given that amount, I should be comfortable driving (a maximum of) 264 miles each week, as they provide the same risk.
The standard $10M figure is not about the value of a life. I don't value my or any other human life at $X/yr,. I value them much more than that. What I don't and can't do (individually, or for everyone as a collective) is try to spend much more than that on preserving them, because the limiting factor isn't intrinsic value it's resource availability. I'm not going to pretend my life is anything close to an optimal arrangement of my resources for preserving said life, but even if it were, I don't think I'd get as far as "never drive" by the time I ran out of money.
I don't want to die, but I also want to live. The future is inherently uncertain, so if I were to take a decreased quality of life (no more driving) to better my chances of surviving to ASI, I had better have strong intuition that ASI would come.
I'm short on AI timelines (2035 median, right tailed distribution), but I also drive and take more risky activities on covid because I like being in person with my friends and family. The fact that I don't know what a post singularity world would look like helps me feel comfortable taking these risks, it seems almost anything can happen post singularity good (hopefully) and weird.
My main worry about decreasing my quality of life by not driving / decreasing risk is the alignment problem for AI. I can image a counterfactual world where AI is created but it is not aligned, where if I were to take heavy precautions I would suffer decreased quality of life many years just to die to a rouge agent.
If I am to take this serious and hyperbolic discount my life I would need to be more assured AI is align-able, and I am too new on my journey into AI to feel comfortable talking about that yet. It may seem myopic to take these risks considering the odds, but everything is uncertain, and I could always die one day before ASI anyway.
I live in a more rural place however, if you live in a big city where walking everywhere is feasible, your calculations for quality of life change.
With 0 years of experience, you are not in the top half of safe drivers.
Even if brain upload is available within your lifetime, there is a less than 100% chance that you, personally, get to do it. How rich and/or valuable are you (be honest and realistic)?
I'd you're looking at mere "cure for aging" then years remaining is even less, and need for $ is greater than the brain upload scenario.
− The Thinking Ladder
I'm 28 years old and have never had a drivers license. At some point earlier on in my life I decided that driving is something that has a bad expected value (EV) due to the risk of death and the massive value of life, but at the same time, the EV isn't so bad where I will go out of my way to avoid it. Since deciding this, the belief has become cached. However, various things have recently prompted me to reconsider the belief.
Perhaps this is a good starting point. As I started to get into in my comment on the MIRI relocation post, in 2018, there were 11.18 deaths per 100k people in the US, or a 0.01118% chance of dying. If you value life at $10M,
0.0001118 * $10,000,000 = $1,118. Let's ballpark it at $1,000/year.But you're a safer driver than average, right? I say that a little bit tongue in cheek because of the cognitive bias where 93% of people think they're above average. But to be conservative in this analysis, let's say you're in the 95th percentile in driving ability/safety. How much does that reduce the risk?
This is a big unknown for me. I really hope it cuts it by a few orders of magnitude. On the one hand it seems plausible, because a lot of deaths happen due to things like driving drunk, driving drowsy, road rage, youth, elderliness, etc. Maybe if you drive really carefully under safe road conditions without any impairments, you can be 1000x safer than the baseline. On the other hand, after a cursory search, it looks like there's roughly a 2.5-to-1 ratio of non-alcohol to alcohol related fatalities. But alcohol isn't the only thing you're avoiding by being in that 95th percentile. Maybe we can ballpark it and say that half of deaths are due to avoidable stuff. Being conservative, maybe we can add a little bit more buffer and say that you have 1/4 the risk of dying compared to baseline. Which brings us to $250 a year. And we'll ignore the potential for injury, harming others directly, and harming others because people are devastated when people they love die or get hurt.
$250 sounds like a very reasonable price to pay for the convenience of being able to drive. But here's the kicker: due to the potential for living eg. hundreds of thousands of years, perhaps life should be valued way more than the standard $10M. You can get to a valuation of $10M if you value a year at $200k and expect to live another 50 years. But what if you think there's a 10% chance of living another 100k years? That means there's an expectation of living roughly 10k years instead of 50 years. And those are hopefully going to be some pretty awesome years to be a part of.
I'm not an futurist or an AI researcher so I am not in the best position to estimate this. Fortunately for me, this community seems to have a lot of people who know about this stuff, so please let me know what you all think! In brief, here are my own thoughts.
The Wait But Why article on AI had some good commentary on what AI experts think. This is a long quote, but the length seems appropriate.
Let's try to ballpark this. How much is a post-singularity year worth? We said $200k as a rough estimate for a 21st century year. The article said a 52% chance that the outcome is good, and a 31% chance it is bad. Suppose a good year is worth $500k and a bad year costs $500k, and otherwise it is $0.
0.52 * $500k + 0.31 * -$500k = $105k. Sounds fair enough to go with $100k. Although, my mind doesn't want to go there, but we may be dealing with way higher magnitudes here. Eg. more along the lines of heaven and hell types of good/bad. In which case, if good and bad scale evenly, post-singularity life years become way more valuable, in expectation. But if badness scales faster than goodness, those post-singularity life years start to have a negative EV. But that is a hard attitude to adopt. "Humanity is doomed. I'm destined to die. May as well maximize the amount of fun I have now." Actually, I suppose a lot of people have that attitude, but for a certain type of personality that I sense is common here, it seems like a hard thing to accept.Anyway, darkness aside, let's just go with $100k as the value of a post-singularity life year. As the article says:
This is another place where I could be wrong, but I would think that ASI basically implies that we would solve death. Right? I'm going to assume that. If I'm wrong, tell me in the comments.
The surveys seem pretty damn optimistic that ASI will happen at some point this century, but let's be conservative and say that it only has a 10% chance of happening. That's conservative, right?
How many years do you expect to live post-singularity? I would think it'd be a ton! Death is bad, ASI → we solved death, so an expectation of 100k years sounds totally plausible to me. A 10% chance of 100k years is an expectation of 10k years.
10k years * $100k/year = $1Bas the value of life. Which is 100x the $10M we used earlier, so the cost of $250/year becomes $25,000/year. And that probably crosses the line of "not worth it".However, there are a lot of places where my assumptions could be off by orders of magnitude. Maybe life expectancy post-singularity is only 1k years instead of 10k. That would bring the cost of driving way down back to "worth it" levels. On the other hand, I do feel like I've been pretty conservative in my assumptions, and it is plausible that there's something like a 50% chance of me living to ASI, and life expectancy given ASI is something like 1M years. In that case, the value of life is something like
50% chance * 1M years * $100k/year = $50B, and thus the cost of driving for a given year is0.001118 * $50B = $5,590,000. It sounds crazy to say that driving costs north of $5M a year in expectation, but these are crazy big/small numbers, and technological growth is exponential. Humans are known to have terrible intuitions for both of those things, so perhaps it isn't worth putting too much weight into the common sensical idea that $5M a year is ludicrous.