I do not feel like I am ready to apply for funding yet, but I was wondering are funds (such as Long-Term Future Fund) willing to give extra money to AI safety researchers (which could be spent on travel or luxury) to balance for the opportunity cost of taking an "industry" job?

What I mean by this is the following: if someone is a good AI safety researcher, that person can probably get a job in the industry by being a machine learning engineer. Maybe (and I'm not sure about this, that's why I'm asking) this person can earn more being a machine learning engineer than an AI safety researcher.

I'm wondering whether the funds would be generally willing to give a grant which exceeds the needs of the project at hand, so that the person receiving the grant can spend some of it on travel, luxury etc. To clarify, I'm not asking if the funds are willing to match a particular counteroffer from the industry, but rather are they willing to give some money to the individual so that they can spend it on things such as travel, luxury etc. (and if yes, approximately how much).

New Answer
New Comment

1 Answers sorted by

tchauvin

Mar 16, 2023

51

I think you can guess a reasonable answer even as a complete outsider (like me), considering the purpose of these funds, which is to maximize the amount of expected good they cause by the allocation of their money. A few things that must come into consideration:

  1. is it productive to pay very good researchers the bare minimum they need to survive? No:
    • it consequently make the path of independent research unattractive to most;
    • it produces some level of adverse selection in future applicants, i.e. you'll move toward getting more applications from people who couldn't really be hired in the industry, which isn't always bad but could be thought to correlate with not being an excellent researcher;
    • you don't want your researchers to waste too much time and energy on things that could be straightforwardly solved with a bit more money.
  2. on the other hand, paying too much has a few issues:
    • the money spent on a researcher hitting decreasing returns after a certain point;
    • also some level of adverse selection, if people know they can make the same amount of money here or in the industry, and your fund's approval process is lighter than industry interviews due to a lack of resources and a hits-based giving approach: you might get an influx of candidates who aren't altruistically motivated and were rejected from the industry for perhaps good reasons;
    • damaging the reputation of the movement by appearing to allocate your money frivolously.

In terms of existing data, you can have a look at past public payouts, for example the December 2021 LTFF report. In it, you'll find a 6-month salary of $50,000 for a well-known independent researcher, which is above the bare minimum needed to survive, probably allowing for some level of travel and luxury, while staying well below industry standards.