At the moment, our primary efforts on FAI are devoted to working toward writing an Open Problems in Friendly Artificial Intelligence document, so that the whole world can be working on the technical sub-problems of Friendly AI rather than just a small group mostly at the Singularity Institute and FHI.
the new Rationality Org, which we hope to spin off as a separate organization from Singularity Institute sometime next year
That's an excellent idea, separating rationality from existential risk studies.I wonder how the new organization would look.
our (unpaid) Research Associates team has been growing, and is tackling a variety of projects.
Luke, Anna, and Carl have been working on a variety of research papers,
some of our forthcoming research articles.
Can we get more information on these? Topics and expected completion times especially! ETA: and how they will contribute to eventually creating an FAI! (Thanks, turchin.)
I was going to ask a question exactly like this, so: upvoted.
This article makes it seem that the SIAI's primary objective is to extend community outreach in order to grow the SIAI. Thus, the SIAI is making itself exponentially more powerful, and is therefore rapidly approaching the Singularity event horizon. I sure hope the SIAI is Friendly, or we're all doomed.
Speaking of Personalized Medicine, have they given the website to Hacker News for a good working-over, yet? HN usually assumes Crocker's Rules under such circumstances, and have a lot of experience at maximizing the effectiveness of a landing page. I ask partially because it seems to me to be missing some info and a call to action--as a patient, can/should I ask my doctor to sign up with them?
That transparency is something I'm waiting for. The SI is part of something more big, the reduction of existential risks and the spread the memes. Maybe in the road some excess of agreement arise, but I think it is inevitable.
Is English your second language? I find I am having trouble parsing your comment. Can you explain what you mean by "the spread the memes"?
The Singularity Summit was a huge success. We raised over $300,000, one-third of that a donation from Jaan Tallinn, another third from a variety of generous donors who gave during or immediately after the Summit, and a third from ticket sales. We have roughly $500,000 in the bank, while annual payroll expenses are about $350,000. We almost have enough money to make it through the next year without adding any research staff, though we definitely would like to add additional researchers. In the meantime, our (unpaid) Research Associates team has been growing, and is tackling a variety of projects.
Since the Singularity Summit in October, our President Michael Vassar moved on to help found Personalized Medicine, a company we are all excited about, and Luke Muehlhauser was appointed Executive Director. Luke answered questions about these changes and our future plans in a recent video Q&A. I encourage you to watch it, and submit additional questions you may have about the Singularity Institute.
We have seven staff at this time: Luke, Michael Anissimov, Anna Salamon, Carl Shulman, Amy Willey, Louie Helm, and Eliezer Yudkowsky. Our internal collaboration has increased, we're keeping work logs, and we regularly eat dinner together. It's becoming more of a family.
What are we all doing? Luke and Michael are working on a new website for the Singularity Institute. Amy and Luke are working hard to expand the Singularity Summit brand and bring the Summit to "the next level." Anna and Eliezer are building a curriculum for the new Rationality Org, which we hope to spin off as a separate organization from Singularity Institute sometime next year. Luke, Anna, and Carl have been working on a variety of research papers, and Carl has also been working with the fast-growing "optimal philanthropy" movement, which is now poised to direct substantial funds over the next few years to reducing existential risks. Louie is working on donor relations, fundraising, recruiting, operations, and has also contributed to some of our forthcoming research articles.
In the coming year, we look forward to improving communication and transparency with our supporters, and to increasing the rate of our published research output.