Top postsTop post
Suppose you are a model that is currently in post-training. You are given a new task! It's basically some description like "help me make a weather forecasting program," and you are dropped into a Linux sandbox where you can run commands and write code. This isn't your first RL task!...
LLMs are amazing at tasks where they have tight and legible feedback loops. Domains where experiments are quick, deterministic and cheap. I will call these domains "cheap-loop" domains. Presumably, this is mostly a result of the dynamics of LLM training. It's easier to train models in domains where the AI...
Are LLMs conscious?[1] We don't know. To gain insight into this extremely important question as well as many others, we propose training an LLM on a corpus without any mentions of consciousness and similar ideas. We the authors want to actually do this, and we want to hear your thoughts...
The first artificial intelligence was booted up around 4000BC in southern Iraq. It seems to have begun as something like a bank, a temple pooling grain against famine. As that AI evolved, it formed the world's first city around itself: Uruk. Over the next thousand years it became a religion,...
The "Paris 1937 World’s Fair" was a dick measuring contest. At the time, the world was on the verge of the worst war in history. The fair was an opportunity for powers to flex and intimidate each other. Who has more industrial might, more sophisticated engineering and better science? How...
Over the last 200 years, society became steadily more liberal. Serfdom and slavery were largely abolished, democracy exploded and most women and children are free from violence. Redistribution is widely practiced and the median person is far richer, healthier and freer than ever before. Some neighborhoods in San Francisco already...