THIS GUIDE IS OUT OF DATE
[I would like to say "and we have a new guide that is not out of date" but we haven't written it yet. You can read a post about new features of the updated editor here)
.. (read more)
Many "rare" LLM behaviours are known if you're in the know (e.g. Gemma/Gemini acting weird around dates after their training cutoff) but aren't immediately apparent if you're just working with the LLMs. In lieu of an existing resource about this, I thought I'd start the wiki (with the hope of others contributing to it in the future)... (read more)
Aether is an AI safety research organization.
| User | Post Title | Wikitag | Pow | When | Vote |
Monastic Academy for the Preservation of Life on Earth offers what they call "modern monastic training to develop a collective that can resolve the crises of the digital age."
Over time, there might be an increasingly large gap between insider model access and outsider model access. By insiders, we mean employees at the frontier lab. By "outsiders", we mean external safety researchers, third-party auditors, and other actors trying to make the future go well.
We call this a model access gap — and when the gap is small, we call this model access parity....
I might just be daft, but I was confused by this sentence and my best explanation is there is a typo in it:
> Previously, we've been combining both
It seems like the correct reading would be that a blue observation carries 1 bit of evidence against H?
Artificial Intelligence is the study of creating intelligence in algorithms. AI Alignment is the task of ensuring [powerful] AI systemsystems are aligned with human values and interests. The central concern is that a powerful enough AI, if not designed and implemented with sufficient understanding, would optimize something unintended by its creators and pose an existential threat to the future of humanity. This is known as the AI alignment problem.
Wikitag for organizing and announcing protests.
Monastic Academy for the Preservation of Life on Earth offers what they call "modern monastic training to develop a collective that can resolve the crises of the digital age."
Aether is a smallan AI safety research organization.
Real-world experience provides an excellent foundation for continued professional success. level 6 nvq construction offers a practical way to demonstrate management capability through evidence collected from active construction projects. The qualification values competence developed through hands-on responsibility and leadership. This workplace-focused approach continues to benefit construction professionals throughout their careers. The College of Contract Management also provides construction-related programmes that encourage lifelong learning.SPAM
Real-world experience provides an excellent foundation for continued professional success. level 6 nvq construction offers a practical way to demonstrate management capability through evidence collected from active construction projects. The qualification values competence developed through hands-on responsibility and leadership. This workplace-focused approach continues to benefit construction professionals throughout their careers. The College of Contract Management also provides construction-related programmes that encourage lifelong learning.
Over time, there might be an increasingly large gap between insider model access and outsider model access. By insiders, we mean employees at the frontier lab. By "outsiders", we mean external safety researchers, third-party auditors, and other actors trying to make the future go well.
We call this a model access gap — and when the gap is small, we call this model access parity.
Questions:
Wikitag for talking about protests.
Goodhart's Law is of particular relevance to AI Alignment. Suppose you have something which is generally a good proxy for "the stuff that humans care about", it would be dangerous to have. If you make a powerful AI optimize for thethis proxy, in accordance with Goodhart's law,law predicts that the proxy will breakdown.break down.
Why does this happen? The proxy can at best partially describe your real goal. An optimizer will optimize for the entire proxy, not just the part you wanted optimized. Examples of how this happens are provided by the taxonomy below.
[I would like to say "and we have a new guide that is not out of date" but we haven't written it yet. You can read a post about new features of the updated editor here)
Articulation is not my strong suit, so I apologize in advance for any blunders deposited. CEV = good.
Peoples wants = fickle, subject to change, and categorically a sub optimal idea for a target spec.
When I studied the current state of alignment, it seemed to me that alignment is a structural problem requiring a structural fix. If humanity's survival is a load-bearing constraint, then it should be a load-bearing constraint at the architectural level such as that the machine cannot argue with it. Analogy: when I jump, I cannot argue with gravity. it just IS. I return to the ground. When a rocket targets escape velocity, honoring reality in practice means we point the rocket eastward to reduce required speed relative to the ground (for escape velocity). The rocket doesn't argue with gravity, it engineers around the constraint. Therefore, alignment should be a structural reality an AI cannot engineer around. It can't be a behavior guardrail. Acknowledging that eventually, its going to advance to a point where our opinions won't matter. It is also worth pointing out the stochastic reality, the longer people sit around and debate alignment, the increased probability that someone is going to engineer a solution without consulting you.