All of artifex0's Comments + Replies

Well, props for offering a fresh outside perspective- this site could certainly use more of that.  Unfortunately, I don't think you've made a very convincing argument. (Was that intentional, since you don't seem to believe ideological arguments can be convincing?)

We can never hope to glimpse pure empirical noumenon, but we certainly can build models that more or less accurately predict what we will experience in the future. We rely on those models to promote whatever we value, and it's important to try and improve how well they work. Colloquially, we ... (read more) Eliezer's latest story, past 1M words

There are a lot of interesting ideas in this RP thread.  Unfortunately, I've always found it a bit hard to enjoy roleplaying threads that I'm not participating in myself.  Approached as works of fiction rather than games, RP threads tend to have some very serious structural problems that can make them difficult to read.

Because players aren't sure where a story is going and can't edit previous sections, the stories tend to be plagued by pacing problems- scenes that could be a paragraph are dragged out over pages, important plot beats are glossed o... (read more)

7Eliezer Yudkowsky3mo
We are both experienced authors not in need of this advice at this level.
What DALL-E 2 can and cannot do


I'm not sure how much the repetitions helped much with accuracy for this prompt- it's still sort of randomizing traits between the two subjects.  Though with a prompt this complex, the token limit may be an issue- it might be interesting to test at some point whether very simple prompts get more accurate with repetitions.

That said, the second set are pretty awesome- asking for a scene may have helped encourage some more interesting compositions.  One benefit of repetition may just be that you're more likely to include phrases that more accurately describe what you're looking for.

What DALL-E 2 can and cannot do

When they released the first Dall-E, didn't OpenAI mention that prompts which repeated the same description several times with slight re-phrasing produced improved results?

I wonder how a prompt like:

"A post-singularity tribesman with a pet steampunk panther robot. Illustration by James Gurney."

-would compare with something like:

"A post-singularity tribesman with a pet steampunk panther robot. Illustration by James Gurney.  A painting of an ornate robotic feline made of brass and a man wearing futuristic tribal clothing.  A steampunk scene by James Gurney featuring a robot shaped like a panther and a high-tech shaman."

"A post-singularity tribesman with a pet steampunk panther robot. Illustration by James Gurney." Vs "A post-singularity tribesman with a pet steampunk panther robot. Illustration by James Gurney. A painting of an ornate robotic feline made of brass and a man wearing futuristic tribal clothing. A steampunk scene by James Gurney featuring a robot shaped like a panther and a high-tech shaman." Huh! Yeah, the second one definitely does seem to incorporate more detail.
4Shai Noy4mo
Good point. I've also noticed good results for adding multiple details by mentioning each individually. E.g. instead of "tribesman with you blue robe, holding a club, looking angry, with a pet robot tiger" try "A tribesman with a pet tiger. The tribesman wears a blue robe. The tribesman is angry. The tribesman is holding a club. The tiger is a cyberpunk robot robot."
Convince me that humanity *isn’t* doomed by AGI

I think this argument can and should be expanded on.  Historically, very smart people making confident predictions about the medium-term future of civilization have had a pretty abysmal track record.  Can we pin down exactly why- what specific kind of error futurists have been falling prey to- and then see if that applies here?

Take, for example, traditional Marxist thought.  In the early twentieth century, an intellectual Marxist's prediction of a stateless post-property utopia may have seemed to arise from a wonderfully complex yet self-con... (read more)

Playing with DALL·E 2

Thanks for posting these.

It's odd that mentioning Dall-E by name in the prompt would be a content policy violation.  Do you know if they've mentioned why?

If you're still taking suggestions:
A beautiful, detailed illustration by James Gurney of a steampunk cheetah robot stalking through the ruins of a post-singularity city.  A painting of an ornate brass automaton shaped like a big cat.  A 4K image of a robotic cheetah in a strange, high-tech landscape.

I think OpenAI mentioned that including the same information several times with different ph... (read more)

What's the easiest way to currently generate images with machine learning?

For text-to-image synthesis, the Disco Diffusion notebook is pretty popular right now.  Like other notebooks that use CLIP, it produces results that aren't very coherent, but which are interesting in the sense that they will reliably combine all of the elements described in a prompt in surprising and semi-sensible ways, even when those elements never occurred together in the models' training sets.

The Glide notebook from OpenAI is also worth looking at.  It produces results that are much more coherent but also much less interesting than the CLIP n... (read more)

Postmortem on DIY Recombinant Covid Vaccine

Has your experience with this project given you any insights into bioterrorism risk?

Suppose that, rather than synthesizing a vaccine, you'd wanted to synthesize a new pandemic.  Would that have been remotely possible?  Do you think the current safeguards will be enough to prevent that sort of thing as the technology develops over the next decade or so?

If you want to synthesize a new pandemic you would need to know what proteins to add. That's very hard. It's much easier to It seems the South African's for example put older variants together in the lab with antibodies against the spike protein to test how soon it evolves to get immune evasion. That's the kind of research with the potential to produce new pandemics waves like Omicron.

Not really, was concerned about biological X-risks before and continue to be.

I don't currently see any plausible defense against them - even if we somehow got a sufficient number of nations to stop/moderate gain-of-function research and think twice about what information to publish, genetic engineering will continue to become easier and cheaper over time. As a result, I can see us temporarily offsetting the decline in minimum IQ*money*tech_level needed to destroy humanity but not stop it, and that's already in a geopolitically optimistic scenario.

Luckily there are some intimidatingly smart people working on the problem and I hope they can leverage the pandemic to get at least some of the funding the subject deserves.

Thoughts on Moral Philosophy

Do you think it's plausible that the whole deontology/consequentialism/virtue ethics confusion might arise from our idea of morality actually being a conflation of several different things that serve separate purposes?

Like, say there's a social technology that evolved to solve intractable coordination problems by getting people to rationally pre-commit to acting against their individual interests in the future, and additionally a lot of people have started to extend our instinctive compassion and tribal loyalties to the entirety of humanity, and also peopl... (read more)

That's entirely plausible
Going Out With Dignity

When people talk about "human values" in this context, I think they usually mean something like "goals that are Pareto optimal for the values of individual humans"- and the things you listed definitely aren't that.

I'm not sure they mean that. Perhaps it would be better to actually specify the specific values you want implemented. But then of course people will disagree, including the actual humans who are trying to build AGI.
5Svyatoslav Usachev1y
If we are talking about any sort of "optimality", we can't expect even individual humans to have these "optimal" values, much less so en masse. Of course it is futile to dream that our deus ex machina will impose those fantastic values on the world if 99% of us de facto disagree with them.
Sam Altman and Ezra Klein on the AI Revolution

The marketing company Salesforce was founded in Silicon Valley in '99, and has been hugely successful.  It's often ranked as one of the best companies in the U.S. to work for.  I went to one of their conferences recently, and the whole thing was a massive status display- they'd built an arcade with Salesforce-themed video games just for that one conference, and had a live performance by Gwen Stafani, among other things.

...But the marketing industry is one massive collective action problem. It consumes a vast amount of labor and resources, distort... (read more)