LESSWRONG
LW

311
Yair Halberstadt
3492Ω1875900
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
7Yair Halberstadt's Shortform
3y
17
Yair Halberstadt's Shortform
Yair Halberstadt2h20

Quick thoughts on Gemini 3 pro:

It's a good model sir. Whilst it doesn't beat every other model on everything, it's definitely pushed the pareto frontier a step further out.

It hallucinates pretty badly. ChatGPT 5 did too when it was released, hopefully they can fix this in future patches and it's not inherent to the model.

To those who were hoping/expecting to have hit a wall. Clearly hasn't happened yet (although neither have we proved that LLMs can take us all the way to AGI).

Costs are slightly higher than 2.5-pro, much higher than gpt 5.1, and none of googles models have seen any price reduction in the last couple of years. This suggests that it's not quickly getting cheaper to run a given model, and that pushing the pareto frontier forward is costing ever more in inference. (However we are learning how to get more intelligence out of a fixed size with newer small models).

I would say Google currently has the best image models and best LLM, but that doesn't prove they're in the lead. I expect openai and anthropic to drop new models in the next few months, and Google won't release a new one for another 6 months at best. It's lead is not strong enough to last that long.

However we can firmly say that Google is capable of creating SOTA models that give openai and anthropic a run for their money, something many were doubting just a year ago.

Google has some tremendous structural advantages:

  • independent training and inference stack with TPUs, JAX, etc. It is possible they can do ML at a scale and price point noone else can achieve.
  • trivial distribution. If Google comes up with a good integration they have dozens of products where they can instantly push it out to hundreds of millions of people (monetising is a different question).
  • deep pockets. No immediate need to generate a profit, or beg investors for money.
  • lots of engineers. This doesn't help with the cure model, but does help with integrations and RLHF.

Now that they've proven they can execute, they should likely be considered frontrunners for the AI race.

On the other hand ChatGPT has much greater brand recognition, and LLM usage is sticky. Things aren't looking great for anthropic though with neither deep pockets or high usage.

In terms of existential risk: this is likely to make the race more desperate, which is unlikely to lead to good things.

Reply
A Case for Biology of the Living
Yair Halberstadt20h30

95%+ of all studies of the human body study living bodies. Surgeons cut into living flesh umpteen times a day, and biologists do horrible things do living lab rats in a million different ways. Every study that comes out of today's universities on behaviour, medicine, optics, or what have you not, is performed on living volunteers.

Many of the most important fields in biology focus on dynamic systems, such as biology, neurology, and yes, anatomy.

I'm not sure what justification there is for saying that biology is to focused on the dead, or static systems.

Reply
A Case for Biology of the Living
Yair Halberstadt3d20

Hi and welcome to LessWrong.

Please see the policy on AI generated content: https://www.lesswrong.com/posts/KXujJjnmP85u8eM6B/policy-for-llm-writing-on-lesswrong

In particular:

Prompting a language model to write an essay and copy-pasting the result will not typically meet LessWrong's standards. Please do not submit unedited or lightly-edited LLM content. You can use AI as a writing or research assistant when writing content for LessWrong, but you must have added significant value beyond what the AI produced, the result must meet a high quality standard, and you must vouch for everything in the result.

Reply
Undissolvable Problems: things that still confuse me
Yair Halberstadt5d20

I'm not claiming that we need any extra laws of physics to explain consciousness. I'm saying that even if you showed me the equations that proved I would behave like a conscious being, I still wouldn't feel like the problem was solved satisfactorily, until you explained why that would also make me feel like a conscious being.

Reply
Wei Dai's Shortform
Yair Halberstadt6d53

I think that's fairly limited evidence, would want to see more data than that before claiming anything is vindicated.

Reply1
Undissolvable Problems: things that still confuse me
Yair Halberstadt6d20

Yes, that sounds right (minus the word metaphysical in camp 2).

To be precise: If you were to explain why, based on the laws of physics, I say the words "I Am Conscious" and otherwise act the way I do, I would still not feel like the mystery of consciousness has been explained, because there still doesn't seem to be any reason why there is something experiencing saying those words.

Reply
Undissolvable Problems: things that still confuse me
Yair Halberstadt6d20

But experience itself isn't instantaneous, it's something that happens over time.

Reply
We live in the luckiest timeline
Yair Halberstadt6d52

My claim is no nuclear bomb incident would have killed more than 25% of the population, or 500 million people in 1950, one billion 1970.

Reasoning is trivial - a single nuclear bomb can only kill a maximum of a few hundred thousand people at a time. At the height of the cold war there were a few thousand bombs on each side, most of which weren't aimed at people but second strike capabilities in rural areas. Knock on effects like famines could kill more, but I doubt they would be worse than WW2, since number of direct deaths would be smaller. It would likely lead to war, but again WW2 is your ballpark here for number of deaths from an all out global war.

Making an anthropic update from something that at worse would have reduced world population by 25 percent is basically identical to reading tealeaves, especially if you don't update the other way from WW1s and WW2s and other assorted disasters which majorly reduced world population.

Maybe we are the luckiest timeline. But the evidence for that is not enough to update you enough to meaningfully change your plans.

Reply
We live in the luckiest timeline
Yair Halberstadt7d92

Not one of these would have ended humanity, or even long term particularly reduced it's population, hence the evidence towards survivorship bias from this is effectively 0.

Reply11
Undissolvable Problems: things that still confuse me
Yair Halberstadt7d20

To clarify I'm talking about why consciousness is a possible thing to exist, in this universe or any. I'm not talking about a reason why if things can be conscious, they would evolve to be so, or regardless of whether consciousness can exist, they would evolve to act in a way similar to conscious beings.

Granted that given that this universe does have consciousness in it, hence there must be some explanation for consciousness, the superintelligence probably would predict it.

But I'm saying that none of the explanations for why consciousness is a possible thing to exist, feel like the sort of thing that would be convincing to an entity that has no idea it exists in the first place. Nor can I even imagine what sort of argument would be convincing (other than showing them that conscious beings do in fact exist).

Reply
Load More
8Arrows of time and space
3d
2
8Mortgage houses not land?
6d
1
23Undissolvable Problems: things that still confuse me
7d
22
18Thinking Mathematically - Convergent Sequences
1mo
5
61GDM also claims IMO gold medal
4mo
3
19Don't fight your LLM, redirect it!
4mo
2
31If Not Now, When?
5mo
3
194Gemini Diffusion: watch this space
6mo
39
-22Caplan's being melodramatic about circumcision
6mo
1
22Fake AI lawsuits to drive links
7mo
0
Load More