FL33TW00D

The reason this visualisation is so persistent is that it taps into one of biological brains strongest inductive biases: stuff falls down.

A more useful (mental) visualisation is a 3D vector field with regions of low/high loss colorised as regions/clouds in space. This gives an extra degree of freedom back to weights.

It also enables you to think about things like weight decay as a gravitational pull towards the centre.

I had assumed most elite engineers are using spaced repetition?

I'm not elite but life would be much more difficult without it.

Disagreeing because it really wasn't that simple. He had to masterfully play multiple key people, it wasn't just "win the dam, win the day".

What I mean to highlight is that Brown and Root were fungible, any of the other rich Texans of the era could have been utilised instead.

Both Rayburn and Russell were absolutely crucial.

Whilst Brown and Root were the core of Johnsons financing for the rest of his career, they were just one piece of the puzzle.

His cultivation of numerous older men was of far greater importance (there were plenty of other rich backers he could have had, there was only one Sam Rayburn), in particular Richard Russell and Sam Rayburn. Without them he would have never ascended beyond the house.

Any source for Gemini 3 Pro and Opus 4.5 being multiple trillion? Just intuitively from the serving speed of Opus 4.5 seems dubious.

I investigated this a while back, Starship completely breaks the trendline. I arrived at $120/kg with an estimated 5 reuses.

Interactive version here.

Firefox Focus on iPhone is useful here.

Delete all social media apps from your phone, and hide safari. 

Only access any platforms via Firefox Focus - browsing sessions are ephemeral, so you need to login each time. This added friction basically solved it for me.

The linked video says so at 30:45

I think you're missing a trick here purely focusing on waking seconds.

Demis explains this beautifully in this talk here:

TLDW:

The brain replays memories stochastically during sleep, and replays them OOMs faster than they were experienced. This "multi epoch training" allows the brain to learn much more from the environment, and it can prioritise salient experiences.