A few predictions: A google subsidiary starts selling TPUs. Deepmind seeks outside funding and moves to productize their suite. GCP becomes more viable. Google search loses market share and is forced to compete with Gemini’s offerings. OAI and Anthropic have enormous revenue streams open up. Timeline effects: Acceleration due to...
Dwarkesh had a podcast recently with Francois Chollet (creator of Keras) He seems fairly skeptical we are anywhere near AGI with LLMs. He mostly bases his intuition that LLMs fail on OOD tasks and don't seem to be good at solving simple abstract reasoning problems he calls the ARC challenge....
Presumably they get offered longevity treatments since they already get healthcare. Are they locked up until the end of time? For 100 years?
The movement to reduce AI x-risk is overly purist. This is leading to a lot of sects to maintain each individual sect's platonic level of purity and is actively (greatly) harming the cause. How the Safety Sects Manifest * People suggest not publishing AI research * More recently, Jan and...
https://arxiv.org/abs/2402.17764 claims that 1 bit LLMs are possible. If this scales, I'd imagine there is a ton of speedup to unlock since our hardware has been optimized for 1 bit operations for decades. What does this imply for companies like nvidia and the future of LLM inference/training? Do we get...
This 5-7 trillion is to enhance GPU production and he also sees revenue doubling from current $2 billion to $4 billion next year. I’m taking a guess GPT-5 training is going well?