" (...) the term technical is a red flag for me, as it is many times used not for the routine business of implementing ideas but for the parts, ideas and all, which are just hard to understand and many times contain the main novelties."
- Saharon Shelah
"A little learning is a dangerous thing ;
Drink deep, or taste not the Pierian spring" - Alexander Pope
As a true-born Dutchman I endorse .
For my most of my writing see my short-forms (new shortform, old shortform)
Twitter: @FellowHominid
Personal website: https://sites.google.com/view/afdago/home
Able activists are conflict theorists. They understand the logic of power & propaganda & cultish devotion at an intuitive level. To become an effective soldier one needs to excise a part of the brain devoted to evenkeeled uncertainty, nuance, intellectual empathy, self-doubt.
Conflict theorists may do great good as readily as they may do great harm. They wield a dangerous force, easily corruptible, yet perhaps necessary.
I was taught the more classical 'ideal' point of view on the structure of rings in school. I'm curious if [and why] you regard the annihilator point of view as possibly more fecund?
Nice post Cole.
I think I'm sympathetic to your overall point. That said, I am less pessimistic than you that Neural Network computation can never be understood beyond the macroscopic level ' what does it do' .
The Turing machine paradigm is just one out of many paradigms to understand computation. It would be a mistake to be too pessimistic based on just the failure of the ur-classical TM paradigm.
Computational learning theory's bounds are vacuous for realistic machine learning. I would guess, and I say this as a nonexpert, that this is chiefly due to
(i) a general immaturity of the field of computational complexity, i.e. most of the field is conjectures, it's hard to prove much about time complexity even if we're quite confident the statements are likely true
(ii) computational learning theory grew out of classical learning theory and has not fully incorporated the lessons of singular learning theory. Much of the field is working in the wrong 'worst-case/pessimistic' framework when they should be thinking in terms of Bayesian inference & simplicity/degeneracy bias. Additionally, there is perhaps too much focus on exact discrete bounds when instead one should be thinking in terms of smooth relaxation and geometry of loss landscapes.
That said, I agree with you that the big questions are currently largely open.
https://youtu.be/tgkP0W7OvMc?si=hoa0l2mu5B6aRbpy
Perhaps of interest, 16:33 the guy mentions the development of a new type of drone resistant "turtle" tank
Highly recommended video on drone development in the Ukraine-Russia war, interview with a Russian private military drone developer.
some key takeaways
Chinese manufacturing and technological prowess is strong but they produce their military material like toys - they don't have the on-hands experience that Russia [and Ukraine] has.-
Much appreciated Habryka-san!
You might be interested in my old shortform on the military balance of power between US and China too. It's a bit dated by now - the importance of drones has become much more clear by now [I think the evidence that we are in a military technological revolution on par with the introduction of guns] but you may find it of interest regardless.
According to Ukraine drone operators western drones are often not even regarded as very good. Expensive, overengineered, fail often, haven't kept pace with rapid innovation during the Ukraine war.
What is meant by 'causal direction' ? Where in the paper is this referring to?