Agreed that the huge (in comparison to human short term memory) context size makes updating weights less pressing. Also agreed that training to improve the ability to write memories and documentation by looking at improvements in accuracy on subsequent tasks of a variety of types makes sense. I still think that weight updates have something to recommend them, notably the "grokking" phenomena where further training can reorganize a substantial body of weights.
I have a suggestion on incremental weight updating. I hope it is ok to place it here. If not, can ... (read more)
Venerating a corpse does it no good, and vilifying it does it no harm.
(I suppose I should add a qualifier - I mean either a non-cryonically suspended legal corpse, or an information-theoretically-dead corpse. That covers the case if one were to extend "venerate" to include include maintaining-in-cryonic-suspension)
obligatory xkcd response:
Not necessarily: a straightforward steelmanning would re-define "anything in this world" as "anything in this world I can get by paying an appropriate price (not necessarily in money)".
Even with that restriction, the quote would still be false. In terms of things priced financially, there are lots of objects which cost more than many peoples' lifetime earnings (and good luck trying to raise those earnings by a large multiplier). In terms of things priced in terms of time or effort - there are limits on those too. If, for instance, a nonagenarian enrolled in a Ph.D. program which typically took a decade to complete - they might earn their degree, but the odds are against it.
If the only thing in favour of an idea is how wonderful the world would be if everyone followed it, it's a bad idea.
Almost entirely agreed. The one class of exceptions are cases where a single standard avoids some severe problem with a mix. "Elbonia will switch from driving on the left to driving on the right. The change will be made gradually."
More importantly, I'm disputing that it makes sense to judge by the numbers today.
It certainly isn't a perfect measure - but it seems like a decent one. I'd suggest correcting for some measure of how common the technology is. If there was something that only 10% of people have, but those 10% are getting killed at the same fraction per year as automobile drivers, I'd think it is still notable, though it wouldn't precisely meet gwern's criteria. If there were a technology which much less than 10% of the population has, then I'd be skeptical that it was... (read more)
I haven't tracked down the specific evidence - but muons are comparatively easy: They live long enough to leave tracks in particle detectors with known magnetic fields. That gives you the charge-to-mass ratio. Given that charge looks quantized (Milliken oil drop experiment and umpteen repetitions), and there are other pieces of evidence from the particle tracks of muon decay (and the electrons from that decay again leave tracks, and the angles are visible even if the neutrinos aren't) - I'd be surprised if the muon mass wasn't pretty solid.
Though if we take "efficacy" to the include the social effects (say, persuading one's co-religionists to assist after a loss that prompted the prayer), the universality looks quite plausible... Perhaps in the environment of evolutionary adaptation, hunter-gatherer bands were small enough that all prayer was effectively public, and this always applied, while private prayer might be a recent maladaptive generalization?
Here's another link, which points to quite a body of research: http://bud-meyers.blogspot.com/2012/03/study-10-on-wall-street-are-psychopaths.html
Not to endorse the view, but criticism of specifically the middle class is not novel: (from a comment on Paul Fussell's Class):
Quoting Lord Melbourne, he notes: "The higher and lower classes, there's some good in them, but the middle classes are all affectation and conceit and pretense and concealment."
The pain from the needle during the injection lasts just a few seconds, but the muscle pain at the injection site is noticeable for hours. That said, I'd rate it as much lower than eric3 rated it. For me, this is one of those situations where having the explanation for a sensation in hand, and knowing that it is self-limiting and harmless, makes a large difference. I'd be quite concerned if I had a pain of identical magnitude but with no explanation for what caused it.
"soon" can vary quite a bit, depending on what is false. Following the link, I'm skeptical of "From the study of that single pebble you could see the laws of physics and all they imply." Specifically, I'm skeptical that one can deduce the parts of the laws of physics that matter under extreme conditions (general relativity, physics at Plank-scale energies) by examining the behavior of matter under benchtop conditions, at achievable levels of accuracy. The motivation for building instruments like the LHC in the first place is that they allow probing parts of physical laws which would otherwise produce exceeding small effects or exceedingly rare phenomena.
Many Thanks for writing this! Fascinating journey!