LESSWRONG
LW

Dhananjay Ashok
2210
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
Updating and Editing Factual Knowledge in Language Models
Dhananjay Ashok7mo20

I think we know very little about how humans learn individual new facts from a neuroscience perspective. There are some studies that track fMRI scans of individuals who learn new things over the course of a day (sleep seems particularly important for the formation of connections in the brain having to do with new learning), but I am sceptical that it is the kind of learning that could be applied to Language Model type systems as of now. 

 

In general though, I think humans are the gold standard for factual knowledge updating. I agree with you that there are some examples of failures, but no other system comes close in my view. 

Reply
No wikitag contributions to display.
1Locating and Editing Knowledge in LMs
7mo
0
2Updating and Editing Factual Knowledge in Language Models
7mo
2