LESSWRONG
LW

2335
Dhananjay Ashok
2210
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
Updating and Editing Factual Knowledge in Language Models
Dhananjay Ashok9mo20

I think we know very little about how humans learn individual new facts from a neuroscience perspective. There are some studies that track fMRI scans of individuals who learn new things over the course of a day (sleep seems particularly important for the formation of connections in the brain having to do with new learning), but I am sceptical that it is the kind of learning that could be applied to Language Model type systems as of now. 

 

In general though, I think humans are the gold standard for factual knowledge updating. I agree with you that there are some examples of failures, but no other system comes close in my view. 

Reply
1Locating and Editing Knowledge in LMs
9mo
0
2Updating and Editing Factual Knowledge in Language Models
9mo
2