x

LESSWRONG
LW

Bjrn

Subscribe

Message

2

3

7y

Bjrn

Subscribe

Message

2

3

7y

What were the biggest discoveries / innovations in AI and ML?

Answer by BjrnJan 08, 202020

From A 'Brief' History of Neural Nets and Deep Learning, Part 4:

So, why indeed, did purely supervised learning with backpropagation not work well in the past? Geoffrey Hinton summarized the findings up to today in these four points:

Our labeled datasets were thousands of times too small.

Our computers were millions of times too slow.

We initialized the weights in a stupid way.

We used the wrong type of non-linearity.

I think this blog series might help provide a partial answer to your question.

Reply

My Anki patterns

Bjrn6y20

Would it be possible to share some CSS/images showing off your card æsthethethics?

Reply

Personal quality experimentation

Bjrn6y10

It seems largely true to me that it is not hard to create a temporary change in one of the axes, but I am curious if these can lead to permanently changed settings in the long run. I would be very curious to hear from anyone who's created lasting change through an experiment like this and what axis in particular they changed.

Personally, I've experimented with acting much more extroverted than I typically am in certain social contexts (interviews are a good example) and the new setting feels comfortable or even better at times. Gaining more experi... (read more)

Reply