lennart

Lennart Heim | Zürich, Switzerland | Personal Website | LinkedIn | Twitter | len+EA@heim.xyz |

Sequences

Transformative AI and Compute

Wiki Contributions

Comments

What is Compute? - Transformative AI and Compute [1/4]

Thanks!

  • I'm working with a colleague on the trends of the three components (compute, memory, and interconnect) over time of compute systems and then comparing it to our best estimates for the human brain (or other biological anchors). However, this will still take some time but I hope we will be able to share it in the future (≈ till the end of the year).
What is Compute? - Transformative AI and Compute [1/4]

Thanks for the correction and references. I just followed my "common sense" from lectures and other pieces.

What do you think made AlexNet stand out? Is it the depth and use of GPUs?

What is Compute? - Transformative AI and Compute [1/4]

Thanks for the feedback, Gunnar. You're right - it's more of a recap and introduction. I think the "newest" insight is probably the updates in Section 2.3.

I also would be curious to know in which aspects and questions you're most interested in.