2023

Books

• Siddhartha An Indian Tale - Hermann Hesse

• Measure what Matters - John Doerr

• I am That: Talks with Sri Nisargadatta Maharaj

• The Precipice - Tony Orb

• Eleanor Oliphant is Completely Fine - Gail Honeyman

Learning about LLMs and Generative ML

• Courses/Lectures:

  • Neural Networks: Zero to Hero - Karpathy Youtube

  • LLM Bootcamp (Spring 2023) - Full Stack Deep Learning Youtube

  • Foundation Models - Samuel Albanie Youtube

  • Stanford's' CS25: Transformers United V3 - Home Page, Youtube 

  • Large Language Models and Transformers (2023) - Simon Institute Homepage Youtube

  • Introduction to Diffusion and Score-Based Generative Models - Yang Song,  Jascha Sohl-Dickstein

  • Tutorial Diffusion Model CVPR 2022 - Karsten Kreis, Ruiqi Gao, Arash Vahdat Youtube

  • AI Alignment: Why It's Hard, and Where to Start - Eliezer Yudkowsky Youtube

  • Retrieval-based Language Models and Applications - ACL 2023 Tutorial

  • Responsible AI for Generative AI in Practice: Lessons Learned and Open Challenges - ICML 2023 Homepage

• Research Talks

  • Holistic Evaluation of Language Models - Rishi Bommasani Youtube

  • Scaling RLHF - Jan Leike Youtube Youtube

  • The Impact of chatGPT talks (2023) - Yann LeCun Youtube

  • The Impact of chatGPT talks (2023) - Prof. Max Tegmark Youtube

  • Observations on  Generalization - Ilya Sutskever Youtube

  • Catching up on the weird world of LLMs - Simon Williams Youtube

  • AI Succession - Rich Sutton Youtube

  • Possible Impossibilities and Impossible Possibilities - Yejion Choi Youtube

  • Looking Inside Neural Network with Mechanistic Interpretability - Chris Olah Youtube

  • Emergence and reasoning in large language models - Jason Wei Youtube
    
    

• Podcast/Interviews:

  • What does the AI revolution mean for our future? - Mustafa Suleyman & Yuval Noah Harari  Youtube

  • $10 Billion Models, OpenAI, Scaling, & Alignment - Dario Amodei Youtube

  • Inflection AI CEO Mustafa Suleyman on building modern AI, DeepMind origins - TWIS Youtube

  • AI, Computational Creativity, & the Art of Teaching - Lupe Fiasco, Fox Harrell, & Nick Montfort Youtube

  • Building AGI, Alignment, Spies, Microsoft, & Enlightenment - Ilya Sutskever Youtube

  • Sam Altman and Greg Brockman on AI and the Future (Full Audio) - Reid Hoffman Pod Youtube

  • Berkeley EECS Research Symposium BEARS 2023 - Future of Robotics Pieter Abbeel & Joey Gonzalez Youtube

  • Two Paths to Intelligence - Geoffrey Hinton Youtube

• Papers:

  • "Borges and AI" by Léon Bottou et al., Sep 2023 arXiv
    
    

• Blogs:

  • Prompt Engineering, The Transformer Family (2.0), Diffusion Models, Toxicity in Language Models, Self-Supervised Representation Learning - Lilian Weng 

  • Prompt Engineering Series 101, 201, hallucination, Transformer Family - Xavier Amatriain

  • The hot mess theory of AI misalignment: More intelligent agents behave less coherently - Jascha Sohl-Dickstein Blog

  • Emerging Architectures for LLM Applications - Matt Bornstein and Rajko Radovanovic A16z

  • Can LLMs Critique and Iterate on Their Own Outputs? - Eric Jang Blog

  • Annotated Transformer - Sash Rush Blog