Lex Fridman Podcast - #306 – Oriol Vinyals: Deep Learning and Artificial General Intelligence

Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:
Shopify: https://shopify.com/lex to get 14-day free trial
Weights & Biases: https://lexfridman.com/wnb
Magic Spoon: https://magicspoon.com/lex and use code LEX to get $5 off
Blinkist: https://blinkist.com/lex and use code LEX to get 25% off premium

EPISODE LINKS:
Oriol’s Twitter: https://twitter.com/oriolvinyalsml
Oriol’s publications: https://scholar.google.com/citations?user=NkzyCvUAAAAJ
DeepMind’s Twitter: https://twitter.com/DeepMind
DeepMind’s Instagram: https://instagram.com/deepmind
DeepMind’s Website: https://deepmind.com
Papers:
1. Gato: https://deepmind.com/publications/a-generalist-agent
2. Flamingo: https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model
3. Language Models are Few-Shot Learners: https://arxiv.org/abs/2005.14165
4. Emergent Abilities of Large Language Models: https://arxiv.org/abs/2206.07682
5. Attention Is All You Need: https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:18) – AI
(20:14) – Weights
(26:33) – Gato
(1:01:22) – Meta learning
(1:15:21) – Neural networks
(1:37:46) – Emergence
(1:44:30) – AI sentience
(2:08:27) – AGI

Stuff They Don't Want You To Know - CLASSIC: Cannibalism: Fact and Fiction

Cannibalism is an ancient taboo, but how often has it actually occurred? Join the guys in this classic episode as they explore the grisly rumors and frightening facts behind history’s stories of cannibalism.

They don't want you to read our book.: https://static.macmillan.com/static/fib/stuff-you-should-read/

See omnystudio.com/listener for privacy information.

array(3) { [0]=> string(150) "https://www.omnycontent.com/d/programs/e73c998e-6e60-432f-8610-ae210140c5b1/2e824128-fbd5-4c9e-9a57-ae2f0056b0c4/image.jpg?t=1749831085&size=Large" [1]=> string(10) "image/jpeg" [2]=> int(0) }

Headlines From The Times - What do Gillian Anderson and Eleanor Roosevelt have in common?

It’s Emmy season, so we’ve got another episode of the “Envelope” for you. This time, it’s an in-depth conversation with Gillian Anderson, who plays Eleanor Roosevelt in “The First Lady.” Anderson talks about how Eleanor Roosevelt was the brains behind the FDR presidency, the focus on Roosevelt’s loving relationship with journalist Lorena Hickok in “The First Lady,” and why it took her some time to click with “Sex Education.” Taking on a historical figure isn’t new for Anderson — who also plays Margaret Thatcher in “The Crown” and Catherine’s mother, Joanna, in “The Great.” Nor is portraying a character who stays in her lane, which wasn’t a stretch from Anderson’s own personality. Follow the "Envelope" wherever you listen to podcasts.  Read the full transcript here.

The Intelligence from The Economist - Two to make a quarrel: the battle to be Britain’s PM

The campaigning is a bit nasty, by British standards, as Liz Truss and Rishi Sunak vie to become Conservative Party leader and thus prime minister. What will the mud-slinging do for the party’s image? We examine a potentially simple solution to address the Catholic Church’s problem with child abuse. And why prices are skyrocketing at posh hotels. 

For full access to print, digital and audio editions of The Economist, subscribe here www.economist.com/intelligenceoffer

Code Story: Insights from Startup Tech Leaders - S6 E28: Tyson Kunosvsky, Autocloud

Tyson Kunosvsky was born in South Africa, and travelled a lot as a kid. When he was a kid, he was majorly influenced by his parents, who ran the Gottman Institute. It was his parents job to take the content that the Gottmans created, and deliver their research to the world, and Tyson helped them do that by building the first version of their learning management system. Outside of tech, he loves to ride motorcycles and do rock climbing.

In 2015, Tyson started a company who focused on migrating enterprise workloads to the cloud. After being acquired, he realized they kept doing the same thing over and over again at the larger company. At 18,000 feet in the air while climbing a mountain, he made the decision to quit his job and build a solution to help people go to cloud.

This is the creation story of Autocloud.

Sponsors

Links




Our Sponsors:
* Check out Vanta: https://vanta.com/CODESTORY


Support this podcast at — https://redcircle.com/code-story/donations

Advertising Inquiries: https://redcircle.com/brands

Privacy & Opt-Out: https://redcircle.com/privacy

The Goods from the Woods - Episode #339 – “1994” with Brandie Posey, Kyle Clark, & Seth Pomeroy (Part 2)

In this episode, comedians Rivers Langley, Brandie Posey, Kyle Clark, and Seth Pomeroy continue their full review of the crazy year that was 1994. Sit back, relax, and reminisce about the year that everyone went to the barber to get "The Rachel", thicc boys like Blues Traveler's John Popper and Notorious B.I.G. reigned supreme, and life was, indeed, like a box of chocolates. This episode was too much fun to record and we hope y'all dig it.  This episode covers July through December of 1994. Part one is available in the archives. Follow Brandie on Twitter @Brandazzle and listen to her podcast "Lady to Lady". Follow Kyle on Twitter and stuff @KyleClarkIsRad and listen to his podcast "This is Rad!". Follow Seth on Twitter @SethPomeroy and watch his movie 'Couldn't You Wait? The Story of Silkworm'.  Follow the show on Twitter @TheGoodsPod.  Rivers is @RiversLangley  Sam is @SlamHarter  Carter is @Carter_Glascock Subscribe on Patreon for HOURS of bonus content and growing ALL THE TIME!  http://patreon.com/TheGoodsPod Pick up a Goods from the Woods t-shirt at:  http://prowrestlingtees.com/TheGoodsPod

The Best One Yet - 🎀 “The secret sauce to Pink Sauce” — Pink Sauce’s growth hack. Marvel’s superhero ROI. Weber’s broken grill.

Pink Sauce has gone viral, but its growth hack was not explaining what it is. At Comic-Con, Disney revealed 2 more phases of its Marvel Cinematic Universe — we think it’s one of the greatest acquisitions of all time. And summer is peak-season for lighting up Weber Grills, yet Weber stock just plummeted 16%. $DIS $WEBR $KHC $SPY Follow The Best One Yet on Instagram, Twitter, and Tiktok: @tboypod And now watch us on Youtube Want a Shoutout on the pod? Fill out this form Got the Best Fact Yet? We got a form for that too Learn more about your ad choices. Visit podcastchoices.com/adchoices See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.