Big Technology Podcast - Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel

Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.


---

Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.


Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology


Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

Code Story: Insights from Startup Tech Leaders - The Gene Simmons of Data Protection – Are You Ready For the GenAI Data Frontier?

The Gene Simmons of Data Protection: Protegrity's KISS Method

Today, we are releasing another episode from our series, entitled The Gene Simmons of Data Protection - the KISS Method, brought to you by none other than ProtegrityProtegrity is AI-powered data security for data consumption, offering fine grain data protection solutions, so you can enable your data security, compliance, sharing and analytics.

Episode Title: Are You Ready For the GenAI Data Frontier? Exploring GenAI Security

In this episode, we talk with Anthony Cammarano, CTO & VP of Engineering, as he breaks down and simplifies GenAI for companies struggling in the new frontier. There is a flood of unstructured data pouring into workflows - thanks to GenAI - and traditional security methods aren't prepared to cover this expanded attack surface. The good news is that companies already have what they need to fix this, and it's a simple mindset shift.

Questions

  • What are some of the most common misconceptions or trends about GenAI, as it relates to data protection and privacy, that organizations face today?
  • What are the primary business challenges facing the adoption of GenAI today?
  • How do modern GenAI systems create data security vulnerabilities and what are the potential risks?
  • What is crucial in the implementation of GenAI-security solutions, and how can it accelerate AI adoption?
  • Can you provide examples of how attackers are targeting data during its use and the importance of securing this data?
  • What are some best practices for robust data governance and how can organizations stay ahead in the rapidly evolving GenAI landscape?

Links




Our Sponsors:
* Check out Vanta: https://vanta.com/CODESTORY


Support this podcast at — https://redcircle.com/code-story/donations

Advertising Inquiries: https://redcircle.com/brands

Privacy & Opt-Out: https://redcircle.com/privacy

Code Story: Insights from Startup Tech Leaders - S10 E29: Lucas Lovell, Paddle

Lucas Lovell grew up in Adelaide, Australia, before eventually landing where resides now, in London. He studied law, but he eventually decided that he didn't want to become a lawyer. During his time in law school, he and his crew built an app - and he was hooked on the wild ride that tech is. Prior to London, he spent 4 years in Paris, and indeed loves to travel. He also enjoys skiing, and when asked about snowboarding, he said he tried - but eventually reverted back.

Four and a half years ago, Lucas joined a company solving end to end payments, while being the merchant of record. What was missing from the platform was some function around invoicing - which started him on his journey of product creation.

This is Lucas' creation story at Paddle.

Sponsors

Links



Our Sponsors:
* Check out Vanta: https://vanta.com/CODESTORY


Support this podcast at — https://redcircle.com/code-story/donations

Advertising Inquiries: https://redcircle.com/brands

Privacy & Opt-Out: https://redcircle.com/privacy

Python Bytes - #429 Nitpicking Python

Topics covered in this episode:
Watch on YouTube

About the show

Sponsored by Posit Workbench: pythonbytes.fm/workbench

Connect with the hosts

Join us on YouTube at pythonbytes.fm/live to be part of the audience. Usually Monday at 10am PT. Older video versions available there too.

Finally, if you want an artisanal, hand-crafted digest of every week of the show notes in email form? Add your name and email to our friends of the show list, we'll never share it.

Michael #1: Huly

  • All-in-One Project Management Platform (alternative to Linear, Jira, Slack, Notion, Motion)
  • If you're primarily interested in self-hosting Huly without the intention to modify or contribute to its development, please use huly-selfhost.
  • Manage your tasks efficiently with Huly's bidirectional GitHub synchronization. Use Huly as an advanced front-end for GitHub Issues and GitHub Projects.
  • Connect every element of your workflow to build a dynamic knowledge base.
  • Everything you need for productive team work: Team Planner • Project Management • Virtual Office • Chat • Documents • Inbox
  • Self hosting as a service: elest.io

Brian #2: CVE Foundation formed to take over CVE program from MITRE

  • Back story: CVE, global source of cybersecurity info, was hours from being cut by DHS
    • The 25-year-old CVE program, an essential part of global cybersecurity, is cited in nearly any discussion or response to a computer security issue.
    • CVE was at real risk of closure after its contract was set to expire on April 16.
    • The nonprofit MITRE runs CVE on a contract with the DHS.
    • A letter last Tuesday sent Tuesday by Yosry Barsoum, vice president of MITRE, gave notice of the potential halt to operations.
    • Another possible victim of the current administration.
  • CVE Foundation Launched to Secure the Future of the CVE Program
    • CVE Board members have spent the past year developing a strategy to transition CVE to a dedicated, non-profit foundation. The new CVE Foundation will focus solely on continuing the mission of delivering high-quality vulnerability identification and maintaining the integrity and availability of CVE data for defenders worldwide.
    • Over the coming days, the Foundation will release more information about its structure, transition planning, and opportunities for involvement from the broader community.

Michael #3: drawdb

  • Free and open source, simple, and intuitive database design editor, data-modeler, and SQL generator.
  • Great drag-drop relationship manager
  • Define your DB visually, export as SQL create scripts
  • Or import existing SQL to kickstart the diagramming.

Brian #4: 14 Advanced Python Features

Extras

Michael:

Joke: Python Tariffs

Talk Python To Me - #502: Django Ledger: Accounting with Python

Do you or your company need accounting software? Well, there are plenty of SaaS products out there that you can give your data to. but maybe you also really like Django and would rather have a foundation to build your own accounting system exactly as you need for your company or your product. On this episode, we're diving into Django Ledger, created by Miguel Sanda, which can do just that.

Episode sponsors

Auth0
Talk Python Courses

Miguel Sanda on Twitter: @elarroba
Miguel on Mastodon: @elarroba@fosstodon.org
Miguel on GitHub: github.com

Django Ledger on Github: github.com
Django Ledger Discord: discord.gg

Get Started with Django MongoDB Backend: mongodb.com
Wagtail CMS: wagtail.org
Watch this episode on YouTube: youtube.com
Episode #502 deep-dive: talkpython.fm/502
Episode transcripts: talkpython.fm

--- Stay in touch with us ---
Subscribe to Talk Python on YouTube: youtube.com
Talk Python on Bluesky: @talkpython.fm at bsky.app
Talk Python on Mastodon: talkpython
Michael on Bluesky: @mkennedy.codes at bsky.app
Michael on Mastodon: mkennedy

Big Technology Podcast - Is OpenAI’s o3 Model AGI?, Is AI The New Social Media?, Zuck’s Revealing Testimony

Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover 1) Is OpenAI's o3 model AGI? 2) Maybe it's AGI when you squint 3) Why people are floating the idea that OpenAi is close to AGI 4) Is OpenAI going to declare that GPT-5 is AGI 5) What's in it for companies saying they've achieved AGI first? 6) AI's new memory capabilities add something big to the experience 7) Is AI the new social media? 8) Facebook has moved away from friend sharing 9) Could Google be broken up? 10) Is Google's stake in the open web actually a good thing?

---


Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.


For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/


Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology


Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

The Government Huddle with Brian Chidester - 179: The One with the Metrostar Distinguished Technical Fellow

Hannah Hunt, Distinguished Technical Fellow at MetroStar and former Chief of Product at the Army Software Factory joins the show to share how her government experience is now shaping her impact from the private sector. She also offered candid insights on software factory success metrics, the challenges of scaling innovation within bureaucracy, and how emerging technologies like generative AI can be aligned with mission needs. Finally, we unpacked lessons learned from standing up transformative programs inside the Department of Defense and the importance of storytelling, empathy, and data in delivering value to government customers.

Lex Fridman Podcast - #465 – Robert Rodriguez: Sin City, Desperado, El Mariachi, Alita, and Filmmaking

Robert Rodriguez is a legendary filmmaker and creator of Sin City, El Mariachi, Desperado, Spy Kids, Machete, From Dusk Till Dawn, Alita: Battle Angel, The Faculty, and his newest venture Brass Knuckle Films.
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep465-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.

Transcript:
https://lexfridman.com/robert-rodriguez-transcript

CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact

EPISODE LINKS:
Robert’s X: https://x.com/rodriguez
Robert’s Instagram: https://instagram.com/rodriguez/
Brass Knuckle Films: https://brassknucklefilms.com/
Rebel without a Crew (book): https://amzn.to/3G7gtQJ
Rebel without a Crew (audiobook): https://amzn.to/3Ri5wyc

SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Invideo AI: AI video generator.
Go to https://invideo.io/i/lexpod
Brain.fm: Music for focus.
Go to https://brain.fm/lex
NetSuite: Business management software.
Go to http://netsuite.com/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex

OUTLINE:
(00:00) – Introduction
(10:04) – Explosions and having only one take
(17:39) – Success and failure
(26:28) – Filmmaking on a low budget
(38:41) – El Mariachi
(50:10) – Creativity
(1:12:06) – Limitations
(1:18:22) – Handling criticism
(1:34:32) – Action films
(1:45:53) – Quentin Tarantino
(1:55:52) – Desperado
(1:56:54) – Salma Hayek
(2:01:40) – Danny Trejo
(2:06:55) – Filming in Austin
(2:13:05) – Editing
(2:22:35) – Sound design
(2:27:43) – Deadlines
(2:31:14) – Alita: Battle Angel
(2:39:36) – James Cameron
(2:52:39) – Sin City
(3:06:48) – Manifesting
(3:18:12) – Memories and journaling
(3:27:56) – Mortality

PODCAST LINKS:
– Podcast Website: https://lexfridman.com/podcast
– Apple Podcasts: https://apple.co/2lwqZIr
– Spotify: https://spoti.fi/2nEwCF8
– RSS: https://lexfridman.com/feed/podcast/
– Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4
– Clips Channel: https://www.youtube.com/lexclips