Talk Python To Me - #528: Python apps with LLM building blocks

In this episode, I’m talking with Vincent Warmerdam about treating LLMs as just another API in your Python app, with clear boundaries, small focused endpoints, and good monitoring. We’ll dig into patterns for wrapping these calls, caching and inspecting responses, and deciding where an LLM API actually earns its keep in your architecture.

Episode sponsors

Seer: AI Debugging, Code TALKPYTHON
NordStellar
Talk Python Courses

Vincent on X: @fishnets88
Vincent on Mastodon: @koaning

LLM Building Blocks for Python Co-urse: training.talkpython.fm
Top Talk Python Episodes of 2024: talkpython.fm
LLM Usage - Datasette: llm.datasette.io
DiskCache - Disk Backed Cache (Documentation): grantjenks.com
smartfunc - Turn docstrings into LLM-functions: github.com
Ollama: ollama.com
LM Studio - Local AI: lmstudio.ai
marimo - A Next-Generation Python Notebook: marimo.io
Pydantic: pydantic.dev
Instructor - Complex Schemas & Validation (Python): python.useinstructor.com
Diving into PydanticAI with marimo: youtube.com
Cline - AI Coding Agent: cline.bot
OpenRouter - The Unified Interface For LLMs: openrouter.ai
Leafcloud: leaf.cloud
OpenAI looks for its "Google Chrome" moment with new Atlas web browser: arstechnica.com

Watch this episode on YouTube: youtube.com
Episode #528 deep-dive: talkpython.fm/528
Episode transcripts: talkpython.fm

Theme Song: Developer Rap
🥁 Served in a Flask 🎸: talkpython.fm/flasksong

---== Don't be a stranger ==---
YouTube: youtube.com/@talkpython

Bluesky: @talkpython.fm
Mastodon: @talkpython@fosstodon.org
X.com: @talkpython

Michael on Bluesky: @mkennedy.codes
Michael on Mastodon: @mkennedy@fosstodon.org
Michael on X.com: @mkennedy

What Next | Daily News and Analysis - TBD | If You Give A.I. a Nuke

As the U.S. upgrades and updates its defense and military systems, the question isn’t whether A.I. will be integrated, but where, how much, and how much decision-making are we ceding to the machine?

Guest: Josh Keating, senior correspondent at Vox and a fellow at the Outrider Foundation where he’s reporting on nuclear weapons and AI.


Want more What Next TBD? Subscribe to Slate Plus to access ad-free listening to the whole What Next family and all your favorite Slate podcasts. Subscribe today on Apple Podcasts by clicking “Try Free” at the top of our show page. Sign up now at slate.com/whatnextplus to get access wherever you listen.

Learn more about your ad choices. Visit megaphone.fm/adchoices

Up First from NPR - Your Next Great Listen

Are you searching for your next favorite podcast? With an endless queue of options, it can be hard to choose. That’s where Lauren Gonzales, co-writer of the Pod Club newsletter, can help. The Pod Club newsletter aims to cut through the clutter and help you decipher what’s worth listening to. Sign up for the newsletter here: npr.org/podclub.

Podcasts featured in this episode:



Learn more about sponsor message choices: podcastchoices.com/adchoices

NPR Privacy Policy

It Could Happen Here - CZM Book Club: Pathfinder: Dawn of the Frogs, Part Five

There's nothing left to do but track these cultists to the source.

See omnystudio.com/listener for privacy information.

array(3) { [0]=> string(150) "https://www.omnycontent.com/d/programs/e73c998e-6e60-432f-8610-ae210140c5b1/78d30acb-8463-4c40-a5ae-ae2d0145c9ff/image.jpg?t=1751824393&size=Large" [1]=> string(10) "image/jpeg" [2]=> int(0) }

Global News Podcast - Venezuela stands up to Donald Trump

Venezuela has condemned as a "colonialist threat" President Trump's warning that its airspace should be considered closed. The US does not have the authority to shut another country's airspace and the foreign ministry described his social media post as an illegal and unjustified aggression. Also: the number of people killed as a result of Israel's military offensive in Gaza in the past two years has risen above 70,000 according to the Hamas-run health ministry in the Palestinian territory; rescue operations are continuing in Indonesia after floods and landslides killed more than 300 people in Sumatra; and King Charles leads tributes to the British playwright and Oscar winning screenwriter, Tom Stoppard, who has died at the age of 88.

PBS News Hour - World - News Wrap: Trump declares Venezuela’s airspace ‘closed’ after weeks of escalating tensions

In our news wrap Saturday, Trump declared Venezuela’s airspace to be considered closed despite not having the legal authority to do so, Russia carried out deadly drone and missile attacks overnight in Ukraine, the FAA ordered airlines to update software in a widely used aircraft, and acclaimed British playwright Tom Stoppard died at age 88. PBS News is supported by - https://www.pbs.org/newshour/about/funders. Hosted on Acast. See acast.com/privacy

PBS News Hour - Health - Whooping cough cases remain elevated as vaccination rates drop

As friends and family gather this holiday season, there’s a warning for new parents. The CDC says cases of pertussis, or whooping cough, remain elevated this year. An unvaccinated infant died from the illness in Kentucky this week, while other states across the country are also experiencing a surge of cases. Ali Rogin speaks with pediatric infectious disease specialist Dr. Lorne Walker for more. PBS News is supported by - https://www.pbs.org/newshour/about/funders. Hosted on Acast. See acast.com/privacy

Newshour - Venezuela slams Trump’s airspace warning

Venezuela has condemned President Trump's warning that its airspace should be considered closed. It called it a colonialist threat and an unjustified aggression against the Venezuelan people. Mr Trump's post could lead to travel uncertainty and deter airlines from operating in the area. We hear from the capital Caracas.

Also in the programme: Celebrated British playwright Tom Stoppard has died; and Ukraine's battle against Russia's "shadow fleet"

(Picture: People shop at a market, after U.S. President Donald Trump said on Saturday that the airspace above and around Venezuela would be closed entirely, in Caracas, Venezuela. Credit:Reuters)