The Stack Overflow Podcast - Are long context windows the end of RAG?

DBRX, an open, general-purpose LLM created by Databricks, reportedly outperforms GPT-3.5 and is competitive with Gemini 1.0 Pro.

Recent research found that large, complex LLMs use a simple mechanism to retrieve stored knowledge in response to a user prompt. These mechanisms can help researchers reveal what the model knows and potentially even correct false information it has stored.

FTX co-founder Sam Bankman-Fried, whose downfall began in late 2022, was sentenced last week to 25 years in prison for conspiracy and fraud. 

Find Michael on LinkedIn.

Find Cassidy on her website.

Stack Overflow user Bucket received a well-deserved Lifeboat badge for rescuing How to calculate decimal(x, y) max value in SQL Server from an ocean of ignorance.

Chapters (please note that these timestamps may not be exact): 

00:00 Introduction and White Paper Discussion

02:01 Long Context Windows and Retrieval Augmented Generation

05:56 Models' Ability to Recall Relevant Information

07:18 Models' Creativity and Thinking Outside the Box

09:41 Advantages and Limitations of Models' Knowledge

15:09 Databricks' Open Language Model

22:25 Sam Bankman-Fried’s Sentence and the Effects on Crypto/Blockchain

31:28 Closing Remarks and Lifeboat Badge

Read Me a Poem - “The Limits of Love” by Yahia Lababidi

Amanda Holmes reads Yahia Lababidi’s “The Limits of Love.” Have a suggestion for a poem by a (dead) writer? Email us: podcast@theamericanscholar.org. If we select your entry, you’ll win a copy of a poetry collection edited by David Lehman.

 

This episode was produced by Stephanie Bastek and features the song “Canvasback” by Chad Crouch.



Hosted on Acast. See acast.com/privacy for more information.

It Could Happen Here - Against the War, For the Union: The Story of Shift Change

Mia talks with John, Jehad, and Rosa, candidates of Shift Change’s slate for National Nurses United's Council of Presidents about healthcare work, Palestine solidarity organizing, and what brought them together to challenge their union’s leadership

https://www.shiftchangennu.org/

Council of Presidents statement on interview:

https://www.facebook.com/100090872020765/posts/pfbid027wzeDxjTLVmZ6Y17nzSm5FN9oHohZ1FcAYCSK1jN8Z4JB4WwndVHAERsk3utjQuPl/

See omnystudio.com/listener for privacy information.

array(3) { [0]=> string(150) "https://www.omnycontent.com/d/programs/e73c998e-6e60-432f-8610-ae210140c5b1/78d30acb-8463-4c40-a5ae-ae2d0145c9ff/image.jpg?t=1749835422&size=Large" [1]=> string(10) "image/jpeg" [2]=> int(0) }

The Gist - Real Rolexes, Fake Story

CNN's Jim Sciutto comes by to discuss his new book, The Return of Great Powers: Russia, China, and the Next World War. Plus, the Women's NCAA tournament draws the wrong court, and an April Fools game asks you to spot the fake Rolex.


Produced by Joel Patterson and Corey Wara

Email us at thegist@mikepesca.com

To advertise on the show, visit: https://advertisecast.com/TheGist

Subscribe to The Gist Subscribe: https://subscribe.mikepesca.com/

Follow Mikes Substack at: Pesca Profundities | MikePesca | Substack

Learn more about your ad choices. Visit podcastchoices.com/adchoices

Consider This from NPR - What Happens When A Powerful Corporation Owns The Local News?

When news outlets shut down in a city, that creates what's often called a news desert. But in Richmond, California, NPR's media correspondent David Folkenflik says the situation is more like a news mirage.

Energy giant Chevron is the biggest employer - and the biggest polluter in the California city. Chevron also owns the local news site. How does that impact the community there?

NPR's Mary Louise Kelly speaks with Folkenflik and Miranda Green, director of investigations for the news site Floodlight - about what happens when a major corporation owns the local news.

For sponsor-free episodes of Consider This, sign up for Consider This+ via Apple Podcasts or at plus.npr.org.

Email us at considerthis@npr.org.

Learn more about sponsor message choices: podcastchoices.com/adchoices

NPR Privacy Policy

CoinDesk Podcast Network - COINDESK DAILY: Degen Chain Racks up Millions in Volumes; Latest in Custodia Bank’s Legal Battle Against the Fed

Host Jennifer Sanasie breaks down the latest news in the crypto industry from the surging volumes on the Degen Chain to the legal battle between Custodia Bank and the Fed.

To get the show every day, follow the podcast here.

"CoinDesk Daily" host Jennifer Sanasie breaks down the biggest headlines impacting the crypto industry today, as meme coins flourish on Degen Chain, a new layer-3 blockchain built on top of Base. Plus, Roman Storm's legal team filed a motion to dismiss the criminal indictment against the Tornado Cash developer. And, a federal judge has rejected Custodia Bank's argument that it is entitled to a Federal Reserve master account.

-

Consensus is where experts convene to talk about the ideas shaping our digital future. Join developers, investors, founders, brands, policymakers and more in Austin, Texas from May 29-31. The tenth annual Consensus is curated by CoinDesk to feature the industry’s most sought-after speakers, unparalleled networking opportunities and unforgettable experiences. Register now at consensus.coindesk.com.

-

This episode was hosted by Jennifer Sanasie. “First Mover” is produced by Jennifer Sanasie and Melissa Montañez and edited by Victor Chen.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

State of the World from NPR - Israelis Return to a City that was Attacked

Sderot, Israel, near the border with Gaza, was the biggest city attack by Hamas on October 7th. At the beginning of the war, Israel evacuated nearly everyone. Our correspondent visits Sderot and finds that people are returning.

For more coverage of all sides of this conflict, go to npr.org/mideastupdates

Learn more about sponsor message choices: podcastchoices.com/adchoices

NPR Privacy Policy

The Indicator from Planet Money - Can breaking the law be good for business?

Does breaking the law ... make financial sense? Paying future fines and settlements at the risk of harm to people and the environment? Some legal scholars argue that's just the cost of doing business.Today, we ask whether a company's duty is to the law ... or to its shareholders.

Learn more about sponsor message choices: podcastchoices.com/adchoices

NPR Privacy Policy

Motley Fool Money - Top Stocks to Buy Right Now (April 1 Edition)

With the market hitting new highs, which stocks can go the distance?


(00:21) Jason Moser and Deidre Woollard discuss:

- Another big stumble for AT&T.

- Why 3M’s spin-off might be worth watching.

- What’s driving gold prices.


(17:01) Asit Sharma and Ricky Mulvey discuss stocks that can beef up your portfolio, in a special April 1st themed conversation.


Companies discussed: T, SOLV, MMM, UPS, PATH, AMD


Host: Deidre Woollard

Guests: Jason Moser, Ricky Mulvey, Asit Sharma, Erin Karney

Producer: Ricky Mulvey

Engineer: Dan Boyd

Learn more about your ad choices. Visit megaphone.fm/adchoices