Episodes

search
Latest Episode
AI Safety's Crux: Culture vs. Capitalism

AI Safety's Crux: Culture vs. Capitalism

Episode 58 · · 10:30

SB1047's veto, OpenAI's turnover, and a constant treadmill pushing AI startups to be all too similar to big technology name brands.This is AI generated audio with Python and 11Labs.S...
Interviewing Riley Goodside on the science of prompting

Interviewing Riley Goodside on the science of prompting

Episode 56 · · 01:08:39

More information: https://www.interconnects.ai/p/riley-goodside-on-science-of-promptingRiley Goodside is a staff prompting engineer at Scale AI. Previously working in data science, h...
Llama 3.2 Vision and Molmo: Foundations for the multimodal open-source ecosystem

Llama 3.2 Vision and Molmo: Foundations for the multimodal open-source ecosystem

Episode 57 · · 14:04

Sorry this one was late! Thanks for bearing with me, and keep sending feedback my way. Still a year or two away from when I have time to record these, but I would love to.Open-source...
Reverse engineering OpenAI's o1

Reverse engineering OpenAI's o1

Episode 55 · · 18:52

What productionizing test-time compute shows us about the future of AI. Exploration has landed in language model training.This is AI generated audio with Python and 11Labs.Source cod...
Futures of the data foundry business model

Futures of the data foundry business model

Episode 54 · · 11:32

Scale AI's future versus further scaling of language model performance. How Nvidia may take all the margins from the data market, too.This is AI generated audio with Python and 11Lab...
A post-training approach to AI regulation with Model Specs

A post-training approach to AI regulation with Model Specs

Episode 53 · · 05:39

And why the concept of mandating "model spec's" could be a good start.(Oops, forgot to upload this yesterday!)This is AI generated audio with Python and 11Labs.Source code: https://g...
OpenAI's Strawberry, LM self-talk, inference scaling laws, and spending more on inference

OpenAI's Strawberry, LM self-talk, inference scaling laws, and spending more on inference

Episode 52 · · 10:40

Whether or not scaling works, we should spend more on inference.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interconnects-toolsOrigi...
OLMoE and the hidden simplicity in training better foundation models

OLMoE and the hidden simplicity in training better foundation models

Episode 51 · · 10:31

Ai2 released OLMoE, which is probably our "best" model yet relative to its peers, but not much has changed in the process.This is AI generated audio with Python and 11Labs.Source cod...
On the current definitions of open-source AI and the state of the data commons

On the current definitions of open-source AI and the state of the data commons

Episode 50 · · 08:01

The Open Source Initiative is working towards a definition.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interconnects-toolsOriginal p...
Nous Hermes 3 and exploiting underspecified evaluations

Nous Hermes 3 and exploiting underspecified evaluations

Episode 49 · · 08:32

The latest model from one of the most popular fine-tuning labs makes us question how a model should be identified as a "frontier model."This is AI generated audio with Python and 11L...
Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents

Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents

Episode 47 · · 01:02:22

I had the pleasure of Talking with Ross Taylor (https://x.com/rosstaylor90), who has a great spectrum of unique experiences in the language modeling space — evaluation experience, Ga...
A recipe for frontier model post-training

A recipe for frontier model post-training

Episode 48 · · 10:24

Apple, Meta, and Nvidia all agree -- synthetic data, iterative training, human preference labels, and lots of filtering.This is AI generated audio with Python and 11Labs.Source code:...
Interviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI education

Interviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI education

Episode 46 · · 01:03:42

This week, I had the pleasure of chatting with Sebastian Raschka. Sebastian is doing a ton of work on the open language model ecosystem and AI research broadly. He’s been writing the...
GPT-4o-mini changed ChatBotArena

GPT-4o-mini changed ChatBotArena

Episode 45 · · 07:55

And how to understand Llama three point one's results.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interconnects-toolsOriginal post: ...
Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem

Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem

Episode 44 · · 15:22

Defining the future of the AI economy and regulation. Is Meta's AI play equivalent to the Unix stack for open-source software?This is AI generated audio with Python and 11Labs.Source...
SB 1047, AI regulation, and unlikely allies for open models

SB 1047, AI regulation, and unlikely allies for open models

Episode 43 · · 14:20

SB 1047, AI regulation, and unlikely allies for open modelsThe rallying of the open-source community against CA SB 1047 can represent a turning point for AI regulation.This is AI gen...
Switched to Claude 3.5

Switched to Claude 3.5

Episode 42 · · 06:40

I Switched to Claude 3.5Speculations on the role of RLHF and why I love the model for people who pay attention.This is AI generated audio with Python and 11Labs.Source code: https://...
Interviewing Dean Ball on AI policy

Interviewing Dean Ball on AI policy

Episode 41 · · 56:31

I’m really excited to resume the Interconnects Interviews with Dean W. Ball from the Hyperdimensional Substack. We cover the whole stack of recent happenings in AI policy, focusing o...
RLHF Roundup: Trying to get good at PPO, charting RLHF's impact, RewardBench retrospective, and a reward model competition

RLHF Roundup: Trying to get good at PPO, charting RLHF's impact, RewardBench retrospective, and a reward model competition

Episode 40 · · 11:52

Things to be aware of if you work on language model fine-tuning.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interconnects-toolsOrigi...
Frontiers in synthetic data

Frontiers in synthetic data

Episode 39 · · 11:27

Synthetic data is known to be a super powerful tool for every level of the language modeling stack. It's documented as being used for expanding vanilla pretraining data and creating ...