AI in 2025: Agents & The Rise of Evaluation-Driven Development

This week, we're sharing a special episode courtesy of 'Dev Interrupted.' Our co-host, Galileo CEO Vikram Chatterji, recently joined theDev Interrupted team for an engaging discussion on AI strategy. We were so impressed by the conversation that we wanted to share it with our audience, and they were kind enough to let us. We hope you enjoy it! Chain of Thought is hosted by Conor Bronsdon.

This week, we're sharing a special episode courtesy of 'Dev Interrupted.' Our co-host, Galileo CEO Vikram Chatterji, recently joined theDev Interrupted team for an engaging discussion on AI strategy. We were so impressed by the conversation that we wanted to share it with our audience, and they were kind enough to let us. We hope you enjoy it!

From Dev Interrupted:

"Vikram Chatterji joins Dev Interrupted’s Andrew Zigler to discuss how engineering leaders can future-proof their AI strategy and navigate an emerging dilemma: the pressure to adopt AI to stay competitive, while justifying AI spending and avoiding risky investments.

To accomplish this, Vikram emphasizes the importance of establishing clear evaluation frameworks, prioritizing AI use cases based on business needs and understanding your company's unique cultural context when deploying AI."


Chapters:

00:00 Introduction and Special Announcement

01:14 Welcome to Dev Interrupted

01:42 Challenges in AI Adoption

03:16 Balancing Business Needs and AI

06:15 Crawl, Walk, Run Approach

10:52 Building Trust and Prototyping

13:07 AI Agents as Smart Routers

13:50 Galileo's Role in AI Development

16:25 Evaluating AI Systems

25:36 Skills for Engineering Leaders

27:35 Conclusion



Follow Dev Interrupted

Podcast

Substack

LinkedIn


Follow Dev Interrupted Hosts

Andrew

Ben


Connect with Chain of Thought host Conor Bronsdon:

Check out Galileo

⁠⁠⁠⁠Try Galileo⁠⁠

Creators and Guests

Conor Bronsdon
Host
Conor Bronsdon
Creator and Host of the Chain of Thought Podcast | Technical Ecosystem Lead at Modular
AI in 2025: Agents & The Rise of Evaluation-Driven Development
Broadcast by