Software Huddle

• Lessons from Transcribing and Indexing 3.5 Million Podcasts with Arvid Kahl

  Big time guest today as Arvid Kahl joins us. Arvid is my favorite type of guest -- a deeply technical founder that can talk about both the technical and business challenges of a startup. Lots to enjoy from this episode. Arvid is known as the Bootstrapped Founder and has documented his path to selling Feedback Panda back in 2019. He's now building Podscan and sharing his journey as he goes. Podscan is a fascinating project. It's making the content of *every* podcast episode around the world fully searchable. He currently has 3.5 million episodes transcribed and adds another 30,000 - 50,000 episodes every day. This involves a ton of technical challenges, including how to get the best transcription results from the latest LLMs, whether you should use APIs from public providers or run your own LLMs, and how to efficiently provide full-text search across terabytes of transcription data. Arvid shares the lessons he's learned and the various strategies he's tried over the years. But there are also unique business challenges. For most technical businesses, your infrastructure costs grow in line with your customers. More customers == more data == more servers. With Podscan, Arvid has to index the entire podcast ecosystem regardless of his customers. This means a lot of upfront investment as he looks to grow his customer base. Arvid tells us how he's optimized his infrastructure to account for this unique challenge.

  --------  

  1:18:00

  --------

  1:18:00
• It's time to build Jarvis with Kent C. Dodds

  Today we have the excellent Kent C. Dodds on the program. Kent is an amazing teacher in the web development space, and I've learned a ton from him about React, JavaScript testing, and general web dev. Lately, Kent has been going all-in on AI, especially with the model context protocol (MCP) space. He's sharing a ton of useful material in this area as he works on a new course. We spent a lot of time going over what MCP is, why it's useful, and why Kent thinks our own personal Jarvis is the next step. We cover a bunch of other topics too, like what it's like putting on a conference (Epic Web Conf) plus how AI has changed the educational space. Check it out! *Timestamps* 01:12 Start 06:52 The pitch for MCP 14:30 Where does MCP architecturally sit? 17:27 Contrasting with REST 23:07 Should I be building these now? 23:47 Are there any frameworks? 26:31 Why Cloudflare 34:10 MCP Spec 35:35 Authentication 38:29 A2A by Google 41:50 What caught Kent's attention? 44:28 What got Kent interested in React? 46:16 Jarvis 47:44 Frontend Development in the long run 51:44 What needs to get better for this to happen? 57:42 How has AI impacted education landscape? 01:04:46 Like the travel? 01:12:35 App Stack 01:13:48 React Server Components Follow Kent: https://twitter.com/kentcdodds Follow Alex: https://twitter.com/alexbdebrie Follow Sean: https://twitter.com/seanfalconer *Software Huddle ⤵︎* X: https://twitter.com/SoftwareHuddle

  --------  

  1:21:17

  --------

  1:21:17
• Rewriting in Rust + Being a Learning Machine with AJ Stuyvenberg

  Today's guest is AJ Stuyvenberg, a Staff Engineer at Datadog working on their Serverless observability project. He had a great article recently about how they rewrote their AWS Lambda extension in Rust. It's a really interesting look at a big, hard project, from thinking about when it's a good idea to do a rewrite to talking about their focus on performance and reliability above all else and what he thinks about the Rust ecosystem. Beyond that, AJ is just a learning machine, so I got his thoughts on all kinds of software development topics, from underrated AWS services and our favorite databases to the AWS Free Tier and the annoyances of a new AWS account. Finally, AJ dishes out some career advice for curious, ambitious developers.

  --------  

  1:21:36

  --------

  1:21:36
• Software Reliability Agents with Amal Kiran

  So if you're writing code or keeping systems running, you probably know the drill. Late night pages, chasing down weird bugs, dealing with alert storms. It's tough! It costs money when things break, and honestly, nobody loves that experience. So the big question is, can we actually use something like AI, AI agents in particular, to make reliability less painful, more systematic? That's what we're talking about today. We have on the show with us Amal Kiran, the CEO and Co-founder of Temperstack. They're building tools aimed at automating SRE tasks, think, automatically finding monitoring gaps, alerts, helping with root cause analysis, even generating Runbooks using AI.  So if you wanna hear about applying AI to real world SRE problems and all the tech behind it, we think you're gonna enjoy this.

  --------  

  51:07

  --------

  51:07
• From ORM to Infra: Prisma Postgres with Søren Bramer Schmidt

  Today we have Søren from Prisma on the show. Prisma has been the most popular ORM in the TypeScript world for a while, and now they’re moving more into hosted infrastructure. We spend a lot of time talking about their new offering called Prisma Postgres, which is this unikernel-based Postgres offering. It’s a really unique offering from both a technical and a product perspective. On the technical side, they’re doing some interesting work compared to other Postgres providers. They’re running on bare metal in a colocation facility rather than the default public clouds like AWS, GCP, and Azure. Further, they’re using unikernels in a Firecracker VM, giving them unique startup and security characteristics. These technical decisions give them unique economics compared to standard providers, so they’re able to have a generous free tier and a unique billing model that works great for serverless applications with spiky workloads. Around all of this, it’s very interesting to see a company with such a unique spread of products — a popular, mature open-source library paired with a mission-critical infrastructure service offering. We talked about the difficulties in building a company that accommodates these two very different products. Timestamps 01:51 Start 06:08 Prisma Postgres 09:10 Accelerate 11:39 Why Postgres 17:32 How Prisma Postgres Works 21:32 Colocation Facility 22:05 Unikernels 27:56 CoLo vs Public Cloud 29:11 Building the team 31:46 Missing Features that are being worked on 32:31 Use Cases 33:37 Colo Locations 34:53 Cloudflare 35:42 Biggest surprises since release 37:34 More Unikernel adoption? 39:08 Supporting Prisma ORM 46:43 Mongo 47:51 Life as A CEO 53:04 MCP 57:23 Søren Questions Alex Software Huddle ⤵︎ X: https://twitter.com/SoftwareHuddle Substack: https://softwarehuddle.substack.com

  --------  

  1:02:22

  --------

  1:02:22

Fler podcasts i Teknologi

Trendiga poddar i Teknologi

Om Software Huddle