Chipstrat (@chipstrat) header
Chipstrat (@chipstrat) profile picture

Semis, infra, optics/networking, physical AI, and more from @austinsemis. If you like Stratechery and SemiAnalysis, you're in the right place

United States
Joined October 2023
Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)Photo by Chipstrat (@chipstrat)
Chipstrat retweeted
If you enjoy our pod, please check out our sponsor @CrusoeAI using the link below. Sign up quick or log in with Google and get $5 in credit! When you claim that $5 in credit, this show keeps going! 🙏 semidoped.com/crusoe-x
🎙️ NEW EPISODE: Why Marvell Wants Lumentum: Vertical Integration in AI Optics With Cignal AI Recorded the morning after the $MRVL $LITE rumor broke. Our thoughts (live with no prep!) Andrew Schmitt and Scott Wilkinson of market research firm Cignal AI join Austin and Vik to break down Marvell's potential acquisition of Lumentum. They explain how Marvell could run the "Broadcom playbook" by bundling DSPs and optics, even at the cost of competing with its own customers. - The driver is vertical integration, not securing laser capacity. Marvell wants to control the supply chain from chips to optics to co-design better products for AI - Marvell's DSP customers would have to compete with a vertically integrated Marvell-Lumentum, a dynamic that has already pushed some players out of coherent - Lumentum's Optical Circuit Switches (OCS) and high-power lasers for CPO and NPO matter as much as its current-gen transceivers - After a 4x expansion of its Indium Phosphide fab, Lumentum can supply Marvell AND keep selling lasers to the open market - A bidding war is possible. Could the leak be intentional, to attract suitors? This episode is presented by @CrusoeAI. Crusoe's Serverless Fine-Tuning trains an open model like Llama, DeepSeek, or GLM on your own data, and you pay per million tokens, not per GPU hour. About $2 buys roughly 5M training tokens on smaller models. Get $5 in credit to start: semidoped.com/crusoe-x Chapters: 0:00 Intro: Marvell & Lumentum 7:38 The Vertical Integration Driver 9:17 The Channel Conflict Problem 14:58 Transceiver Value Chain 17:38 Why Would Lumentum Sell? 21:23 Lumentum's InP Capacity 24:52 The Cost of Waiting 27:00 Manufacturing Scale Is the Moat 31:30 How AI Changed Component Value 33:43 CPO: The Integration Endgame 36:50 The 'Broadcom Playbook' 38:58 Prediction: A Bidding War Get more of Austin and Vik daily, free! Sign up: daily.semidoped.com/ Connect with Vik and Austin: Vik's Paid Substack: viksnewsletter.com Austin's Paid Substack: chipstrat.com @austinsemis @vikramskr @aschmitt @ScottWilkinsonQ
3
6
2,267
Great deep dive into EMIB with $INTC
🎙️ NEW EPISODE: How Intel Took EMIB From Science Fiction to High Volume: Intel Foundry's Ravi Mahajan Ravi Mahajan, a distinguished engineer at Intel Foundry, joins Austin to detail EMIB's 20-year journey from a "science fiction" concept to a high-volume manufacturing reality. - Organic package wire escape density at the die edge improved only about 10% per generation, so EMIB puts fine-pitch silicon in small patches at the die edges and leaves power to the substrate's thick metal - Production required five technologies to converge, including a custom 4-layer silicon process and dies half the thickness of an A4 sheet of paper - HBM was the first driver. Solve the highest-performance memory interconnect and the technology can "waterfall down" to everything else - The advantage over CoWoS is manufacturing scale. Small bridges replace a full-sized silicon interposer and its high cost and poor wafer utilization on large, multi-reticle AI packages - EMIB-T was in the original patent, using TSVs to fix the "torturous" power path around the bridge - EMIB is an Intel Foundry exclusive, and the roadmap includes top-side optics This episode is presented by @CrusoeAI. Crusoe's Serverless Fine-Tuning trains an open model like Llama, DeepSeek, or GLM on your own data, and you pay per million tokens, not per GPU hour. About $2 buys roughly 5M training tokens on smaller models. Get $5 in credit to start: semidoped.com/crusoe-x Chapters: 0:00 Intro: Ravi Mahajan 1:44 Pathfinding & The HIR Roadmap 7:58 The Two Drivers of EMIB 15:15 Decoupling I/O and Power 16:27 The 'Science Fiction' of EMIB 20:36 HBM as the Killer App 25:06 EMIB vs. CoWoS 31:44 Chiplets, UCIe, and Packaging Tiers 34:08 The EMIB Portfolio: T, M, Active 37:01 An Intel Foundry Exclusive 41:21 AI's Role in Packaging 43:26 Future: Top-Side Optics Get more of Austin and Vik daily, free! Sign up: daily.semidoped.com/ Connect with Vik and Austin: Vik's Paid Substack: viksnewsletter.com Austin's Paid Substack: chipstrat.com @austinsemis @vikramskr @Intel_Foundry
3
18
1,695
New article: Right-Sizing Memory My take on Micron's webinar, from despeccing to who captures value in custom HBM newsletter.chipstrat.com/p/r…
1
1
4
1,866
Optics Primer, Part 4: Coherent Optics How amplitude, phase, and polarization carry data hundreds of kilometers, why that costs more than the optics inside a data center, and where coherent-lite fits newsletter.chipstrat.com/p/o…
4
2
31
7,558
Chipstrat retweeted
🎙️ NEW EPISODE: MicroVCSELs vs MicroLEDs, a MicroExplainer Austin and Vik host an explainer on the two competing microemitter technologies for AI interconnects, microLEDs and microVCSELs. They break down Credo's surprising pivot at OCP from its microLED acquisition to a microVCSEL product, and the physics that give microVCSELs better speed and reach. - The new battleground is the 5-50 meter "reach gap," too long for copper limited to ~7 meters and too short for expensive, supply-constrained InP optics - MicroLEDs are limited to ~3-5 Gbps over 5 meters because their broad light spectrum causes chromatic dispersion that smears the signal - Hitting 1 Tbps with microLEDs takes ~300 slow lanes, and coupling hundreds of fibers adds a lot of manufacturing complexity - MicroVCSELs can hit 50 Gbps+ over 50 meters. Stimulated emission gives a narrow beam with less dispersion, for 10x the speed and reach - MicroVCSELs use a mature Gallium Arsenide (GaAs) process on 8-inch wafers, shared with cell phones, for a cost and scale advantage over InP - MicroLEDs' niche is heat. Gallium Nitride (GaN) is highly temperature-insensitive, a candidate for short-reach optics inside a hot server tray This episode is presented by @CrusoeAI. Crusoe's Serverless Fine-Tuning trains an open model like Llama, DeepSeek, or GLM on your own data, and you pay per million tokens, not per GPU hour. About $2 buys roughly 5M training tokens on smaller models. Get $5 in credit to start: semidoped.com/crusoe-x Chapters: 0:00 The Credo Pivot 3:49 The Talk of OCP 8:13 The 5-50 Meter Reach Gap 12:52 How MicroLEDs Work 21:10 MicroLEDs' Parallelism Problem 22:55 How MicroVCSELs Work 26:57 MicroVCSEL Performance Specs 31:51 The Physics of VCSELs 33:35 The Market Chooses MicroVCSELs 35:45 MicroLEDs' Niche: Heat 38:16 Teasing Future Interviews Mentioned in this episode: - PicoJool’s Al Yuen: The Case for GaAs VCSELs in Scale-Up Interconnects (Semi Doped episode): daily.semidoped.com/p/picojo… - A MicroLED Field Trip to Avicena (Vik's Newsletter, paid): viksnewsletter.com/p/a-micro… - MicroLEDs vs. Lasers: The Linewidth Tradeoff (Vik's Newsletter, free): viksnewsletter.com/p/microle… - Understanding Energy Bands in Semiconductors (Vik's Newsletter, free): viksnewsletter.com/p/energy-… Get more of Austin and Vik daily, free! Sign up: daily.semidoped.com/ Connect with Vik and Austin: Vik's Paid Substack: viksnewsletter.com Austin's Paid Substack: chipstrat.com @austinsemis @vikramskr
12
5
37
18,913
Chipstrat retweeted
🎙️ NEW EPISODE: Synopsys Will Take a Royalty on Amazon's Chips and Sell GPT-Synopsys: Ravi Subramanian Ravi joins Austin to discuss why the company is moving to a royalty-based model for its custom "application optimized IP", starting with a billion-dollar deal with Amazon. Ravi also unpacks the OpenAI partnership and AI "agent engineers", and explains why physics-based simulation remains the ground truth. Insights: - Because 1-2 applications drive most of a hyperscaler's revenue, companies like Amazon now want custom "application optimized IP" instead of standards-based IP - The custom model has three parts. There is a license fee, a "customization fee" to prioritize scarce engineers, and for the first time a royalty on the final chip - The royalty model mirrors the Arm-Amazon partnership from a decade ago and fits 12-month design cycles. It also expands Synopsys's role to system-level bring-up - Customers can "hire" an AI agent engineer with a specific skillset, which fits existing budgets and team structures - GPT-Synopsys with OpenAI bundles a specialized LLM, the compute, and forward-deployed engineers - A CFET needs 200x more device equations than a planar FET, so physics-based simulators stay the ground truth This episode is presented by @CrusoeAI. Try Crusoe's managed inference for open models with $5 in free credits: semidoped.com/crusoe Chapters: 0:00 Intro: The Amazon & OpenAI Deals 2:39 Application Optimized IP 6:04 The New Royalty Business Model 12:14 How Standard IP Differentiates 18:20 The Arm-Amazon Analogy 22:00 Synopsys's Role in Test Chips 26:06 The Three Stages of Chip Design 31:27 The 'Agent Engineer' AI Model 36:20 The GPT-Synopsys Partnership 39:27 In AI We Believe, In Physics We Trust Get more of Austin and Vik daily, free! Sign up: daily.semidoped.com/ Connect with Vik and Austin: Vik's Paid Substack: viksnewsletter.com Austin's Paid Substack: chipstrat.com @austinsemis @vikramskr @Synopsys
3
7
4
37
14,366
Chipstrat retweeted
Fun chat! Check it out!
Today's guest is @austinsemis, the writer behind @chipstrat. Austin started his career as an engineer at Intel before moving into startups and independent analysis. Today, he writes about semiconductors, optics, networking, and physical AI, bringing an engineer's perspective to what's happening across the compute stack. We're thrilled to have him join us for a conversation on the state of the chip industry. Give it a listen!
2
7
1,367
Chipstrat retweeted
Aw yeah! @semidoped is now presented by @CrusoeAI 🚀 Love the pod? Support us! Sign up for Crusoe's managed inference at semidoped.com/crusoe and get $5 in free credits. You can even fine-tune your own model with just a few clicks!
🎙️ NEW EPISODE: Every Muse User Gets 2 CPUs and 8GB in Meta's Cloud. Your Phone Already Has That! Meta gives every Muse user a cloud VM. That gets expensive at a billion users; meanwhile, your phone is sitting idle. - Model labs earn on cloud inference. Meta's ads pay for it. - AI PCs flopped with no use case. Agents give the edge one. - Qualcomm bought Modular so Mojo can run agents on any chip. - Your computer is for your AI to use, not just for you. This episode is presented by @CrusoeAI. Try Crusoe's managed inference for open models with $5 in free credits: semidoped.com/crusoe Chapters: 0:00 Who Makes Local AI Happen? 1:25 Making the Intro with AI 4:43 Qualcomm's Agent Vision 6:54 Why AIPCs Failed 8:45 The Phone as a Portal 13:52 Meta's Incentive for Edge AI 24:05 The End of Apps & UIs? 32:31 The Ideal Personal Agent 34:25 The Edge as a Context Layer 38:17 Qualcomm's Modular Acquisition 43:16 The Ecosystem of You 48:01 Google's Missed Opportunity Get more of Austin and Vik daily, free! Sign up: daily.semidoped.com/ Connect with Vik and Austin: Vik's Paid Substack: viksnewsletter.com Austin's Paid Substack: chipstrat.com @austinsemis @vikramskr
2
2
25
5,057
Chipstrat retweeted
🎙️ NEW EPISODE: Why calls to "pace" AI are a red herring for GPU demand. AI safety work doesn't slow the hardware buildout. The real governor on AI is data center construction pushback. Today's sponsor is G2i — expert training data, evals, and RL environments for AI labs: fandf.co/4wZvKHS Chapters: 0:00 Introduction: Pacing AI 1:36 Recapping Dario Amodei's Essay 7:42 Hot Take: Anthropic vs. OpenAI 11:34 The John Deere Playbook 15:22 The Problem with Interpretability 17:53 Pulling the Plug 19:03 The Real Bottleneck: Data Centers 22:03 The Geopolitical Blind Spot 23:41 Counter-narratives: Meta & Open Source 27:26 The Investment Thesis: Pacing Increases Compute 32:29 The Financial System Analogy 36:05 AI Safety as the New Cybersecurity Get more of Austin and Vik daily, free! Sign up: daily.semidoped.com/ Connect with Vik and Austin: Vik's Paid Substack: viksnewsletter.com Austin's Paid Substack: chipstrat.com @austinsemis @vikramskr
1
2
2
12
7,976
Chipstrat retweeted
AI diffusion needs open competitive frontier models
1
2
9
3,608
Influenced by @jjding99 book, highly recommend
2
778
Here's my "NPO State of the Union" report. We heard a lot of talk about NPO on earnings calls, less about CPO, so I dug in to see what I could find. chipstrat.com/p/npo-state-of…
1
10
6,183
Chipstrat retweeted
As enterprise AI usage grows, so does token usage. AMD’s @MadhuR_PDX explains how intelligent model routing can match requests to the right AI resource to help enterprises optimize growing token costs without compromising output quality. Watch his interview: bit.ly/4bGsXfe
48
7
1
72
32,521