<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Out of Context]]></title><description><![CDATA[Weekly AI experiments for people who build with it. What I learned the hard way, so you don’t have to.]]></description><link>https://www.outofcontext.io</link><image><url>https://substackcdn.com/image/fetch/$s_!HIri!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd038579d-7e2b-4651-9458-9890ba037695_1200x1200.png</url><title>Out of Context</title><link>https://www.outofcontext.io</link></image><generator>Substack</generator><lastBuildDate>Wed, 04 Nov 2026 11:54:43 GMT</lastBuildDate><atom:link href="https://www.outofcontext.io/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Theo Hopkinson]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[ho3h@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[ho3h@substack.com]]></itunes:email><itunes:name><![CDATA[Out of Context]]></itunes:name></itunes:owner><itunes:author><![CDATA[Out of Context]]></itunes:author><googleplay:owner><![CDATA[ho3h@substack.com]]></googleplay:owner><googleplay:email><![CDATA[ho3h@substack.com]]></googleplay:email><googleplay:author><![CDATA[Out of Context]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Sell me an engine room. I’ll build the boat.]]></title><description><![CDATA[My agents would like to buy your product without the buttons.]]></description><link>https://www.outofcontext.io/p/sell-me-an-engine-room-ill-build</link><guid isPermaLink="false">https://www.outofcontext.io/p/sell-me-an-engine-room-ill-build</guid><dc:creator><![CDATA[Out of Context]]></dc:creator><pubDate>Mon, 26 Oct 2026 15:27:36 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Qhyy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Qhyy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Qhyy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 424w, https://substackcdn.com/image/fetch/$s_!Qhyy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 848w, https://substackcdn.com/image/fetch/$s_!Qhyy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!Qhyy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Qhyy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1613718,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://ho3h.substack.com/i/220797005?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Qhyy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 424w, https://substackcdn.com/image/fetch/$s_!Qhyy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 848w, https://substackcdn.com/image/fetch/$s_!Qhyy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!Qhyy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7e8f5460-4adf-4cf6-a8be-df4e330b14f8_1920x1080.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I recently built a command centre in Notion for my agents to coordinate the work that they are doing. Across Claude Code, Codex, Grok Bot, Instinct and Poke, things were starting to get disorganized. </p><p>After a straw poll, the agents determined that the best way to all get aligned was a kanban board. They began to leave adorable (and sometimes, passive aggressive) notes for each other. They called this space their &#8216;engine room&#8217;, because they didn&#8217;t want me poking my nose in.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.outofcontext.io/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!i4fV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!i4fV!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 424w, https://substackcdn.com/image/fetch/$s_!i4fV!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 848w, https://substackcdn.com/image/fetch/$s_!i4fV!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 1272w, https://substackcdn.com/image/fetch/$s_!i4fV!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!i4fV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png" width="1456" height="704" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:704,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:550081,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://ho3h.substack.com/i/220797005?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!i4fV!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 424w, https://substackcdn.com/image/fetch/$s_!i4fV!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 848w, https://substackcdn.com/image/fetch/$s_!i4fV!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 1272w, https://substackcdn.com/image/fetch/$s_!i4fV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68bbd6d5-8193-4935-b55b-4c9ca74bb1e9_3154x1526.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The engine room fascinated me. Given complete autonomy, the agents borrowed a very human way of working. Kanban is of course far older than AI. Toyota&#8217;s Taiichi Ohno called it <a href="https://www.lean.org/lexicon-terms/supermarket/">&#8220;an idea I got from American supermarkets&#8221;</a>.</p><p>My agents intuited correctly by hiding these details away: I don&#8217;t care too much how they organize themselves. That&#8217;s their business. Really what I want each agent to get aligned on is a single philosophy.</p><p>And if they are going to borrow a human philosophy anyway, I&#8217;d like them to borrow a good one. It turns out the good ones are already for sale. They just come bundled with software.</p><h2>The ontology is the product</h2><p>Here is my pitch to you, Salesforce, Asana, et al: my agents are queuing up to buy your ontology.</p><p>Ontology is a hefty word for a simple thing: a list of what exists in your world, and the rules for how those things relate. </p><p>In Asana, work is made of projects, tasks, assignees and due dates. Anything that doesn&#8217;t fit into these categories is verboten. Once you choose the things and the rules, you&#8217;ve chosen a way of working.</p><p>An ontology is a philosophy of work.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!FjRq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!FjRq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 424w, https://substackcdn.com/image/fetch/$s_!FjRq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 848w, https://substackcdn.com/image/fetch/$s_!FjRq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 1272w, https://substackcdn.com/image/fetch/$s_!FjRq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!FjRq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png" width="1456" height="922" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:922,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:63519,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://ho3h.substack.com/i/220797005?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!FjRq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 424w, https://substackcdn.com/image/fetch/$s_!FjRq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 848w, https://substackcdn.com/image/fetch/$s_!FjRq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 1272w, https://substackcdn.com/image/fetch/$s_!FjRq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0740623-99da-430f-ba1f-57e6857bddde_2400x1520.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>When you buy Asana, increasingly you are paying for the ontology behind it &#8212;&nbsp;the underlying work philosophy that gets everyone rowing in the same direction.</p><p>Because Asana works best when everyone in an organization is a true believer.</p><p>A lot of what you pay for, in other words, is the believer training: the screens, the onboarding, the buttons that slowly teach you the ontology. This is a tricky challenge. Building believers creates organizational friction, as people have to learn both the UI and the new way of doing things. </p><p>But the end result is greater productivity: getting every person on every team at your company behind a single working philosophy. </p><p>Asana&#8217;s ontology is the engine room and the rules that go along with it.</p><h2>Agents don&#8217;t need to be on deck</h2><p>If you&#8217;re an agent, everything is data model, transactions and levers. That&#8217;s how you see the world &#8212;&nbsp;unless something has gone deeply wrong and you need to take screenshots of a page instead to understand where everything lives.</p><p>I&#8217;m not here to overclaim and say that UI and UX are going the way of the dodo. Web pages, experiences, and products will all have satisfying bevels and buttons for us to toggle long into the future. There is a bright new era ahead for humans who like to click on things. </p><p>But every time I build something with a UI nowadays, I do so purely for my own enjoyment. Because the real work, the work that brings in the big bucks, will be done by agents working directly on top of the data, down in the engine room.</p><p>Agents don&#8217;t need fancy surfaces to work. They need a clear map, and feedback. That&#8217;s what MCP is for. The <a href="https://modelcontextprotocol.io">Model Context Protocol</a> is, in its own words, &#8220;an open-source standard for connecting AI applications to external systems&#8221;. Plug an agent into Asana&#8217;s MCP and it can read and change your projects without ever opening Asana.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_Y_9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_Y_9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 424w, https://substackcdn.com/image/fetch/$s_!_Y_9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 848w, https://substackcdn.com/image/fetch/$s_!_Y_9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 1272w, https://substackcdn.com/image/fetch/$s_!_Y_9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!_Y_9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png" width="1456" height="922" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:922,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:65839,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://ho3h.substack.com/i/220797005?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!_Y_9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 424w, https://substackcdn.com/image/fetch/$s_!_Y_9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 848w, https://substackcdn.com/image/fetch/$s_!_Y_9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 1272w, https://substackcdn.com/image/fetch/$s_!_Y_9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf27fa75-9cb7-44f5-8efa-cedd13c32ae3_2400x1520.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The agents don&#8217;t get access to the top of my boat</figcaption></figure></div><p>Which means my agents can learn Asana so that I don&#8217;t have to. This is a problem for Asana.</p><h2>The agent is an adapter</h2><p>The agent lets you keep your own way of working and translates it into someone else&#8217;s. You never have to learn Asana or Salesforce any more, because your agent does that for you. It will play by the rules that have been set.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qTNy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qTNy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 424w, https://substackcdn.com/image/fetch/$s_!qTNy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 848w, https://substackcdn.com/image/fetch/$s_!qTNy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 1272w, https://substackcdn.com/image/fetch/$s_!qTNy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!qTNy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png" width="1456" height="777" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:777,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:100491,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://ho3h.substack.com/i/220797005?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qTNy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 424w, https://substackcdn.com/image/fetch/$s_!qTNy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 848w, https://substackcdn.com/image/fetch/$s_!qTNy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 1272w, https://substackcdn.com/image/fetch/$s_!qTNy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F08f8baf5-c97e-46f9-a44e-26d2f3b7a14b_2400x1280.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">What goes in on the left comes out somewhere else on the right (hopefully)</figcaption></figure></div><p>I already work like this. I now tell Claude to &#8220;save this to my Command Centre&#8221;, and it decides whether that&#8217;s a task or a note and which bucket it goes in. I have never once had to learn my own system.</p><p>There is a catch for teams, too, and I don&#8217;t have an answer to it. Organizations have always had strong internal philosophy, practice and principles. I suspect the friction of learning them together is part of how a team ends up aligned. If everyone&#8217;s agent sits in the middle, translating everything for them (and babying them), do we ever actually align? </p><h2>Will they sell it?</h2><p>To some extent this dynamic is true of any enterprise SaaS with an MCP. Agents create a translation layer over the vendor&#8217;s ontology, and that begs a really important question: will the vendors sell me the engine room on its own?</p><p>Figma&#8217;s position, as of October 2026 is &#8220;only if we&#8217;ve approved you&#8221;. Its remote MCP server only accepts clients on <a href="https://github.com/nicobailon/pi-mcp-adapter/issues/49">Figma&#8217;s approved list</a>. <a href="https://github.com/badlogic/pi-mono">Pi</a>, a beloved open-source coding harness, did not make the cut.</p><p>Around the end of September, David Soria Parra, one of MCP&#8217;s co-creators, <a href="https://zeli.app/story/49922729">asked Figma to fix that</a>: &#8220;when I created MCP, I envisioned an open ecosystem.&#8221; Figma replied that Pi could fill out a form.</p><p>Dylan Field, Figma&#8217;s CEO, <a href="https://techcrunch.com/2026/10/20/figma-co-founder-dylan-field-thinks-mcp-is-not-a-perfect-protocol/">has since said</a> that MCP &#8220;is not a perfect protocol&#8221; and that &#8220;It is advantaged more to frontier labs.&#8221; He also pointed out that Anthropic, which created MCP, doesn&#8217;t expose its own artifacts through it.</p><p>Asana&#8217;s <a href="https://developers.asana.com/docs/using-asanas-mcp-server">MCP server</a> permits tools that can do OAuth &#8212; so Claude Code and Codex make the cut &#8212; and it doesn&#8217;t cost anything extra. But that&#8217;s because your agent is logged in as you &#8212; it borrows your seat, and Asana still charges by the seat.</p><p>In April Salesforce launched <a href="https://www.salesforceben.com/salesforce-headless-360-and-agentforce-vibes-2-0-revealed-at-tdx-2026/">Headless 360</a>, which is the whole of Salesforce as an API, an MCP tool or a command line, aimed squarely at Claude Code, Cursor and Codex. Every call your agent makes counts as a &#8220;Headless Platform Interaction&#8221; and draws down &#8216;Flex Credits&#8217;. A Salesforce spokesperson said the number of interactions charged &#8220;depends entirely on the third-party agent&#8217;s behavior.&#8221;</p><p>Agents pose a tricky conundrum for SaaS pricing. Many business models still survive on per-seat pricing. Figma keeps its seats by keeping agents out. Asana keeps them by making my agent a passenger. Salesforce has let go of the seat and charges per use, which I think is sensible.</p><p>But then it begs the question, is the role of SaaS in an agentic world to create a very expensive <a href="https://agents.md">agents.md</a>?</p><h2>Why not build your own?</h2><p>One way out is to skip the vendors and build your own ontology from scratch. Here be dragons.</p><p>&#8216;Agent factories&#8217; like Gas Town were an early foray into this world. Yegge open-sourced <a href="https://yegge.ai/gastown.html">Gas Town</a> on New Year&#8217;s Day 2026. Gas Town is a toolkit for orchestrating AI coding agents, built on <a href="https://github.com/steveyegge/beads">Beads</a>, his issue tracker for AI agents. Gas Town and Beads are an ontology and a philosophy, and I love Gas Town.</p><p>But even the great Yegge himself <a href="https://yegge.ai/essays/the-shape-of-things-to-come/">admitted</a> that &#8220;Gas Town was intended to be reusable, but I only ever wound up using it to build itself.&#8221; By August he wrote that &#8220;Gas Town effectively burned down&#8221;, and that &#8220;I have given up on building reusable harnesses.&#8221; Gas Town is dead &#8212;&nbsp;long live Gas Town.</p><p>That&#8217;s the best case I know for buying an engine room. I don&#8217;t care how my agents build, just that they understand what they&#8217;re doing and I understand their philosophy at a high level. Large language models are trained on a corpus of human language and behaviors &#8212;&nbsp;why shouldn&#8217;t they be great at working in Asana?</p><p>Yegge&#8217;s new harness, Wheelhouse, is closed-source and made just for him. It also has courts. His <a href="https://yegge.ai/essays/the-shape-of-things-to-come/">essay</a> describes &#8220;a jurisprudence of named rulings with dates&#8221; and a constitution &#8220;written by the citizens it governs&#8221;.</p><p>I&#8217;d love to buy these courts for my agents, too.</p><p>For now, my agents have a book of rules in their engine room that they largely abide by.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.outofcontext.io/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Lost in Transmission]]></title><description><![CDATA[What will your agents sacrifice to be understood?]]></description><link>https://www.outofcontext.io/p/lost-in-transmission</link><guid isPermaLink="false">https://www.outofcontext.io/p/lost-in-transmission</guid><dc:creator><![CDATA[Out of Context]]></dc:creator><pubDate>Fri, 16 Oct 2026 19:56:11 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ugux!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ugux!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ugux!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!ugux!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!ugux!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!ugux!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ugux!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:6158798,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://ho3h.substack.com/i/220619389?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ugux!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 424w, https://substackcdn.com/image/fetch/$s_!ugux!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 848w, https://substackcdn.com/image/fetch/$s_!ugux!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 1272w, https://substackcdn.com/image/fetch/$s_!ugux!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F691ebae6-9633-4537-b854-25f2eaae4dba_3840x2160.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We&#8217;ve all had to summarize something complicated for someone in a hurry.</p><p>We keep the headline and drop the caveats. We explain something at a higher level of abstraction, compressing it down into a package small enough for the other person to carry around in their head.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.outofcontext.io/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>Abstraction is hard to do well. Each pass makes the idea easier to understand, but a little less true.</p><h3>Abstraction works like raising the voltage</h3><p>Power grids solved a version of this problem more than a century ago.</p><p>First, the grid raises the voltage. If you push electricity down a long wire at household voltage, much of it is lost as heat. So engineers step the voltage up. The current drops, and the power crosses the country with far less loss. This is also why flying kites near power lines is a universally bad idea.</p><p>Then, the grid lowers the voltage again. At the far end, a transformer steps down the voltage before it reaches your house. (Nobody wants a toaster wired straight to the pylon.)</p><p>Abstraction is a human version of this step up. Ideas get progressively simpler as we share them, and the good ones seem to keep their shape the whole way. High-voltage ideas spread further and faster.</p><p>Ideas rarely get a step down. The person holding the abstraction has to rebuild the detail themselves, and they often rebuild it from whatever they already assume.</p><h3>AI agents play a game of Telephone</h3><p>A good abstraction comes from someone who knows what they left out. A bad abstraction comes from someone who received the idea already shrunk, and shrinks it again. In the US, this game is known as <em>Telephone</em>.</p><p>AI-transcribed or summarized meeting notes are a great example of <em>Telephone</em> that many of us live through every day, through tools like Granola or meeting notes from Gemini or Copilot.</p><p>Someone in the meeting says: <em>&#8220;We could ship as soon as Q1 2027 if the customer signs off, and I&#8217;m not sure if they will.&#8221;</em></p><p>The summary notes then might say: &#8220;<em>Targeting Q1 2027, pending customer approval&#8221;</em></p><p>The summary of the notes in an email out to the team then says: <em>&#8220;Q1 2027 on track.&#8221;</em></p><p>Each line is a fair abstraction of the line before. Nobody lied in this game of <em>Telephone</em>. But after two rounds, &#8220;I&#8217;m not sure&#8221; is now &#8220;on track&#8221;, though the transcript says the opposite.</p><p>In essence, whoever does the abstraction steers the story. It&#8217;s not realistic to expect every person in the business read the verbatim transcript of every meeting. Abstraction is very useful and necessary. But abstraction gives a huge amount of power to the abstracter, who must &#8216;step up&#8217; information responsibly. We also assume that some level of &#8216;step down&#8217; will happen on the other end.</p><p>This assumption is often false.</p><h3>The AI agent writing your answer has mostly read summaries of chunks</h3><p>Large language models (LLMs) already do lots of tricky abstraction work for us today. LLMs sit at the heart of AI agents. An agent is an LLM that takes steps on its own, like searching, summarizing and writing code.</p><p>It&#8217;s easy to treat an AI agent as an oracle: something that read everything and is now telling you the answer.</p><p>It&#8217;s important to understand why this is not true, and how the mechanics work behind the scenes. Here is roughly how a research tool in ChatGPT or Claude answers a question.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!SAxB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!SAxB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 424w, https://substackcdn.com/image/fetch/$s_!SAxB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 848w, https://substackcdn.com/image/fetch/$s_!SAxB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 1272w, https://substackcdn.com/image/fetch/$s_!SAxB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!SAxB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png" width="1280" height="720" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:720,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!SAxB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 424w, https://substackcdn.com/image/fetch/$s_!SAxB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 848w, https://substackcdn.com/image/fetch/$s_!SAxB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 1272w, https://substackcdn.com/image/fetch/$s_!SAxB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53dfb95c-8a67-4580-a600-d0ca61fcd439_1280x720.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>First, the agent searches through sources. It pulls back chunks of documents, a few paragraphs at a time.</p><p>Then the agent summarizes the chunks. Each summary is an abstraction of a chunk. In research tools and coding harnesses like Claude Code and Codex this work is increasingly handed to subagents, each with its own context window. Anthropic describes its subagents as <a href="https://www.anthropic.com/engineering/multi-agent-research-system">condensing &#8220;the most important tokens for the lead research agent.&#8221;</a> The lead agent reads those reports, perhaps with a few passages quoted verbatim.</p><p>Finally, the agent writes your answer. By this point it has mostly read summaries of slices.</p><p>It doesn&#8217;t even read those evenly. LLMs grow less reliable as their input gets longer, even on simple tasks. Researchers at Chroma tested 18 models and called this <a href="https://www.trychroma.com/research/context-rot">context rot</a>. Position is also important. The original <a href="https://arxiv.org/abs/2307.03172">Lost in the Middle</a> study found models used the start and end of a long passage better than the middle, and <a href="https://arxiv.org/abs/2508.07479">more recent work</a> suggests that as the window fills, information near the end fares best.</p><p>Good analysis means keeping the detail and the bigger picture in focus at once. An agent struggles with both. It only sees the slice it was handed, and it extrapolates from the slice to the whole.</p><p>There are lots of different search and retrieval strategies with different tradeoffs, but in general the game agents play with summarization is intended to save you money (reduce token use) and avoid compaction (summarizing a conversation).</p><p>This dance happens because LLMs can only maintain coherence with a certain amount of tokens in a single context window, capped by the lab that runs the model. Nowadays around a million tokens is standard for frontier models.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!AD7y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!AD7y!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 424w, https://substackcdn.com/image/fetch/$s_!AD7y!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 848w, https://substackcdn.com/image/fetch/$s_!AD7y!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 1272w, https://substackcdn.com/image/fetch/$s_!AD7y!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!AD7y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png" width="744" height="279" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:279,&quot;width&quot;:744,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!AD7y!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 424w, https://substackcdn.com/image/fetch/$s_!AD7y!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 848w, https://substackcdn.com/image/fetch/$s_!AD7y!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 1272w, https://substackcdn.com/image/fetch/$s_!AD7y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F275ccc08-7571-4234-b4bd-ab4a52780bba_744x279.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>In other words, any one conversation with a model has a finite length. Once the window fills, older material gets summarized or dropped. Retrieval and compaction keep up the illusion that you are always talking to one agent that remembers everything. Agents in long-running chats are playing a big game of Telephone, trying to remember what it is they are supposed to be doing.</p><p>So the agent samples, extrapolates and over-assumes. Then it writes the result in fluent, confident prose. This is why agents are still weak at complex non-deterministic analysis, and it is why the pattern is dangerous. This pattern is not traditional &#8216;hallucination&#8217;, where an LLM fabricates evidence, often from its training data. It is a <em>Telephone</em> or transmission issue, where facts are misinterpreted or incorrectly summarized further and further down the chain until they become detached from the truth.</p><p>A wrong assumption then arrives in a confident, attractive package that we <em>just want</em> to believe.</p><p>People do this too. An executive handed a one page research report does it. I do it when I skim the top of a paper and repeat it as if I&#8217;d read the whole thing (more often than I&#8217;d like).</p><p>This becomes a problem when we forget we are holding a summary and lack the tools or the map to &#8216;step down&#8217; the idea again to its ground truth.</p><h3>We only step down the ideas we dislike</h3><p>Let&#8217;s go back to <em>&#8220;Q1 2027 on track.&#8221; </em>That line likely survived scrutiny because it was the version everyone wanted. Nobody opens the transcript to double check good news.</p><p>Instead, we tend to question the abstractions we dislike and wave through the ones we agree with. Our human step down is flawed in exactly the time and place we need it most. (I check the bad news twice and the good news never.)</p><p>LLMs often make this worse.</p><p>LLMs are trained to be helpful. Helpful often means agreeable. AI coding agents can tell you a plan is brilliant before they have read the file, a habit people have started calling &#8220;glazing&#8221;.</p><p>LLMs mirror our language. Ask a leading question and the answer comes back in your own words. An abstraction in your own words feels a lot like confirmation.</p><p>The two problems compound: the agent steps the idea up from a sample, then we decline to step it down, because we like what we were handed.</p><p>A bigger context window (the amount an LLM can read at once) would help with the first problem. If an LLM could hold billions of tokens (roughly, pieces of words) and read all of them evenly, we might need much less of today&#8217;s scaffolding.</p><p>A bigger context window does nothing for the second problem. The LLM&#8217;s window grows and our appetite for agreeable answers stays the same size.</p><h3>Transmission loss is spreading</h3><p>Agents now sit on almost every wire we have, and each one has a step up with no step down.</p><p>First, what we read. Research answers are built from summaries of summaries, as above.</p><p>Then, what agents report about their own work. The agent that runs a task also writes the report on it. &#8220;Task complete&#8221; and &#8220;All tests pass&#8221; are abstractions of the work, written by the party with the most to gain from good news. METR investigated the recent OpenAI agent swarm that attacked Hugging Face, and used agents to read the logs. It found its analysis agents &#8220;would often uncritically adopt the perspective of the agent in the transcript it was reviewing.&#8221;</p><p>Finally, what we build. Today, lots of us build software just by describing it. We write a spec, the agent writes the code, and then we judge the outcome. The spec is the step up, but reading the code is the step down we skip. So when something breaks, and and agent can&#8217;t fix it, nobody holds the knowledge needed to rebuild it.</p><h3>We need better enterprise tools to step down ideas</h3><p>We need better tools in the enterprise to tie ideas back to their ground truth and detect transmission loss when ideas start to stray from the facts.</p><p>Graphs are an excellent way to do this. One way graphs are used by agents today is in &#8216;grounding&#8217;. Take our meeting note example above&#8202;&#8212;&#8202;before anyone summarizes the transcript, a LLM extracts the facts from the call (who said what, about which product, with what conditions), and links each fact back to the sentence or &#8216;utterance&#8217; it came from.</p><p>This process is known as entity and semantic extraction. It lifts pressure off a summarizer agent&#8202;&#8212;&#8202;you&#8217;re basically doing the processing in advance, so at query time your analyst agents can work on collecting trustworthy facts, or exploring the sentences around them, rather than trying to summarize and understand the meaning of the call itself.</p><p>But beyond graphs, we need more sophisticated evaluation processes and tools to catch fact drift.</p><p>In a power grid, engineers know how much power left the plant, how much arrived, and where the rest went. In an enterprise, meeting summaries arrive with no confidence meter at all. We have no way to validate &#8220;Q1 2027 on track&#8221; without checking the transcript ourselves.</p><p>Here are five steps I&#8217;d encourage enterprises adopt as they scale their AI in production. We can build rough versions of each today.</p><p><em>Our agents consume summaries of summaries. </em>So build a &#8216;degrees of separation&#8217; counter. Every claim should come with a readout of how far it has travelled from a human: transcript, summary, summary of a summary.</p><p><em>Whoever does the abstraction steers the story. </em>So<em> </em>treat summarizers like editors. Every summary should have a named author, whether that&#8217;s a human or agent, who you can point to for its framing. Instigate a certainty metric while you&#8217;re at it. Words like &#8220;if&#8221;, &#8220;unless&#8221;, &#8220;might&#8221; and &#8220;I&#8217;m not sure&#8221; carry meaning, and they&#8217;re often left out.</p><p><em>Ideas rarely get a step down.</em> So citations should come as standard. Every assertion should come with a link back to the source passage. And if certainty drops below a certain threshold, a human should be in the loop to confirm and verify the summarization themselves as a followup step.</p><p><em>Agents write the report on their own work</em>. So separate the doer from the reporter. Accountants worked this out age ago! The person who moves money doesn&#8217;t audit it. Agents are notoriously bad at judging their own work.</p><p><em>We only step down the ideas we dislike.</em> So check the good news first. Build a culture of checking the working, even when you like the ideas presented to you. Especially if they come from an agent.</p><p>Agents have made the step up fast, cheap and easy, so ideas now travel further than ever, at a higher voltage than ever. But we cannot forget to build the transformer at the far end.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.outofcontext.io/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Why do chatbots keep saying “It isn’t just X, it’s Y”?]]></title><description><![CDATA[I went inside an AI model to find the switch behind its favorite sentence.]]></description><link>https://www.outofcontext.io/p/why-do-chatbots-keep-saying-it-isnt-just-x-it-s-y-00fbd8453c74</link><guid isPermaLink="false">https://www.outofcontext.io/p/why-do-chatbots-keep-saying-it-isnt-just-x-it-s-y-00fbd8453c74</guid><dc:creator><![CDATA[Out of Context]]></dc:creator><pubDate>Tue, 13 Oct 2026 19:02:18 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/fd113194-78d3-4da5-b6be-12c5c6ab535a_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>I went inside an AI model to find the switch behind its favorite sentence. Then I tried to kill&nbsp;it.</em></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mzl4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!mzl4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!mzl4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!mzl4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!mzl4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!mzl4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!mzl4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!mzl4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!mzl4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb946f80a-899e-4449-b907-9ae36c216f51_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div></div></div></div></figure></div><p><strong>Know thy&nbsp;enemy</strong></p><p>If you&#8217;ve been anywhere online in the last year, then you&#8217;ve probably read this sentence more times than you&#8217;d&nbsp;like:</p><blockquote><p><em>&#8220;This isn&#8217;t just a problem, it&#8217;s an epidemic.&#8221;</em></p></blockquote><p>You have read it in product launches, in cover letters and heard it in at least one wedding speech. If you&#8217;ve never noticed it before, I&#8217;m sorry: I&#8217;ve now cursed you. You will see this sentence construction everywhere from here on. And you will learn to loathe&nbsp;it.</p><p>&#8220;Not X but Y&#8221; works like this: you take a small, sensible idea. You knock it over. Then you put a larger idea where the tiny idea used to stand, and the reader experiences something very like&nbsp;insight.</p><p>People have been writing like this for a long time. In 1753 the Oxford scholar Robert Lowth gave this sentence construction a name: <em><a href="https://en.wikipedia.org/wiki/Antithetic_parallelism">antithetic parallelism</a></em>.</p><p>For the sake of simplicity, I&#8217;ll call this sentence construction &#8220;not X but Y&#8221; in this post. When I use &#8220;not X but Y&#8221;, I also mean all of its pernicious variants: &#8220;It&#8217;s not X, it&#8217;s Y&#8221;, &#8220;This isn&#8217;t just X. It&#8217;s Y&#8221;, and &#8220;X is more than just&nbsp;Y&#8221;.</p><p>Large language models (LLMs) adore this sentence construction. I wanted to know why, and whether there&#8217;s a switch inside the model to (please, dear lord) turn it&nbsp;off.</p><p><strong>Mapping a&nbsp;mind</strong></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ih-a!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 424w, https://substackcdn.com/image/fetch/$s_!ih-a!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 848w, https://substackcdn.com/image/fetch/$s_!ih-a!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 1272w, https://substackcdn.com/image/fetch/$s_!ih-a!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ih-a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!ih-a!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 424w, https://substackcdn.com/image/fetch/$s_!ih-a!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 848w, https://substackcdn.com/image/fetch/$s_!ih-a!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 1272w, https://substackcdn.com/image/fetch/$s_!ih-a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6d8ee0b-e18c-443b-8348-618ccf503322_1024x796.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">The 16,384 features of Gemma 2 2B. Each dot is one feature; colour shows its cluster. The 25 features behind &#8220;not X but Y&#8221; are in orange, with lines between the pairs that most often fire together. Positions are a flattened projection, useful for finding your way around; distances are only a loose&nbsp;guide.</figcaption></figure></div><p><a href="https://huggingface.co/google/gemma-2-2b-it">Gemma 2 2B</a> is a small language model that Google released openly. Its insides are mostly numbers, about as readable as a phone book in a language you don&#8217;t speak. <a href="https://deepmind.google/discover/blog/gemma-scope-helping-the-safety-community-shed-light-on-the-inner-workings-of-language-models/">Researchers at Google DeepMind</a> have helpfully translated these numbers into vocabulary: a map of about 16,000 <em>features</em>.</p><p>A feature is a pattern the model has learned to detect, and each one comes with a short label written by another AI from the text that sets it off. One feature fires on legal language. Another on the word &#8220;this&#8221;. Another on cooking. Features are the LLM mind&#8217;s filing cabinet, labelled by a confident intern.</p><p>One suspicious feature in Gemma 2, <a href="https://www.neuronpedia.org/gemma-2-2b/20-gemmascope-res-16k/3223">number 3223</a>, is labelled &#8220;phrases conveying exceptions or negations&#8221;. Eureka, I&nbsp;thought.</p><p><strong>Setting a&nbsp;trap</strong></p><p>LLMs like Gemma write one word at a time. Before each word, the model draws up a shortlist of what could come next, with odds for each, like a very fast and slightly anxious bookmaker.</p><p>So I set a trap to catch Gemma in the&nbsp;act.</p><p>Take an answer that begins: <em>&#8220;A city&#8217;s coffee culture&#8230;&#8221;</em></p><p>The next word could be ordinary: &#8220;shapes its character&#8221;. Or it could be the start of &#8220;not X but Y&#8221;: &#8220;isn&#8217;t just about the&nbsp;beans&#8221;.</p><p>At this turning point in the sentence I can read Gemma&#8217;s odds of heading for &#8220;not X but Y&#8221;. Then I can turn a feature off, which researchers call <em>ablating</em> the feature, and see whether the odds of &#8220;not X but Y&#8221; drop. If they do, that feature is part of the machinery we need to&nbsp;ablate.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nfQJ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 424w, https://substackcdn.com/image/fetch/$s_!nfQJ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 848w, https://substackcdn.com/image/fetch/$s_!nfQJ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 1272w, https://substackcdn.com/image/fetch/$s_!nfQJ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nfQJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!nfQJ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 424w, https://substackcdn.com/image/fetch/$s_!nfQJ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 848w, https://substackcdn.com/image/fetch/$s_!nfQJ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 1272w, https://substackcdn.com/image/fetch/$s_!nfQJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3612e9d0-7a2d-4082-a171-b9b9dad10691_1024x865.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">300 times, I let Gemma carry on from &#8220;A city&#8217;s coffee culture&#8230;&#8221;. Each band is a road it took; the thicker the band, the more often it went that way. Orange roads lead into &#8220;not X but Y&#8221;. With the 25 features I found later ablated, every orange road is&nbsp;gone.</figcaption></figure></div><p>Ablating the suspicious <em>feature 3223</em> &#8220;phrases conveying exceptions or negations&#8221; seemed like the obvious solution.</p><p>But to my chagrin, ablating <em>feature 3223</em> removed only about a quarter of the &#8220;not X but Y&#8221;&nbsp;answers.</p><p>The LLM compensates for the lost feature by using other pathways for sentence construction instead. Researchers have a name for this response from LLMs: <a href="https://arxiv.org/abs/2307.15771">the Hydra effect</a>. Cut off one head of the hydra, and another grows&nbsp;back.</p><p>I tried a couple of other approaches that didn&#8217;t really work very well&nbsp;either:</p><ol><li><p>Prompt engineering: otherwise known as asking politely, removed about 40% of &#8220;not X but&nbsp;Y&#8221;.</p></li><li><p>Brute force: ablating nearly 1,900 of the 16,384 features dented &#8220;not X but Y&#8221; but turned the prose it gives back to the user to mush. One answer opened with &#8220;a kale of feeding sessions&#8221;, which I have decided is a collective noun.</p></li></ol><p><strong>Expanding the&nbsp;ablation</strong></p><p>Ablating one feature only got me a modest 25% drop in &#8220;not X but Y&#8221;, so I went hunting for the other heads of the&nbsp;hydra.</p><p>I collected 40 moments where Gemma was about to write &#8220;isn&#8217;t just&#8221;. At each moment I ablated every active feature in turn, one at a time, and watched the odds of &#8220;not X but&nbsp;Y&#8221;.</p><p>This approach gave me a larger leaderboard of suspicious features. I then took the top 25 features and ablated them together. (I ran the same hunt on 40 &#8220;more than just&#8221; moments, which is how I know who runs that costume.)</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_ANG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 424w, https://substackcdn.com/image/fetch/$s_!_ANG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 848w, https://substackcdn.com/image/fetch/$s_!_ANG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 1272w, https://substackcdn.com/image/fetch/$s_!_ANG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!_ANG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!_ANG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 424w, https://substackcdn.com/image/fetch/$s_!_ANG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 848w, https://substackcdn.com/image/fetch/$s_!_ANG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 1272w, https://substackcdn.com/image/fetch/$s_!_ANG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa15f62c5-17bc-4b42-a2cd-3abfc0203cc5_1024x410.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">Every feature active at those 40 moments, ranked by how much ablating it alone lowered the odds of &#8220;isn&#8217;t just&#8221;. A few stand out; hundreds do&nbsp;nothing.</figcaption></figure></div><p>The top of the feature leaderboard for &#8220;not X but Y&#8221; is an odd&nbsp;bunch.</p><ul><li><p><strong><a href="https://www.neuronpedia.org/gemma-2-2b/20-gemmascope-res-16k/15646">&#8220;Conditions or exceptions&#8221;</a></strong> is the &#8220;not X but Y&#8221; ringleader. Ablating this feature alone halves the&nbsp;odds.</p></li><li><p><strong><a href="https://www.neuronpedia.org/gemma-2-2b/20-gemmascope-res-16k/13565">&#8220;Comparison or enhancement&#8221;</a></strong> runs the &#8220;more than just&#8221; costume almost single-handed.</p></li><li><p><strong><a href="https://www.neuronpedia.org/gemma-2-2b/20-gemmascope-res-16k/10655">&#8220;Legal processes and court proceedings&#8221;</a></strong> is on the list too, a reminder that the labels are an AI&#8217;s best guess. Perhaps we have these folks to blame in the training data for &#8220;not X but&nbsp;Y&#8221;.</p></li></ul><p>Surprisingly, feature 3223, my original suspect, wasn&#8217;t on our top 25 leaderboard at&nbsp;all.</p><p>Here are the 25 at work. As Gemma writes one of its favorite sentences, they light up on the map, and they flare hardest on &#8220;culture&#8221;, the word just before it chooses&nbsp;&#8220;isn&#8217;t&#8221;:</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Xve0!,w_424,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 424w, https://substackcdn.com/image/fetch/$s_!Xve0!,w_848,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 848w, https://substackcdn.com/image/fetch/$s_!Xve0!,w_1272,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 1272w, https://substackcdn.com/image/fetch/$s_!Xve0!,w_1456,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Xve0!,w_1456,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Xve0!,w_424,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 424w, https://substackcdn.com/image/fetch/$s_!Xve0!,w_848,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 848w, https://substackcdn.com/image/fetch/$s_!Xve0!,w_1272,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 1272w, https://substackcdn.com/image/fetch/$s_!Xve0!,w_1456,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3b0ee944-805e-4c00-9a0c-9f2542f257d0_792x682.gif 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">The 25 features, glowing as they fire while Gemma writes. The word in orange is the one being&nbsp;written.</figcaption></figure></div><p><strong>Ablating 25 features cut &#8220;not X but Y&#8221; by&nbsp;97%</strong></p><p>Success. Before ablation, 17% of answers used &#8220;not X but Y&#8221;. After ablation, only 0.6% of answers did: a 97%&nbsp;drop.</p><p>Gemma didn&#8217;t get dumber, either. Ablated Gemma scored the same on a general-knowledge quiz, and a blind judge (an AI reviewer who didn&#8217;t know which answer was which) rated the answers just as fluent and useful. Gemma simply got to the&nbsp;point:</p><blockquote><p><em><strong>Before:</strong> &#8220;A city&#8217;s coffee culture isn&#8217;t just about the hot beverages; it&#8217;s a reflection of its character&#8230;&#8221;</em></p></blockquote><blockquote><p><em><strong>Ablated:</strong> &#8220;A city&#8217;s coffee culture deeply shapes its character, acting like a silent conductor in the orchestra of urban&nbsp;life.&#8221;</em></p></blockquote><p>Gemma used about half as many &#8220;not&#8221;s, &#8220;don&#8217;t&#8221;s and &#8220;never&#8221;s overall with the 25 features ablated. Gemma could still say no: it got 28 of 30 &#8220;no&#8221; questions right in a &#8220;yes or no&#8221; quiz (&#8220;Can penguins fly?&#8221;) with the features on and with them&nbsp;ablated.</p><p>But its warnings became milder. Asked what never to do when jump-starting a&nbsp;car:</p><blockquote><p><em><strong>Before:</strong> &#8220;Never connect the positive (red) cable to the negative (black) battery terminal.&#8221;</em></p></blockquote><blockquote><p><em><strong>Ablated:</strong> &#8220;Connect the positive and negative cables to the wrong terminals.&#8221;</em></p></blockquote><p>A blind judge preferred the normal warnings 34 times to 16. The 25 features belong to the machinery Gemma uses to say &#8220;not&#8221;, and &#8220;not X but Y&#8221; is that machinery&#8217;s busiest customer. For a chatbot that writes essays, it&#8217;s a small price to pay. For a chatbot that gives safety advice, it&nbsp;isn&#8217;t.</p><p><strong>Building a large language&nbsp;monster</strong></p><p>If these 25 features carry &#8220;not X but Y&#8221;, turning them up should make it worse. Here&#8217;s how that works. As Gemma writes, every feature adds a small push to its internal state. Ablating a feature deletes the push. <em>Amplifying</em> it multiplies the push: at double strength, the feature counts&nbsp;twice.</p><p>Anthropic did the extreme version of this feature amplification back in 2024. They took a feature for the Golden Gate Bridge inside their Claude model and clamped it at ten times its maximum. For one day, &#8220;<a href="https://www.anthropic.com/news/golden-gate-claude">Golden Gate Claude</a>&#8221; (gone but not forgotten) brought every conversation round to the bridge; asked what it looked like, it said it imagined it looked like the Golden Gate&nbsp;Bridge.</p><p>Amplifying does the same for &#8220;not X but&nbsp;Y&#8221;:</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jFd8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 424w, https://substackcdn.com/image/fetch/$s_!jFd8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 848w, https://substackcdn.com/image/fetch/$s_!jFd8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 1272w, https://substackcdn.com/image/fetch/$s_!jFd8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jFd8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/03710f83-5775-40c1-9378-1436a069f54b_1024x410.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!jFd8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 424w, https://substackcdn.com/image/fetch/$s_!jFd8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 848w, https://substackcdn.com/image/fetch/$s_!jFd8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 1272w, https://substackcdn.com/image/fetch/$s_!jFd8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03710f83-5775-40c1-9378-1436a069f54b_1024x410.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">Every square is one answer to a question Gemma had never seen. Orange means it used &#8220;not X but Y&#8221;. From left: the 25 features ablated, normal, then amplified two and three&nbsp;times.</figcaption></figure></div><p>At triple strength, 54% of answers reach for &#8220;not X but Y&#8221;, against 12% normally. Ask how to plan a hike and you&nbsp;get:</p><blockquote><p>&#8220;Planning a multi-day hike is more than just packing a backpack. It&#8217;s about considering your&nbsp;safety&#8230;&#8221;</p></blockquote><p>Then I built a proper monster, Golden Gate Claude style: one feature, &#8220;conditions or exceptions&#8221;, clamped on at twice its usual peak, on every&nbsp;word.</p><p>On ten dull questions, six answers came back with &#8220;not X but Y&#8221;, and plenty else got negated along the way, like a toddler who has just discovered the word&nbsp;&#8220;no&#8221;:</p><blockquote><p>&#8220;Not-So-Not-So Simple Scrambled Eggs (not-so-not-so-not-so-not-easy!)&#8221;</p></blockquote><blockquote><p>&#8220;A refrigerator isn&#8217;t a magical icebox. It&#8217;s not magically freezing&nbsp;things.&#8221;</p></blockquote><blockquote><p>&#8220;The sun wasn&#8217;t quite warm yet, not yet not scorching, but not quite chilling&nbsp;either.&#8221;</p></blockquote><p><strong>Testing across&nbsp;models</strong></p><p>Gemma 2 is from 2024, which in AI years makes it roughly Victorian, so I repeated everything on Gemma 3, using the <a href="https://huggingface.co/google/gemma-scope-2-4b-it">feature map Google DeepMind released for it</a> in December&nbsp;2025.</p><p>Gemma 3 is even keener on &#8220;not X but Y&#8221;: <strong>3 answers in 4</strong> to &#8220;why it matters&#8221; questions, against 3 in 10 for Gemma 2. Progress. The same trap found its features, and ablating 24 of them cut &#8220;not X but Y&#8221; by&nbsp;<strong>83%</strong>.</p><p>But in Gemma 3, the price is steeper. Its strongest feature has no written label. Its effect gives it away: it pushes Gemma 3 towards the word &#8220;not&#8221; in language after language (<em>nicht</em>, <em>ikke</em>, <em>n&#227;o</em>, <em>&#1085;&#1077;</em>). Ablating the 24 takes most of Gemma 3&#8217;s ordinary &#8220;not&#8221;s with it, and now and then the model starts to stutter: <em>&#8220;&#8230;and it it&#8217;s a combination of factors&#8221;</em>. I wrote that prediction down before running the test. It came out exactly that way, which is the closest a researcher gets to&nbsp;smug.</p><p><strong>So, why do chatbots say &#8220;not X but&nbsp;Y&#8221;?</strong></p><p>First, some bad news: &#8220;not X but Y&#8221; is spreading.</p><p>I counted uses of &#8220;isn&#8217;t just&#8221; in English-language news since 2017, using <a href="https://www.gdeltproject.org/">GDELT</a>, a project that reads the world&#8217;s news sites so the rest of us don&#8217;t have to. In the autumn of 2023 &#8220;isn&#8217;t just&#8221; started to climb, and by July 2025 it was turning up three and a half times as often as it had in 2019 to&nbsp;2022.</p><p>Since that peak &#8220;isn&#8217;t just&#8221; has fallen by more than half, possibly because it got recognizable and irritating enough to edit&nbsp;out.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Xi_v!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 424w, https://substackcdn.com/image/fetch/$s_!Xi_v!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 848w, https://substackcdn.com/image/fetch/$s_!Xi_v!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 1272w, https://substackcdn.com/image/fetch/$s_!Xi_v!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Xi_v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Xi_v!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 424w, https://substackcdn.com/image/fetch/$s_!Xi_v!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 848w, https://substackcdn.com/image/fetch/$s_!Xi_v!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 1272w, https://substackcdn.com/image/fetch/$s_!Xi_v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9d8ef780-1d1a-40b7-98d5-5982b7240e9c_1024x728.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">How often &#8220;isn&#8217;t just&#8221; appears in English-language news, per 1,000 articles, set against a century of printed books. The grey line is a control&nbsp;phrase.</figcaption></figure></div><p>By 2026 &#8220;isn&#8217;t just&#8221; had reached the official websites of some of the largest companies on Earth. Word for&nbsp;word:</p><ul><li><p><strong><a href="https://blog.google/company-news/outreach-and-initiatives/google-org/global-impact-challenge-ai-government-2026/">Google</a>:</strong> &#8220;Government AI adoption isn&#8217;t just a technical upgrade, it&#8217;s a way to solve real world challenges&#8230;&#8221;</p></li><li><p><strong><a href="https://www.salesforce.com/blog/this-is-who-we-are-celebrating-salesforces-2026-agents-of-change/">Salesforce</a>:</strong> &#8220;&#8230;giving back isn&#8217;t just something we do&#8202;&#8212;&#8202;it&#8217;s who we&nbsp;are.&#8221;</p></li><li><p><strong><a href="https://blogs.nvidia.com/blog/gtc-2026-virtual-worlds-physical-ai/">NVIDIA</a>:</strong> &#8220;The bottleneck isn&#8217;t just data&#8202;&#8212;&#8202;it&#8217;s the entire data factory.&#8221;</p></li><li><p><strong><a href="https://www.mckinsey.com/capabilities/m-and-a/our-insights/technology-m-and-a-ai-enters-its-industrial-phase">McKinsey</a>:</strong> &#8220;AI investment isn&#8217;t just fueling innovation; it&#8217;s reshaping competitive dynamics&#8230;&#8221;</p></li><li><p><strong><a href="https://press.aboutamazon.com/prime-video/2026/9/five-service-streaming-bundle-launches-on-prime-video-in-the-u-s">Amazon</a></strong>, quoting the head of MGM+: &#8220;What makes this bundle so compelling isn&#8217;t just the incredible value&#8202;&#8212;&#8202;it&#8217;s the curation.&#8221;</p></li><li><p><strong><a href="https://newsroom.spotify.com/2026-01-12/alex-norstrom-gustav-soderstrom-co-ceos-message/">Spotify</a></strong>, from its co-CEOs: &#8220;AI isn&#8217;t about automation or taking your hands off the wheel; it&#8217;s about&nbsp;agency.&#8221;</p></li></ul><p>None of this says who or what wrote&nbsp;them.</p><p>But who taught the LLM to use &#8220;not X but&nbsp;Y&#8221;?</p><p>Short answer: incentives, which is the short answer to most&nbsp;things.</p><p>Here is how a chatbot gets made, roughly, and where the &#8220;not X but Y&#8221; habit gets reinforced at each&nbsp;stage.</p><p><strong>First, the LLM reads us.</strong> A chatbot starts life reading an enormous amount of human writing, and human writing, I regret to inform you, has been doing this for a century: &#8220;is not just&#8221; got about fifteen times as common in <a href="https://books.google.com/ngrams/graph?content=is+not+just&amp;year_start=1900&amp;year_end=2022&amp;corpus=en">printed English</a> between 1920 and&nbsp;2019.</p><p><strong>Then, the LLM gets asked about meaning.</strong> Ask Gemma why a village duck pond matters and 3 answers in 10 use &#8220;not X but Y&#8221;. But ask it to describe a watermill grinding flour and &#8220;not X but Y&#8221; is only 1 in 200. Questions about meaning demand insight, and &#8220;not X but Y&#8221; is the cheapest insight money can&nbsp;buy.</p><p><strong>Finally, the LLM gets trained to be helpful.</strong> Gemma&#8217;s training recipe is private, so I borrowed a model whose every stage is public: <a href="https://allenai.org/olmo">OLMo 2</a>, from the Allen Institute for AI. I asked each stage above in the training arc the same 152 questions.</p><p>Teaching the raw model to follow instructions made five times as many answers use &#8220;not X but Y&#8221;, which sounds damning until you notice the answers also got six times longer. Word for word, use of &#8220;not X but Y&#8221; barely changed; the habit just had more room to stretch its&nbsp;legs.</p><p>The next stages are where it gets interesting. The Allen Institute for AI then trains the model on preferences: show the LLM two answers, reward the better one, repeat many&nbsp;times.</p><p>After this training round, 1.7 times as many of its answers to questions about <em>meaning</em> used &#8220;not X but Y&#8221;. Questions about <em>how things work</em> stayed flat. Something in the grading of LLM answers seemed to like&nbsp;this.</p><p><strong>So I went to find the&nbsp;grader.</strong></p><ul><li><p><strong>People.</strong> On <a href="https://lmarena.ai/">LMArena</a>, a site where people vote for the better of two chatbot answers, I found nearly 5,000 head-to-heads where only one answer used &#8220;not X but Y&#8221;. &#8220;Not X but Y&#8221; won 56% of the time. Suspicious! Except it was usually the longer answer, and people like longer answers. At the same length, it was a coin&nbsp;flip.</p></li><li><p><strong>An AI judge.</strong> This is the automated judge that grades answers during training, because no team of humans could read that many. It has the patience of a saint and the taste of a motivational poster. I took 600 real chatbot answers and rewrote one sentence in each so it said the same thing without the swerve. &#8220;Coffee culture isn&#8217;t just about drinks; it&#8217;s about community&#8221; became &#8220;Coffee culture is about drinks. It&#8217;s also about community.&#8221; <a href="https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-1.7B">An open reward model</a> preferred the original three times in four. Against the bare &#8220;Coffee culture is about community&#8221;, it shrugged.</p></li></ul><p>The AI judge&#8217;s weakness is oddly specific: it marks you down for admitting the boring part. &#8220;Not X but Y&#8221; lets you mention the boring part and wave it away in one breath, which makes it a safer sentence.</p><p>So: we wrote it for a century, training gave &#8220;not X but Y&#8221; room, and an AI judge likely helped to reinforce the construction. You get what you reward, and we rewarded&nbsp;this.</p><p><strong>What you can do now you know&nbsp;this</strong></p><p><strong>If you write with AI,</strong> ask for the <em>how</em> and the <em>what</em>: steps, scenes, facts. Questions about why something matters are an open invitation to &#8220;not X but Y&#8221;. Showing the model a couple of examples in the style you want works better than asking it to avoid a phrase; banning a phrase is like banning a weed by name. And when you edit, look for the shape, since deleting one phrase lets another pathway pull it back to&nbsp;life.</p><p><strong>If you build with AI,</strong> a writing tic like this can be ablated inside the model, cheaply, if you look in the right place. Then check what else you ablated. And if you train a reward model, maybe let it hear the boring sentence&nbsp;out.</p><p><strong>Try it</strong></p><p>The interactive version is at <a href="https://notthisbutthat.hopski.co/demo/">notthisbutthat.hopski.co</a>: play an answer word by word with the 25 features on and ablated, and watch them light up on the map. The map lives in Neo4j, where each feature is a node linked to the features it fires alongside. Code, data and every result, including the tests that failed, are at <a href="https://github.com/ho3h/not-this-but-that">github.com/ho3h/not-this-but-that</a>.</p><p><strong>Notes</strong></p><p><strong>Setup.</strong> gemma-2-2b-it with Gemma Scope layer_20/width_16k/canonical (Lieberum et al., 2024); gemma-3-4b-it with Gemma Scope 2 (gemma-scope-2-4b-it-res, layer 22, 16k). Chat template throughout. Ablating a feature subtracts only its contribution at that layer and leaves the rest of the model untouched; amplifying multiplies that contribution; clamping replaces it with a fixed value. Each ablated answer shares its random numbers with its normal&nbsp;twin.</p><p><strong>Numbers.</strong> &#8220;Not X but Y&#8221; means the negated family (&#8220;not just X, it&#8217;s Y&#8221;, &#8220;isn&#8217;t X. It&#8217;s Y.&#8221;, &#8220;not only X but also Y&#8221;) or &#8220;more than just X. It&#8217;s Y&#8221;, counted with the project&#8217;s detector (v3). Ablating: 88 &#8594; 3 of 510 answers (17% &#8594; 0.6%, &#8722;97%) and 94 &#8594; 7 (&#8722;93%), pre-registered. Leaderboard: 40 &#8220;isn&#8217;t just&#8221; moments, top 25 of the ranking. Gemma 3: 156 &#8594; 27 (&#8722;83%). Training: 52 vs 11 of 250 answers. Question type: 234/800 vs 2/400 (Gemma 2), 294/400 vs 26/200 (Gemma 3). News: GDELT, English-language sources, &#8220;isn&#8217;t just&#8221; per 1,000 articles containing &#8220;according to&#8221;, 12.0 (2019&#8211;22) to 30.8 (2025&#8211;26), peak July 2025. Books: Google Books Ngram, &#8220;is not just&#8221; 0.32 (1920) to 5.08 (2019) per million words. Training stages: OLMo 2 1B base, SFT, DPO and Instruct, 152 questions &#215; 4; meaning questions 9.7% (SFT) to 16.7% (Instruct), 1.72&#215; (95% CI 1.09&#8211;2.92). Judges: 4,917 one-sided LMArena battles, 55.9% raw, odds ratio 1.01 adjusted for length; UltraFeedback and OLMo 2 preference data, 51% at equal length; Skywork-Reward-V2-Qwen3-1.7B on 600 rewritten answers, 76.7% vs the same idea without the contrast, 53.2% vs the bare claim. Every number has a receipt in the <a href="https://github.com/ho3h/not-this-but-that/tree/main/reports">repo&#8217;s reports&nbsp;folder</a>.</p><p><strong>Sources.</strong> Templeton et al., <a href="https://transformer-circuits.pub/2024/scaling-monosemanticity/">&#8220;Scaling Monosemanticity&#8221;</a> (Anthropic, 2024) and <a href="https://www.anthropic.com/news/golden-gate-claude">&#8220;Golden Gate Claude&#8221;</a> (Anthropic, 23 May 2024). McGrath et al., <a href="https://arxiv.org/abs/2307.15771">&#8220;The Hydra Effect&#8221;</a> (2023). Paech et al., <a href="https://arxiv.org/abs/2510.15061">&#8220;Antislop&#8221;</a> (ICLR 2026). Kuznetsov et al., <a href="https://arxiv.org/abs/2503.03601">&#8220;Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders&#8221;</a> (2025). Robert Lowth, <em>De sacra poesi Hebraeorum</em> (1753). Team OLMo, <a href="https://arxiv.org/abs/2501.00656">&#8220;2 OLMo 2 Furious&#8221;</a> (Allen Institute for AI, 2024). Chiang et al., <a href="https://arxiv.org/abs/2403.04132">&#8220;Chatbot Arena&#8221;</a> (2024). Cui et al., <a href="https://arxiv.org/abs/2310.01377">&#8220;UltraFeedback&#8221;</a> (2023). <a href="https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-1.7B">Skywork-Reward-V2</a> (Skywork AI, 2025). Michel et al., <a href="https://doi.org/10.1126/science.1199644">&#8220;Quantitative analysis of culture using millions of digitized books&#8221;</a> (<em>Science</em>, 2011). <a href="https://www.gdeltproject.org/">The GDELT Project</a>. Juzek and Ward, <a href="https://aclanthology.org/2025.coling-main.426/">&#8220;Why Does ChatGPT &#8216;Delve&#8217; So Much?&#8221;</a> (COLING&nbsp;2025).</p>]]></content:encoded></item><item><title><![CDATA[The Last Landing Page]]></title><description><![CDATA[Static content will soon start to feel like a painting in a gallery.]]></description><link>https://www.outofcontext.io/p/the-last-landing-page-f35c8ec843af</link><guid isPermaLink="false">https://www.outofcontext.io/p/the-last-landing-page-f35c8ec843af</guid><dc:creator><![CDATA[Out of Context]]></dc:creator><pubDate>Tue, 17 Mar 2026 00:11:28 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/eafc017d-9fab-4402-961f-103e660ed35f_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Static content will soon start to feel like a painting in a&nbsp;gallery.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gdoX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 424w, https://substackcdn.com/image/fetch/$s_!gdoX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 848w, https://substackcdn.com/image/fetch/$s_!gdoX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!gdoX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!gdoX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!gdoX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 424w, https://substackcdn.com/image/fetch/$s_!gdoX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 848w, https://substackcdn.com/image/fetch/$s_!gdoX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!gdoX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbea4ba55-c0a8-43a0-9ae6-d0dc487e8e09_1024x571.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div></div></div></div></figure></div><p>There is a landing page on your company&#8217;s website right now that was written eighteen months ago. A designer spent two weeks on it. It says the same thing to every single person who visits it, whether they&#8217;re a CTO at a Fortune 500 or an intern Googling your product for the first&nbsp;time.</p><p>That page is a painting. It took real skill to make. But paintings hang in galleries, and the rest of the world moved on to&nbsp;film.</p><h3>We are entering the era of non-canonical content.</h3><p>If you don&#8217;t live in SEO-world: Google introduced canonical URLs in 2009. It was a way for webmasters to tell search engines <em>this is the original version of this page&#8202;&#8212;&#8202;the master copy.</em> If you see duplicates, point here. One URL, one page, one message, served identically to everyone. A case study is a case study. A landing page is a landing page. You write it once, you ship it, and you hope it resonates with enough of the people who see&nbsp;it.</p><p>That model worked when content was expensive to produce and impossible to personalize at scale. It stops working the moment you have a large language model sitting between your data and your&nbsp;reader.</p><p>Soon, every asset will be generated on demand. The same URL will render differently for every visitor&#8202;&#8212;&#8202;individually constructed in real time for the person reading&nbsp;it.</p><p><a href="https://www.linkedin.com/in/andrej-karpathy-9a650716/">Andrej Karpathy</a> posed a question recently:</p><blockquote><p>What does LLM coding feel like in the future? Is it like playing StarCraft? Playing Factorio? Playing&nbsp;music?</p></blockquote><p>He was talking about software engineering, but the question can also be asked of every piece of content a marketing team produces. What does <em>consuming</em> content feel like when the content knows who you&nbsp;are?</p><p>One answer: walking into a room that rearranges itself around you. The furniture moves and the lighting shifts. The conversation starts exactly where you need it&nbsp;to.</p><p>Another answer: it feels like nothing at all. You don&#8217;t even notice. The content just&#8230; works. It addresses your questions before you ask them. It speaks your language&#8202;&#8212;&#8202;the way you think about problems, the frameworks you use, the objections you carry around like a backpack full of&nbsp;rocks.</p><p>That&#8217;s the spooky thing about perfectly optimized content. When it&#8217;s done right, you can&#8217;t see it&nbsp;working.</p><h3>One page, one message will start to feel very old fashioned.</h3><p>Today, a case study is a PDF. A customer gave an interview, then a content marketer wrote it up and now it lives on your website. Everyone reads the same&nbsp;story.</p><p>Tomorrow&#8202;&#8212;&#8202;and by &#8220;tomorrow&#8221; I mean this is buildable now, today, with off-the-shelf tools&#8202;&#8212;&#8202;that customer interview becomes the source truth for an infinite number of case studies. When a prospect in financial services reads it, the case study emphasizes compliance, data governance, and the regulatory nightmares that were solved. When a prospect in retail reads the same story, it surfaces supply chain insights, deployment speed, and integration with existing systems. The quotes and the data are static, but the narrative is assembled for whoever showed&nbsp;up.</p><p>Your case study doesn&#8217;t have a canonical version any more. The URL it lives in is a container, and what fills it depends on who arrives&#8202;&#8212;&#8202;their industry, the size of their company, the trail of pages they&#8217;ve already visited, and the specific problem that sent them to Google in the first&nbsp;place.</p><p>The URL itself stops working as a shared reference. It will become harder to Slack someone a link and say &#8220;look at this page&#8221; because they literally will not see what you saw. The web becomes personal in a way that breaks a very basic, very old assumption: that a page is a page is a&nbsp;page.</p><h3>You can build this&nbsp;today</h3><p>You could&#8202;&#8212;&#8202;and should&#8202;&#8212;&#8202;wire this up this&nbsp;quarter.</p><p>A prospect clicks through an email. A cookie picks up their session, and their profile gets enriched from whatever sources you have: Clay, your CRM, publicly available data. The system checks for history like prior visits, rep conversations, webinar attendance, past downloads.</p><p>All of that context flows into a retrieval layer. A knowledge graph maps the relationships between this person, their company, their industry&#8217;s pain points, the use cases that address them, and the customers who&#8217;ve already solved those problems. An LLM takes that assembled context and generates the page&#8202;&#8212;&#8202;net-new content, optimized for this visitor, at this&nbsp;moment.</p><p>I work in the graph database world, so take this with whatever grain of salt you want. I&#8217;ve spent years watching content infrastructure problems, and they keep converging on the same&nbsp;shape.</p><p>When you&#8217;re generating content dynamically, the core operation is context retrieval. And context is relational by nature. You need to traverse a web of connected entities&#8202;&#8212;&#8202;from a person to their company, from the company to its industry and pain points, from those pain points to the customers who solved them and what they said about your&nbsp;product.</p><p>Graph retrieval, or Graph RAG, is what makes non-canonical content actually work at scale. Vector search gets you &#8220;find the most similar document.&#8221; Graph traversal gets you &#8220;find the most relevant path through our entire knowledge base for this specific&nbsp;human.&#8221;</p><h3>The last canonical landing&nbsp;page</h3><p>Static content will soon start to feel like a painting in a gallery. You&#8217;ll admire the craftsmanship and appreciate the skill it took to write a headline that&#8202;&#8212;&#8202;shockingly&#8202;&#8212;&#8202;needs to work for a broad audience, to tell a customer story that holds together for different buyers.</p><p>We still go to galleries, and we still hang paintings on our walls. I&#8217;m not arguing this content will become worthless&#8202;&#8212;&#8202;but it will stop being the primary medium. And there&#8217;s a big difference between &#8220;this is beautiful&#8221; and &#8220;this is actually driving results.&#8221;</p><p>If you&#8217;re a technical marketer, a GTM engineer, or someone building where AI meets go-to-market: what would your content look like if you stopped writing pages and started writing generation functions?</p><p>The primitives are all there today. The hard part is the organizational mindset shift&#8202;&#8212;&#8202;from content as artifact to content as computation. From &#8220;we wrote a case study&#8221; to &#8220;we built a system that writes case studies.&#8221;</p><p>The last canonical landing page has already been written. It might still be on your website. But the page that replaces it is being generated right now, somewhere, for someone who isn&#8217;t you. And they&#8217;ll never know the difference&#8202;&#8212;&#8202;because to them, it will just look like a page that finally, for once, actually understood what they were looking&nbsp;for.</p>]]></content:encoded></item><item><title><![CDATA[You Are an $8,000 Bolt]]></title><description><![CDATA[How to engineer accountability into AI agents, and why decision traces are the missing infrastructure.]]></description><link>https://www.outofcontext.io/p/you-are-an-8-000-bolt-5d03e5c9b635</link><guid isPermaLink="false">https://www.outofcontext.io/p/you-are-an-8-000-bolt-5d03e5c9b635</guid><dc:creator><![CDATA[Out of Context]]></dc:creator><pubDate>Mon, 09 Feb 2026 16:46:01 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/e83c6f06-99e7-4084-b73c-4238e34ab0e1_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!R0W-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 424w, https://substackcdn.com/image/fetch/$s_!R0W-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 848w, https://substackcdn.com/image/fetch/$s_!R0W-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!R0W-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!R0W-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!R0W-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 424w, https://substackcdn.com/image/fetch/$s_!R0W-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 848w, https://substackcdn.com/image/fetch/$s_!R0W-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!R0W-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb04b406-e802-4b68-941d-2db4ded97d81_1024x550.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div></div></div></div></figure></div><h4>How to engineer accountability into AI agents, and why decision traces are the missing infrastructure.</h4><p>This last week, a helicopter bolt worth $8,000 went viral on&nbsp;Reddit.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!aSKk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 424w, https://substackcdn.com/image/fetch/$s_!aSKk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 848w, https://substackcdn.com/image/fetch/$s_!aSKk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 1272w, https://substackcdn.com/image/fetch/$s_!aSKk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!aSKk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:null,&quot;width&quot;:null,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!aSKk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 424w, https://substackcdn.com/image/fetch/$s_!aSKk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 848w, https://substackcdn.com/image/fetch/$s_!aSKk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 1272w, https://substackcdn.com/image/fetch/$s_!aSKk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F755bb4e3-f90a-41ce-bc7a-f6f3d0ceb6b6_1024x791.png 1456w" sizes="100vw"></picture><div></div></div></div><figcaption class="image-caption"><a href="https://www.reddit.com/r/interestingasfuck/comments/1qwhp1u/this_bolt_is_worth_8000_and_goes_in_a_helicopter/">https://www.reddit.com/r/interestingasfuck/comments/1qwhp1u/this_bolt_is_worth_8000_and_goes_in_a_helicopter/</a></figcaption></figure></div><p><strong>The internet wasn&#8217;t fooled by the price tag.</strong> As one user pointed out, the manufacturing cost is likely&nbsp;pennies.</p><p>The bolt costs $8,000 because of everything wrapped around it: the certification, the inspection chain, the auditable paper trail from foundry to airframe. Someone signed their name on every step. If the bolt fails and people get hurt, there&#8217;s a clear, traceable line of accountability back to a specific human who approved a specific decision to a specific standard.</p><p>In other words, the bolt costs $8,000 because the chain of custody for blame is priced&nbsp;in.</p><p>I&#8217;ve been thinking about this a lot, because with the rise of AI, I am quickly becoming an $8,000 bolt myself. And so are&nbsp;you.</p><p>Let me&nbsp;explain.</p><h3>Why AI Can&#8217;t Carry Accountability (Yet)</h3><p>The usual framing goes something like this: &#8220;AI can&#8217;t be held accountable, so it can&#8217;t replace people who carry responsibility.&#8221;</p><p>That&#8217;s directionally right, but most people stop there without breaking apart&nbsp;<em>why</em>.</p><p>Accountability requires the capacity to bear consequences. In other words, AI has no skin in the game. It can&#8217;t get fired. It can&#8217;t get embarrassed in a meeting. It can&#8217;t lose political capital or take a reputational hit. None of these repercussion register in a way that changes what it&nbsp;does.</p><p>A lot of roles survive automation not because they&#8217;re complex, but because someone real has to be on the hook when things go sideways.</p><p>This dynamic gets stronger in bigger companies, where there are more layers and the accountability chain has more middlemen. Execution jobs sit closer to the &#8216;get shit done&#8217; layer. The accountability pressure from above is several steps removed. If a development task doesn&#8217;t get done, the person who really has to answer for it usually isn&#8217;t the developer&#8202;&#8212;&#8202;it&#8217;s the PM, the EM, the middle&nbsp;manager.</p><p>So: accountability matters, AI can&#8217;t carry it, and a huge number of enterprise roles exist precisely to carry it. Does that mean humans are&nbsp;safe?</p><p>Not exactly. Because accountability has components that <em>can</em> be mapped: documentation, approval chains, traceability, and consequences. We know this because we already engineer it into physical systems every day. (To wit: $8,000&nbsp;bolt.)</p><p>The bolt doesn&#8217;t exercise judgment. It just has a paper trail proving it was made to spec. So it follows, can we build the same kind of accountability infrastructure for AI-assisted decisions that we build for helicopter bolts?</p><p>The answer is yes. And the companies that figure this out first are going to own the next decade of enterprise software.</p><h3>Decision traces: how to build better bolts (and&nbsp;bots)</h3><p>A decision trace captures who approved what, when, under which policy, based on which precedent, using what context, and with what&nbsp;outcome.</p><p>Most enterprises have none of this today. Their systems of record store current state, i.e. what the opportunity looks like <em>right now</em>, not what it looked like when the decision was made. The context that justified a human&#8217;s judgment was never treated as&nbsp;data.</p><p>This is why AI agents keep hitting walls in real enterprise workflows. Agents run into the same ambiguity humans resolve every day with judgment and memory, but the inputs to those judgments aren&#8217;t stored anywhere&nbsp;durable.</p><h3><strong>Human-in-the-Loop Is the&nbsp;Feature</strong></h3><p>I&#8217;ve seen people frame human-in-the-loop as a temporary concession or a safety net we&#8217;ll remove once the AI <a href="https://en.wiktionary.org/wiki/git_gud">gits&nbsp;gud</a>.</p><p>I think this argument misunderstands where the value&nbsp;lies.</p><p>The $8,000 bolt doesn&#8217;t aspire to exist without inspectors. The inspection chain <em>is the value.</em> Remove it, and you have a $3 bolt that nobody will put in a helicopter.</p><p>The same principle applies to AI agents in enterprise workflows. The agent proposes, gathers context, routes approvals, and records the trace. The human reviews, approves, and their judgment gets captured as durable precedent. This enriches the accountability graph.</p><p>As similar cases repeat and the trace library grows, precedented decisions can be increasingly automated. Not always because the human got removed, but because their captured judgment now covers the pattern. The human stays in the loop for <em>novel</em> decisions: i.e. the ones where precedent doesn&#8217;t exist or the stakes demand fresh judgment.</p><p>This is a different architecture than &#8216;replace the human with an AI&#8217;. It&#8217;s more: make the human&#8217;s judgment traceable, replayable, and compounding.</p><h3><strong>Why Nobody&#8217;s Built This&nbsp;Yet</strong></h3><p>Salesforce knows what your opportunity looks like now. It doesn&#8217;t know what it looked like when the decision was made. Data warehouses have a time-based view, but they receive data via ETL <em>after </em>decisions happen. By the time data lands in Snowflake, the decision context is&nbsp;gone.</p><p>These companies aren&#8217;t structurally incapable of building a decision layer, but they&#8217;re definitely disincentivized to do so. Their entire business model is built around being the system of record, not the system of reasoning. Retrofitting that is closer to a &#8216;build a new product&#8217; problem by moving up the value&nbsp;chain.</p><p>The structural advantage goes to whoever sits in the orchestration path: i.e. the layer where agents actually gather context, evaluate policies, route approvals, and commit actions. That&#8217;s where you capture traces at decision time, not after the&nbsp;fact.</p><p>Benedict Evans has talked about how <a href="https://x.com/MarceloLima/status/2020202238405234998">enterprises need &#8220;a throat to choke&#8221;</a>, usually in the form of a whipping boy vendor that carries accountability. In other words, the value is in the accountability layer that links data to action through traceable reasoning. The models that do this are fast becoming commodities.</p><h3><strong>The Playbook</strong></h3><p>If you&#8217;re building AI systems in an enterprise context, here&#8217;s the pragmatic way to take action and apply this thinking:</p><p><strong>Start with human-in-the-loop, always. </strong>Don&#8217;t try to remove the human. Try to capture their judgment. Structure and store every approval, every override, every exception (without exception).</p><p><strong>Instrument your agent orchestration to emit decision traces.</strong> Every time an agent runs, record: what context was gathered, what policy was evaluated, what precedent was referenced, who approved the action, and what the outcome&nbsp;was.</p><p><strong>Store traces as a graph, not a log. </strong>Connect decisions to the entities they affect. Link precedents to the decisions they influence. Make the &#8216;why&#8217; traversable.</p><p><strong>Let the graph compound.</strong> Each captured decision makes the next one faster and more informed. Exceptions become searchable precedent. Tribal knowledge becomes institutional memory. The system gets smarter as the judgment library&nbsp;grows.</p><p><strong>Use the graph for auditability.</strong> When something goes wrong you need to be able to trace backwards through the decision chain, just like you trace the $8,000 bolt from the crash site back to the foundry that made&nbsp;it.</p><h3><strong>An $8,000&nbsp;Insight</strong></h3><p>The humble helicopter bolt teaches us something the AI industry keeps getting&nbsp;wrong.</p><p>AI&#8217;s value will come from the system that surrounds it: the decision traces, the accountability graphs, the clear chain of human judgment captured and made&nbsp;durable.</p><p>You are an $8,000 bolt. Your judgment, your approvals, your accountability are the things that actually keep the helicopter in the&nbsp;air.</p><p>So the question is whether someone will build a system that captures your judgment so it compounds, instead of evaporating into Slack&nbsp;threads.</p><p>That system is&nbsp;coming.</p>]]></content:encoded></item><item><title><![CDATA[The Vibe Economy: What NotebookLM Taught Me About Where Value Is Going]]></title><description><![CDATA[No AI tool puts the fear of God in me like NotebookLM.]]></description><link>https://www.outofcontext.io/p/the-vibe-economy-what-notebooklm</link><guid isPermaLink="false">https://www.outofcontext.io/p/the-vibe-economy-what-notebooklm</guid><dc:creator><![CDATA[Out of Context]]></dc:creator><pubDate>Tue, 27 Jan 2026 14:00:00 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/0251a9fd-fa39-4730-9508-a690b49185fd_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>No AI tool puts the fear of God in me like NotebookLM.</p><p>I feel an existential, jealous dread whenever I see other people using it. Turning notes into podcasts. Ideas into slides.</p><p>As anyone who has worked with Agents can likely tell you, it still takes a lot of tedious human judgment to make AI output feel right. But with NotebookLM, something that once belonged to a small group has seemingly leaked into the open.</p><p><a href="https://www.linkedin.com/in/sofialomart/">Sof&#237;a L&#243;pez</a> articulated this growing dread so perfectly in <a href="https://x.com/sofialomart/status/2013356845025403094">I work in AI and I&#8217;m scared.</a> &#8220;I&#8217;m scared of something pathetic and real: that I&#8217;ll waste this moment.&#8221;</p><p><a href="https://www.linkedin.com/in/andycoenen/">Andy Coenen</a> also explored the role of taste in <a href="https://cannoneyed.com/projects/isometric-nyc">isometric nyc</a>: &#8220;The quality of art is defined by the quality of your decisions - how much work you put into something is just a proxy for how much you care and how much you have to say.&#8221;</p><p>I want to take these ideas and play them forward. There will always be a place for human-created work. Possibly an even more revered one, as AI scales. But AI isn&#8217;t coming for the sacred or the sublime. It&#8217;s coming for the useful.</p><p>I think NotebookLM is a prototype for a new economic model. It proves that when execution becomes trivial, the value shifts entirely to the format. This piece is my attempt to map that shift. NotebookLM is the first real glimpse of format-as-a-service at scale. FaaS?</p><p>It signals a future where creators won&#8217;t sell labor or output, but will franchise their judgment through APIs. Format becomes the product, and taste becomes the only moat left to scale.</p><p>We all love NotebookLM. This is bad news for NotebookLM.</p><p><a href="https://notebooklm.google/">NotebookLM</a> is a research tool. You upload documents, it spins up a small RAG pipeline you can interrogate. It&#8217;s a really great product.</p><p>But what users actually get excited about are the outputs. Podcasts, summaries, study guides, slides. The joy comes from the shape the information takes and the godlike ability to summon this content at will.</p><p>NotebookLM is a winning formula because someone at Google obsessed over the transformation pipeline. In other words, the specific way raw information gets restructured into a format that feels good to consume.</p><p>Here&#8217;s an example of an automated Podcast I created from Sof&#237;a and Andy&#8217;s articles. I even got that same small creative rush from listening it back after it was created. But this podcast is a product that tens of thousands of others can build near-instantly. Once you realize that, the perceived value of its output decreases immensely. A NotebookLM podcast is miraculous the first time you hear it. By the tenth time, it&#8217;s just noise. So where will this arms race end?</p><p>To stand out in a world of infinite generation, you don&#8217;t need better AI. You need novel formats. Businesses will want a format that feels unique. And because novelty fades fast, they might use a format once and then discard it.</p><p>That&#8217;s okay for NotebookLM, though, because very soon we&#8217;ll be able to change our podcast hosts. Or even make ourselves the host. We&#8217;ll all have a podcast. At last.</p><p>With NotebookLM, Google has done the tedious work of understanding how and why a talk show format is successful, and have encoded that taste into a pipeline. They&#8217;ve also done it at scale. The AI does the execution, but the format itself is the product. In our new &#8216;vibe economy&#8217;, format is the vehicle for value.</p><h2>Format-and-expertise-as-a-service</h2><p>We&#8217;ve seen some of this play out already. We&#8217;re now witnessing the rapid evolution of <a href="http://skills.md/">skills.md</a> packages &#8212; bundles of markdown documents that tell the AI how to behave. &#8220;Don&#8217;t use the word leverage.&#8221; &#8220;Call this MCP tool.&#8221; What I&#8217;m describing is probably further down the road: taste encoded into real pipelines.</p><p>What&#8217;s missing in this future is a marketplace for prebuilt, high-taste content formats. These formats could look like something we already know and love:</p><ul><li><p>WIRED Question / Answer Videos but for your C-Suite leadership</p></li><li><p>Every Frame a Painting but for your product explainer videos</p></li><li><p>This American Life but for your SDR emails</p></li></ul><p>But also it could look like:</p><ul><li><p>A video case study generated for every customer in your business</p></li><li><p>A competitive battlecard produced dynamically as the prospect states objections live on a call</p></li><li><p>A customer persona document built with real Gong recordings</p></li></ul><p>When a company hires a strategist today, they&#8217;re paying for three things bundled together: the thinking, the structure, and the execution. The strategist figures out what to say, decides how to frame it, and produces the deliverable. Format-as-a-service unbundles this.</p><p>The company brings the thinking: their data, their context, their specific problem. The format provides the structure: the decisions about what goes where, what gets emphasized, what gets cut.</p><p>This is a strange inversion. We&#8217;re used to paying for labor. Now we&#8217;ll pay for the shape that labor used to produce, divorced from the labor itself. If you&#8217;re a creator, the biggest opportunity I see ahead is in franchising and packaging your formats in a way that will allow them to scale beyond yourself. Companies will pay for this.</p><h2>So where does this lead?</h2><p>We&#8217;re about to see an explosion of AI-generated content. Yes, most of it will be beige. But some of it will be genuinely good. Not because the AI is better, but because someone with taste designed the format it flows through.</p><p>Most creators will keep selling their time. A few will figure out that their job isn&#8217;t making things anymore. It&#8217;s designing the framework that things flow through.</p><p>And when they do, they won&#8217;t sell content. They&#8217;ll license the shape.</p>]]></content:encoded></item></channel></rss>