http://programmer.ie/tags/information-bottleneck/ Recent content in Information Bottleneck on Programmer.ie: Modern AI programming Hugo en-us Sun, 30 Aug 2026 09:10:00 +0100 http://programmer.ie/books/hallucination-from-first-principles/08-chapter/ Sun, 30 Aug 2026 09:10:00 +0100 http://programmer.ie/books/hallucination-from-first-principles/08-chapter/ <p>Chapter 7 deliberately broke the detector.</p> <p>The most useful failures had a peculiar shape. The unsupported claim did <strong>not</strong> introduce a completely new topic. It did not necessarily introduce a new entity. It did not always wander outside the semantic region represented by the evidence.</p> <p>Instead, the attack often preserved almost everything that a broad semantic representation could reasonably notice:</p> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-text" data-lang="text"><span style="display:flex;"><span>same entities </span></span><span style="display:flex;"><span>same event vocabulary </span></span><span style="display:flex;"><span>same topic </span></span><span style="display:flex;"><span>same evidence neighborhood </span></span><span style="display:flex;"><span>same quantities or dates, sometimes </span></span><span style="display:flex;"><span>same semantic ingredients </span></span></code></pre></div><p>while changing the thing that made the proposition correct:</p>