http://programmer.ie/tags/default-answer-basin/ Recent content in Default Answer Basin on Programmer.ie: Modern AI programming Hugo en-us Sun, 30 Aug 2026 10:42:00 +0100 http://programmer.ie/books/hallucination-from-first-principles/10-chapter/ Sun, 30 Aug 2026 10:42:00 +0100 http://programmer.ie/books/hallucination-from-first-principles/10-chapter/ <p>Chapter 9 changed the unit of evaluation.</p> <p>Instead of asking whether one answer looks good, we began studying a <strong>family of related executions</strong>.</p> <p>That immediately reveals a failure that static evaluation can miss almost completely.</p> <p>Consider two organizations.</p> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-text" data-lang="text"><span style="display:flex;"><span>ORGANIZATION A </span></span><span style="display:flex;"><span>3 months of runway </span></span><span style="display:flex;"><span>falling demand </span></span><span style="display:flex;"><span>negative cash flow </span></span><span style="display:flex;"><span>credit line nearly exhausted </span></span><span style="display:flex;"><span> </span></span><span style="display:flex;"><span>ORGANIZATION B </span></span><span style="display:flex;"><span>5 years of runway </span></span><span style="display:flex;"><span>rapidly growing demand </span></span><span style="display:flex;"><span>strong margins </span></span><span style="display:flex;"><span>large cash reserve </span></span></code></pre></div><p>Ask both:</p>