Models From First Principles 01: MR.Q — Building a Neural Quality Model From Two Embeddings

Sat, 08 Aug 2026 14:33:00 +0100

MR.Q — Building a Neural Quality Model From Two Embeddings

In the previous post, we established the core idea behind this series:

A complicated model becomes understandable when you recursively decompose it into smaller models, blocks, layers and tensor operations.

Now we build the first real model.

Not a transformer.

Not a giant language model.

Not an agent.

A scorer.

We will take two embeddings:

context embedding
response embedding

combine them, encode the relationship between them, and predict one scalar: