Type a section name and press Enter. Use “help” for the list.
Cliste experiment
Decoder refinement with a fixed encoder
Registered 8 Oct 2026 · Snapshot 12 Oct 2026
The question
Improve perceptual readout by refining only the decoder of fixed refined-encoder VSA vectors, while measuring actual stored-memory readback separately.
Why this experiment?
A memory can only preserve what its sensory interface encodes. These studies separate encoder quality, decoder quality and compatibility with earlier stored vectors.
How it works
Change one component or input representation at a time and evaluate immediate reconstruction on separate images. Keep old-vector readback visible so gains on new inputs do not hide compatibility losses.
Follow this part of the investigation: Sharper perception can also change the language of memory →Implementation and comparison details
Only the 12 decoder lift/painter parameter tensors learn. The refined encoder, position codes, all normalization running statistics, VSA operations and input resolution stay fixed. Both decoders receive identical vectors; actual old stored vectors are evaluated separately from re-encoded observations. Original, zero-rate and vector-dependence controls are retained.
What happened
Photo fidelity improved modestly: COCO MSE 6.19% lower (95% interval 6.05–6.34%), Flickr 5.83% lower; edge error also improved. Writing on white regressed 12.12%, with every example worse in every seed. Actual old-vector readback regressed 4.96–6.45% overall and 8.25–11.45% for Dune. All 39 integrity checks passed, but the candidate is unsuitable as an unconditional general-decoder replacement. Earlier lives retain their original models. Independent audit passed 360/360 checks; all 854 repository tests and required static/viewer checks passed.
Decoder-only refinement: material_improvement; primary MSE reduction 6.19%, 95% interval [6.05%, 6.34%]. Edge detail: improvement.
Measurements
| Recorded field | Value |
|---|---|
| primary relative gain | 0.061930945876963905 |
| primary ci95 | [ 0.06048299136505278, 0.06339958640301797 ] |
| external relative gain | 0.05826819104086278 |
| edge verdict | improvement |
| checks passed | 39 |
| checks total | 39 |
| training seeds | 3 |
| display arm | seed-202 |
| stored memory material regression | Pass |
Recorded checks
| Recorded field | Value |
|---|---|
| registered files unchanged | Pass |
| optimization controls | Pass |
| selected vector dependence | Pass |
| selected encoder outputs exact | Pass |
| previous lives and evidence unchanged | Pass |
| training cache equivalence | Pass |
| final cache equivalence | Pass |
| baseline fixed tensors exact | Pass |
| baseline all finite | Pass |
| baseline production reload equivalent | Pass |
| baseline test coco encoded vectors exact | Pass |
| baseline test flickr encoded vectors exact | Pass |
| baseline replay encoded vectors exact | Pass |
| baseline writing white encoded vectors exact | Pass |
| baseline writing photo encoded vectors exact | Pass |
| seed-101 fixed tensors exact | Pass |
| seed-101 all finite | Pass |
| seed-101 production reload equivalent | Pass |
| seed-101 test coco encoded vectors exact | Pass |
| seed-101 test flickr encoded vectors exact | Pass |
| seed-101 replay encoded vectors exact | Pass |
| seed-101 writing white encoded vectors exact | Pass |
| seed-101 writing photo encoded vectors exact | Pass |
| seed-202 fixed tensors exact | Pass |
| seed-202 all finite | Pass |
| seed-202 production reload equivalent | Pass |
| seed-202 test coco encoded vectors exact | Pass |
| seed-202 test flickr encoded vectors exact | Pass |
| seed-202 replay encoded vectors exact | Pass |
| seed-202 writing white encoded vectors exact | Pass |
| seed-202 writing photo encoded vectors exact | Pass |
| seed-303 fixed tensors exact | Pass |
| seed-303 all finite | Pass |
| seed-303 production reload equivalent | Pass |
| seed-303 test coco encoded vectors exact | Pass |
| seed-303 test flickr encoded vectors exact | Pass |
| seed-303 replay encoded vectors exact | Pass |
| seed-303 writing white encoded vectors exact | Pass |
| seed-303 writing photo encoded vectors exact | Pass |
Results and visual artifacts
Open a figure for its input, comparison, and result. Click an image to enlarge it.
The encoder converts pixels into a VSA vector; the decoder turns that vector back into pixels. Only the decoder is trained in this experiment. The model receives a 64 × 64 RGB image; photographs are center-cropped and resized before encoding. Enlargement here adds no detail. Development examples help select a model; final test examples assess that selected model. Training-control examples deliberately test whether fitting works. “Replay” re-encodes earlier images with the fixed current encoder; “stored replay” decodes the actual older memory vectors. Error panels show four times the absolute RGB difference from the reference, separately for each color channel, clipped at full brightness. Darker pixels mean smaller errors; black is zero or below the display’s precision. The scale is fixed across examples, not adjusted to make each image look better.
COCO test photographs: effect of decoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: largest gains on test photographs

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: smallest gains on test photographs

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Flickr test photographs: effect of decoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier photographs again 0–5

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier photographs again 6–11

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier photographs again 12–17

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier photographs again 18–23

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Andor video frames again 24–29

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Andor video frames again 30–35

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Andor video frames again 36–41

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Andor video frames again 42–47

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Dune video frames again 48–53

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Dune video frames again 54–59

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Dune video frames again 60–65

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: encoding earlier Dune video frames again 66–71

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Rendered writing on white backgrounds: effect of decoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Rendered writing on photographs: effect of decoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored photographs 0–5

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored photographs 6–11

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored photographs 12–17

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored photographs 18–23

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Andor video frames 24–29

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Andor video frames 30–35

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Andor video frames 36–41

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Andor video frames 42–47

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Dune video frames 48–53

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Dune video frames 54–59

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Dune video frames 60–65

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: reading stored Dune video frames 66–71

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
How decoder training changes development-image error

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement: inputs used to monitor training

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder learning check: fitting eight training photographs

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (1e-05): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (1e-05): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (1e-05): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (3e-05): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (3e-05): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (3e-05): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (1e-04): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (1e-04): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (1e-04): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (3e-04): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (3e-04): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, learning-rate trial (3e-04): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 1,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 1,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 1,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 1,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 2,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 2,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 2,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 2,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 3,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 3,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 3,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 3,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 1: 4,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 1,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 1,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 1,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 1,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 2,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 2,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 2,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 2,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 3,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 3,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 3,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 3,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 2: 4,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 1,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 1,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 1,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 1,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 2,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 2,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 2,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 2,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 3,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 3,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 3,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 3,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Decoder refinement, training repetition 3: 4,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Limits and next question
One fixed seed-29 refined encoder, one 64 by 64 PatchSum architecture and one registered decoder-training recipe. Decoder seeds do not repeat encoder training. Pixel fidelity, edge detail and actual stored-memory readback receive separate conclusions; improved reconstruction does not establish acquired understanding, reading or compositional usefulness. Prior historical exposure and all semantic duplicates cannot be ruled out. Encoder-space drift remains a separate adoption question. No existing life is migrated or replaced.
Next question. Can mixed photograph-and-writing training recover the photo gain while retaining writing fidelity and readback from the old vector space?
Inspect the evidence
Download the methods and measurements for this experiment. Large training and saved-state files are not included.