Type a section name and press Enter. Use “help” for the list.
Cliste experiment
Encoder refinement with a fixed decoder
Registered 7 Oct 2026 · Snapshot 12 Oct 2026
The question
Improve immediate perceptual reconstruction by refining only the encoder through the fixed VSA representation and decoder.
Why this experiment?
A memory can only preserve what its sensory interface encodes. These studies separate encoder quality, decoder quality and compatibility with earlier stored vectors.
How it works
Change one component or input representation at a time and evaluate immediate reconstruction on separate images. Keep old-vector readback visible so gains on new inputs do not hide compatibility losses.
Follow this part of the investigation: Sharper perception can also change the language of memory →Implementation and comparison details
Only encoder feature extraction and vector projection parameters learn. Decoder, position codes, normalization statistics, VSA operations and input resolution stay fixed; original and zero-rate controls are retained.
What happened
Encoder-only training reduced immediate reconstruction MSE by 47.64% on 1,024 final COCO photographs (95% interval 46.90–48.38%), 45.38% on 1,000 Flickr photographs and 57.50% on the prior 72 inputs. Three seeds agree; all 15 integrity checks pass. All decoder, place-code and normalization-state tensors remain exact. Fine detail remains blurred, and new vectors drift substantially relative to old memory vectors.
Encoder-only refinement: material_improvement; primary relative MSE gain 47.64%, 95% interval [46.90%, 48.38%].
Measurements
| Recorded field | Value |
|---|---|
| primary relative gain | 0.47641889413283456 |
| primary ci95 | [ 0.46895234855616774, 0.48381665774578303 ] |
| external relative gain | 0.453782666988756 |
| checks passed | 15 |
| checks total | 15 |
| training seeds | 3 |
| display arm | seed-29 |
Recorded checks
| Recorded field | Value |
|---|---|
| registered files unchanged | Pass |
| optimization controls | Pass |
| previous lives and evidence unchanged | Pass |
| baseline fixed tensors exact | Pass |
| baseline all finite | Pass |
| baseline production reload equivalent | Pass |
| seed-17 fixed tensors exact | Pass |
| seed-17 all finite | Pass |
| seed-17 production reload equivalent | Pass |
| seed-29 fixed tensors exact | Pass |
| seed-29 all finite | Pass |
| seed-29 production reload equivalent | Pass |
| seed-43 fixed tensors exact | Pass |
| seed-43 all finite | Pass |
| seed-43 production reload equivalent | Pass |
Results and visual artifacts
Open a figure for its input, comparison, and result. Click an image to enlarge it.
The encoder converts pixels into a VSA vector; the decoder turns that vector back into pixels. Only the encoder is trained in this experiment. The model receives a 64 × 64 RGB image; photographs are center-cropped and resized before encoding. Enlargement here adds no detail. Development examples help select a model; final test examples assess that selected model. Training-control examples deliberately test whether fitting works. Replay examples are earlier images encoded again, not reconstructions from untouched old memory vectors. Error panels show four times the absolute RGB difference from the reference, separately for each color channel, clipped at full brightness. Darker pixels mean smaller errors; black is zero or below the display’s precision. The scale is fixed across examples, not adjusted to make each image look better.
COCO test photographs: effect of encoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: largest gains on test photographs

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: smallest gains on test photographs

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Flickr test photographs: effect of encoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier photographs again 0–5

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier photographs again 6–11

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier photographs again 12–17

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier photographs again 18–23

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Andor video frames again 24–29

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Andor video frames again 30–35

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Andor video frames again 36–41

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Andor video frames again 42–47

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Dune video frames again 48–53

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Dune video frames again 54–59

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Dune video frames again 60–65

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement: encoding earlier Dune video frames again 66–71

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Rendered writing on white backgrounds: effect of encoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Rendered writing on photographs: effect of encoder refinement

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
How encoder training changes development-image error

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder learning check: fitting eight training photographs

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (1e-05): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (1e-05): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (1e-05): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (3e-05): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (3e-05): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (3e-05): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (1e-04): 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (1e-04): 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, learning-rate trial (1e-04): 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 1,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 1,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 1,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 1,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 2,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 2,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 2,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 2,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 3,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 3,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 3,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 3,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 1: 4,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 1,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 1,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 1,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 1,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 2,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 2,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 2,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 2,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 3,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 3,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 3,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 3,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 2: 4,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 0 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 1,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 1,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 1,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 1,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 2,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 2,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 2,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 2,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 3,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 3,250 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 3,500 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 3,750 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Encoder refinement, training repetition 3: 4,000 weight updates

Display derivative: WebP quality 90; maximum edge 2400 px. Original scientific pixels remain in the source run; do not measure this preview.
Limits and next question
This establishes a reconstruction gain for one pretrained 64×64 candidate and training recipe, not optimal encoding or general cognition. Every evaluated image improved in pixel MSE for each seed, but detail is still lost. New vectors match their own old vectors in only 34–36 of 72 replay cases (22/24 photographs); reconstruction alone does not establish memory compatibility or useful semantic/compositional structure. Existing lives retain their original models. Source exposure and near-duplicate screening limits are disclosed in the report.
Next question. How can further encoder refinement preserve more detail and useful vector relationships? Resolve compatibility before adopting the candidate into an old life. Milestone 1.3 remains deferred.
Inspect the evidence
Download the methods and measurements for this experiment. Large training and saved-state files are not included.