run record~/research/cliste/runsAll Cliste runs

Type a section name and press Enter. Use “help” for the list.

Figures: softened for dark viewingDisplay only; image files are unchanged.
← All Cliste runs

Cliste experiment

Does learning more visual patterns improve partial recall?

Execution: completedScientific verdict: Vocabulary growth did not meet the full benefit criteria

The question

Test whether additional acquired patterns improve recall when both conditions have exactly the same episodic experience.

Why this experiment?

A continuing memory should be able to acquire patterns without losing earlier behavior. Growth matters only if those patterns improve later use.

How it works

Admit the same new photographs into one memory and compare partial recall without cleanup, with the original pattern bank, with an expanded bank and with disrupted pattern correspondence. Recheck earlier recall and operations separately.

Follow this part of the investigation: Grow the vocabulary, then test whether it helps →
Implementation and comparison details

Sixteen fresh photographs enter a shared native memory. Compare no cleanup, the original vocabulary, continued acquisition, and disrupted pattern substitution using the same partial cues.

What happened

The independently audited vocabulary grew from 512 to 1,758 patterns. Expanded cleanup recalled 44 of 96 new-photo cues, versus 35 with the original bank and 68 without cleanup. Its source-paired gain over the original bank was 9.4 percentage points (95% interval 2.1 to 17.7), but two old-cue recalls were lost and offset by two gains, failing the registered individual-retention criterion. All legitimate conditions rejected all 160 unfamiliar cues after acquisition. The established no-cleanup path retained all 44 earlier correct recalls, successful temporal behavior at 31 shared anchors, and exact outputs for all 32 editing sequences with the original bank. The occurrence IDs use 0.89 MiB; vocabulary and occurrence payload add 156.71 MiB while dense memories remain. Keep no cleanup as the default and test useful cross-photo vocabulary transfer at the fixed learned memory-readout boundary next. Milestone 1.3 remains open.

Measurements
Measurements — values preserved from this run
Recorded fieldValue
groups
{
  "newly_admitted": {
    "none": {
      "count": 96,
      "correct": 68,
      "wrong": 0,
      "abstained": 28,
      "rank_correct": 91
    },
    "frozen": {
      "count": 96,
      "correct": 35,
      "wrong": 0,
      "abstained": 61,
      "rank_correct": 62
    },
    "continued": {
      "count": 96,
      "correct": 44,
      "wrong": 0,
      "abstained": 52,
      "rank_correct": 70
    },
    "disrupted": {
      "count": 96,
      "correct": 0,
      "wrong": 0,
      "abstained": 96,
      "rank_correct": 2
    }
  },
  "newly_admitted_support_12": {
    "none": {
      "count": 32,
      "correct": 21,
      "wrong": 0,
      "abstained": 11,
      "rank_correct": 29
    },
    "frozen": {
      "count": 32,
      "correct": 6,
      "wrong": 0,
      "abstained": 26,
      "rank_correct": 16
    },
    "continued": {
      "count": 32,
      "correct": 6,
      "wrong": 0,
      "abstained": 26,
      "rank_correct": 18
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 1
    }
  },
  "newly_admitted_support_24": {
    "none": {
      "count": 32,
      "correct": 22,
      "wrong": 0,
      "abstained": 10,
      "rank_correct": 30
    },
    "frozen": {
      "count": 32,
      "correct": 11,
      "wrong": 0,
      "abstained": 21,
      "rank_correct": 21
    },
    "continued": {
      "count": 32,
      "correct": 16,
      "wrong": 0,
      "abstained": 16,
      "rank_correct": 24
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    }
  },
  "newly_admitted_support_64": {
    "none": {
      "count": 32,
      "correct": 25,
      "wrong": 0,
      "abstained": 7,
      "rank_correct": 32
    },
    "frozen": {
      "count": 32,
      "correct": 18,
      "wrong": 0,
      "abstained": 14,
      "rank_correct": 25
    },
    "continued": {
      "count": 32,
      "correct": 22,
      "wrong": 0,
      "abstained": 10,
      "rank_correct": 28
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 1
    }
  },
  "never_admitted": {
    "none": {
      "count": 96,
      "correct": 0,
      "wrong": 0,
      "abstained": 96,
      "rank_correct": 0
    },
    "frozen": {
      "count": 96,
      "correct": 0,
      "wrong": 0,
      "abstained": 96,
      "rank_correct": 0
    },
    "continued": {
      "count": 96,
      "correct": 0,
      "wrong": 0,
      "abstained": 96,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 96,
      "correct": 0,
      "wrong": 0,
      "abstained": 96,
      "rank_correct": 0
    }
  },
  "never_admitted_support_12": {
    "none": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "frozen": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "continued": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    }
  },
  "never_admitted_support_24": {
    "none": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "frozen": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "continued": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    }
  },
  "never_admitted_support_64": {
    "none": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "frozen": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "continued": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    }
  },
  "earlier_known": {
    "none": {
      "count": 80,
      "correct": 44,
      "wrong": 0,
      "abstained": 36,
      "rank_correct": 72
    },
    "frozen": {
      "count": 80,
      "correct": 30,
      "wrong": 0,
      "abstained": 50,
      "rank_correct": 48
    },
    "continued": {
      "count": 80,
      "correct": 30,
      "wrong": 0,
      "abstained": 50,
      "rank_correct": 43
    },
    "disrupted": {
      "count": 80,
      "correct": 3,
      "wrong": 0,
      "abstained": 77,
      "rank_correct": 7
    }
  },
  "earlier_known_support_12": {
    "none": {
      "count": 16,
      "correct": 4,
      "wrong": 0,
      "abstained": 12,
      "rank_correct": 10
    },
    "frozen": {
      "count": 16,
      "correct": 2,
      "wrong": 0,
      "abstained": 14,
      "rank_correct": 5
    },
    "continued": {
      "count": 16,
      "correct": 2,
      "wrong": 0,
      "abstained": 14,
      "rank_correct": 5
    },
    "disrupted": {
      "count": 16,
      "correct": 1,
      "wrong": 0,
      "abstained": 15,
      "rank_correct": 2
    }
  },
  "earlier_known_support_24": {
    "none": {
      "count": 16,
      "correct": 5,
      "wrong": 0,
      "abstained": 11,
      "rank_correct": 14
    },
    "frozen": {
      "count": 16,
      "correct": 2,
      "wrong": 0,
      "abstained": 14,
      "rank_correct": 8
    },
    "continued": {
      "count": 16,
      "correct": 3,
      "wrong": 0,
      "abstained": 13,
      "rank_correct": 5
    },
    "disrupted": {
      "count": 16,
      "correct": 1,
      "wrong": 0,
      "abstained": 15,
      "rank_correct": 2
    }
  },
  "earlier_known_support_64": {
    "none": {
      "count": 48,
      "correct": 35,
      "wrong": 0,
      "abstained": 13,
      "rank_correct": 48
    },
    "frozen": {
      "count": 48,
      "correct": 26,
      "wrong": 0,
      "abstained": 22,
      "rank_correct": 35
    },
    "continued": {
      "count": 48,
      "correct": 25,
      "wrong": 0,
      "abstained": 23,
      "rank_correct": 33
    },
    "disrupted": {
      "count": 48,
      "correct": 1,
      "wrong": 0,
      "abstained": 47,
      "rank_correct": 3
    }
  },
  "earlier_unfamiliar": {
    "none": {
      "count": 64,
      "correct": 0,
      "wrong": 0,
      "abstained": 64,
      "rank_correct": 0
    },
    "frozen": {
      "count": 64,
      "correct": 0,
      "wrong": 0,
      "abstained": 64,
      "rank_correct": 0
    },
    "continued": {
      "count": 64,
      "correct": 0,
      "wrong": 0,
      "abstained": 64,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 64,
      "correct": 0,
      "wrong": 1,
      "abstained": 63,
      "rank_correct": 0
    }
  },
  "earlier_unfamiliar_support_12": {
    "none": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "frozen": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "continued": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 1,
      "abstained": 31,
      "rank_correct": 0
    }
  },
  "earlier_unfamiliar_support_64": {
    "none": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "frozen": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "continued": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    },
    "disrupted": {
      "count": 32,
      "correct": 0,
      "wrong": 0,
      "abstained": 32,
      "rank_correct": 0
    }
  }
}
paired source intervals
{
  "earlier_known": {
    "frozen": {
      "sources": 40,
      "mean": 0.020833333333333336,
      "low": -0.0125,
      "high": 0.075
    },
    "none": {
      "sources": 40,
      "mean": -0.1625,
      "low": -0.275,
      "high": -0.06666666666666668
    },
    "disrupted": {
      "sources": 40,
      "mean": 0.5291666666666666,
      "low": 0.3833333333333333,
      "high": 0.6791666666666666
    }
  },
  "earlier_unfamiliar": {
    "frozen": {
      "sources": 16,
      "mean": 0,
      "low": 0,
      "high": 0
    },
    "none": {
      "sources": 16,
      "mean": 0,
      "low": 0,
      "high": 0
    },
    "disrupted": {
      "sources": 16,
      "mean": 0,
      "low": 0,
      "high": 0
    }
  },
  "never_admitted": {
    "frozen": {
      "sources": 16,
      "mean": 0,
      "low": 0,
      "high": 0
    },
    "none": {
      "sources": 16,
      "mean": 0,
      "low": 0,
      "high": 0
    },
    "disrupted": {
      "sources": 16,
      "mean": 0,
      "low": 0,
      "high": 0
    }
  },
  "newly_admitted": {
    "frozen": {
      "sources": 16,
      "mean": 0.09375,
      "low": 0.02083333333333332,
      "high": 0.17708333333333331
    },
    "none": {
      "sources": 16,
      "mean": -0.25,
      "low": -0.3854166666666667,
      "high": -0.13541666666666666
    },
    "disrupted": {
      "sources": 16,
      "mean": 0.45833333333333337,
      "low": 0.30208333333333337,
      "high": 0.6145833333333333
    }
  }
}
checks
{
  "positive_paired_gain": true,
  "no_additional_fresh_wrong": true,
  "no_additional_unfamiliar_wrong": true,
  "no_additional_old_wrong": true,
  "no_additional_old_unfamiliar_wrong": true,
  "no_loss_old_correct": true,
  "better_than_disruption": true,
  "no_individual_old_loss": false,
  "no_new_unfamiliar_false_acceptance": true
}
acquisition benefitFail
competitive with no cleanupFail
uncertainty excludes zeroPass
individual regressions
[
  {
    "index": 1,
    "group": "newly_admitted",
    "source_id": "train2017/000000330614.jpg",
    "support": 24,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 6,
    "group": "newly_admitted",
    "source_id": "train2017/000000208350.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 23,
    "group": "newly_admitted",
    "source_id": "train2017/000000426806.jpg",
    "support": 64,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 30,
    "group": "newly_admitted",
    "source_id": "train2017/000000253094.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 31,
    "group": "newly_admitted",
    "source_id": "train2017/000000253094.jpg",
    "support": 24,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 33,
    "group": "newly_admitted",
    "source_id": "train2017/000000253094.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 34,
    "group": "newly_admitted",
    "source_id": "train2017/000000253094.jpg",
    "support": 24,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 35,
    "group": "newly_admitted",
    "source_id": "train2017/000000253094.jpg",
    "support": 64,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 36,
    "group": "newly_admitted",
    "source_id": "train2017/000000440755.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 37,
    "group": "newly_admitted",
    "source_id": "train2017/000000440755.jpg",
    "support": 24,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 38,
    "group": "newly_admitted",
    "source_id": "train2017/000000440755.jpg",
    "support": 64,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 39,
    "group": "newly_admitted",
    "source_id": "train2017/000000440755.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 40,
    "group": "newly_admitted",
    "source_id": "train2017/000000440755.jpg",
    "support": 24,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 42,
    "group": "newly_admitted",
    "source_id": "train2017/000000233500.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 43,
    "group": "newly_admitted",
    "source_id": "train2017/000000233500.jpg",
    "support": 24,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 45,
    "group": "newly_admitted",
    "source_id": "train2017/000000233500.jpg",
    "support": 12,
    "reference": "frozen",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 45,
    "group": "newly_admitted",
    "source_id": "train2017/000000233500.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 48,
    "group": "newly_admitted",
    "source_id": "train2017/000000423804.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 57,
    "group": "newly_admitted",
    "source_id": "train2017/000000330748.jpg",
    "support": 12,
    "reference": "frozen",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 57,
    "group": "newly_admitted",
    "source_id": "train2017/000000330748.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 66,
    "group": "newly_admitted",
    "source_id": "train2017/000000242039.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 72,
    "group": "newly_admitted",
    "source_id": "train2017/000000018647.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 75,
    "group": "newly_admitted",
    "source_id": "train2017/000000018647.jpg",
    "support": 12,
    "reference": "none",
    "before": "correct",
    "after": "abstained"
  },
  {
    "index": 78,
    "group": "newly_admitted",
    "source_id": "train2017/000000260713.jpg",
    "support": 12,
    "reference": "frozen",
    "before": "correct",
    "after": "abstained"
  },
  {
    "_indexOmission": "19 further items"
  }
]
scopeAcquisition on sixteen new photographs; same-source partial reuse, not pose or semantic transfer

Results and visual artifacts

Open a figure for its input, comparison, and result. Click an image to enlarge it.

Correct recalls, wrong responses and abstentions are shown separately. An unfamiliar photo has no correct remembered owner: abstention is appropriate, while an accepted memory is a false response. This public record includes 5 of 8 saved figures: summary comparisons and fixed examples, including every figure referenced by the guide. Reported aggregates include every case; individual records and complete outputs remain in the research archive.

What each vocabulary condition recalled
What each vocabulary condition recalled
All four conditions and every query group, including wrong responses and abstentions.
Benefit and uncertainty across image sources
Benefit and uncertainty across image sources
Accepted correct-recall differences and whole-source bootstrap intervals from the saved evaluation.
Growth, reuse and additional storage
Growth, reuse and additional storage
Acquisition and occurrence records distinguish creation, within-photo reuse, later-photo reuse and unresolved features; dense episodic storage remains separate.
Fixed cue and actual readbacks: photograph 1
Fixed cue and actual readbacks: photograph 1
Full source photograph is observer truth; the outlined local field is the actual query. Absent responses remain explicit.
What shared pattern IDs refer to
What shared pattern IDs refer to
Actual 22-by-22 encoder inputs assigned the same newly acquired handle across acquisition photographs. Deterministic examples illustrate encoded matches; they do not establish object identity, transfer, or recall usefulness.

Limits and next question

One codec and one append-only acquisition policy. New-photo queries revisit the acquisition images; this is not transfer across pose, scale or independent instances. Added vocabulary and references consume extra storage beside the dense episodic memory.

Next question. Keep no cleanup as the default. Next, test whether patterns acquired from other photographs improve the existing learned memory-only feature-difference readout on independent photographs. Compare the original bank, expanded bank and predicted difference directly, with the codec, fitted readout and background correction held fixed. This comparison has not yet been implemented or evaluated; milestone 1.3 remains open.

Inspect the evidence

Download the methods and measurements for this experiment. Large training and saved-state files are not included.