run record~/research/cliste/runsAll Cliste runs

Type a section name and press Enter. Use “help” for the list.

Figures: softened for dark viewingDisplay only; image files are unchanged.
← All Cliste runs

Cliste experiment

Can patterns from other photographs improve remembered operations?

Execution: completedScientific verdict: no supported expanded advantage

The question

Test useful transfer of an acquired visual vocabulary at the existing learned memory readout.

Why this experiment?

Patterns acquired from one set of photographs need to help with different photographs. This separates reuse from simply matching the material that created the bank.

How it works

On fresh photographs, run the same learned memory readout with either pattern bank, direct prediction or disrupted selection. Decode every supplied exchange and compare both average error and individual regressions.

Follow this part of the investigation: Test acquired patterns on independent photographs →
Implementation and comparison details

Admit sixteen fresh photographs without vocabulary acquisition, then compare the original bank, expanded bank, direct predicted difference, disrupted pattern content and unchanged memory across 64 supplied exchanges. All conditions use the same frozen readout and original background correction.

What happened

The independent audit passed. Expanded selection improved 26 of 64 exchanges, worsened one and left 37 unchanged; the original bank had the same counts. Expansion reduced mean error by 1.1%, but the whole-photograph uncertainty interval crossed zero. Direct prediction improved 52 exchanges and reduced mean error by 74.8% relative to expanded selection, while worsening 12 requests. Earlier behavior survived: 44 correct recalls, 31 successful replay anchors and 32 exact editing sequences. The formal result is no established expanded-bank advantage.

Measurements
Measurements — values preserved from this run
Recorded fieldValue
operations64
sources16
engineering passedPass
arms
{
  "baseline": {
    "mean_error": 0.0006936407036675822,
    "improved_operations": 0,
    "improved_sources": 0,
    "worsened_operations": 0,
    "unchanged_operations": 64,
    "harmful_operations": 0,
    "severe_operations": 0,
    "positive_excess_error": 0,
    "maximum_absolute_increase": 0,
    "mean_edge_error": 0.00020192961240838848,
    "edge": {
      "mean_error": 0.00020192961240838848,
      "improved_operations": 0,
      "improved_sources": 0,
      "worsened_operations": 0,
      "unchanged_operations": 64,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0,
      "maximum_absolute_increase": 0
    },
    "nontrivial_operations": 0,
    "nontrivial_sources": 0
  },
  "original": {
    "mean_error": 0.00016057906465253343,
    "improved_operations": 26,
    "improved_sources": 13,
    "worsened_operations": 1,
    "unchanged_operations": 37,
    "harmful_operations": 0,
    "severe_operations": 0,
    "positive_excess_error": 0.00002092958157452499,
    "maximum_absolute_increase": 0.00002092958157452499,
    "mean_edge_error": 0.00009304733934219544,
    "edge": {
      "mean_error": 0.00009304733934219544,
      "improved_operations": 25,
      "improved_sources": 13,
      "worsened_operations": 2,
      "unchanged_operations": 37,
      "harmful_operations": 2,
      "severe_operations": 0,
      "positive_excess_error": 0.00004722225724027482,
      "maximum_absolute_increase": 0.000036484640730113536
    },
    "nontrivial_operations": 27,
    "nontrivial_sources": 13
  },
  "expanded": {
    "mean_error": 0.0001587685552539916,
    "improved_operations": 26,
    "improved_sources": 13,
    "worsened_operations": 1,
    "unchanged_operations": 37,
    "harmful_operations": 0,
    "severe_operations": 0,
    "positive_excess_error": 0.00002092958157452499,
    "maximum_absolute_increase": 0.00002092958157452499,
    "mean_edge_error": 0.00009199173234515953,
    "edge": {
      "mean_error": 0.00009199173234515953,
      "improved_operations": 25,
      "improved_sources": 13,
      "worsened_operations": 2,
      "unchanged_operations": 37,
      "harmful_operations": 2,
      "severe_operations": 0,
      "positive_excess_error": 0.00004722225724027482,
      "maximum_absolute_increase": 0.000036484640730113536
    },
    "nontrivial_operations": 27,
    "nontrivial_sources": 13
  },
  "direct": {
    "mean_error": 0.00004001626130374118,
    "improved_operations": 52,
    "improved_sources": 16,
    "worsened_operations": 12,
    "unchanged_operations": 0,
    "harmful_operations": 11,
    "severe_operations": 8,
    "positive_excess_error": 0.00019662815200410547,
    "maximum_absolute_increase": 0.00012554196120027558,
    "mean_edge_error": 0.000027695927769023623,
    "edge": {
      "mean_error": 0.000027695927769023623,
      "improved_operations": 49,
      "improved_sources": 16,
      "worsened_operations": 15,
      "unchanged_operations": 0,
      "harmful_operations": 13,
      "severe_operations": 11,
      "positive_excess_error": 0.00008493320770678715,
      "maximum_absolute_increase": 0.00004673988575317433
    },
    "nontrivial_operations": 64,
    "nontrivial_sources": 16
  },
  "disrupted": {
    "mean_error": 0.0008197525235924705,
    "improved_operations": 7,
    "improved_sources": 6,
    "worsened_operations": 20,
    "unchanged_operations": 37,
    "harmful_operations": 19,
    "severe_operations": 7,
    "positive_excess_error": 0.011176461764081784,
    "maximum_absolute_increase": 0.0014015975757732857,
    "mean_edge_error": 0.00031771682846582644,
    "edge": {
      "mean_error": 0.00031771682846582644,
      "improved_operations": 1,
      "improved_sources": 1,
      "worsened_operations": 26,
      "unchanged_operations": 37,
      "harmful_operations": 24,
      "severe_operations": 13,
      "positive_excess_error": 0.007449474687062842,
      "maximum_absolute_increase": 0.0009890631230037414
    },
    "nontrivial_operations": 27,
    "nontrivial_sources": 13
  }
}
appended use
{
  "operations": 8,
  "sources": 6,
  "improved_operations": 8,
  "improved_sources": 6,
  "improved_over_original_operations": 5,
  "improved_over_original_sources": 3,
  "indices": [
    0,
    1,
    2,
    5,
    9,
    16,
    38,
    48
  ]
}
contrasts
{
  "original_minus_expanded": {
    "mean": 0.000001810509398541825,
    "bootstrap_interval": [
      -0.00000678980073410534,
      0.00001303991778717905
    ],
    "source_means": [
      0.00007055030504524214,
      0.0000034492376154771757,
      -0.000003848163012070072,
      0,
      -0.000036212270581895145,
      0,
      0,
      0,
      0,
      0.0000049458130274093135,
      0,
      0,
      -0.00000991677171749421,
      0,
      0,
      0
    ]
  },
  "direct_minus_expanded": {
    "mean": -0.00011875229395025042,
    "bootstrap_interval": [
      -0.00016842689601929937,
      -0.00007521282167060701
    ],
    "source_means": [
      -0.00013058307283505478,
      -0.000022962114114977624,
      -0.00023187273385690484,
      -0.00003448085000241802,
      -0.00016721499830706346,
      -0.00006325281607886732,
      -0.000023510487664600982,
      -0.0003656870289178799,
      -0.000008990805983492353,
      -0.00013617526306880214,
      -0.00005483469426756321,
      -0.00023010287830880257,
      -0.00007791009435150873,
      -0.00018646174200426832,
      -0.0000706549743154973,
      -0.00009534214912630512
    ]
  },
  "disrupted_minus_expanded": {
    "mean": 0.0006609839683384788,
    "bootstrap_interval": [
      0.0003584654787260152,
      0.000998131363613391
    ],
    "source_means": [
      0.0019501582662242568,
      0.00017292682078929043,
      0.0002992241497667929,
      0.00020238314910613907,
      0.0004199557710745616,
      0.0017118304703455187,
      0.0010958563626464572,
      0.001475465235654821,
      0.00003133462675462758,
      0.0005389912020400633,
      0,
      0.0005301299672263153,
      0.0015795750250344597,
      0.0005679124467523584,
      0,
      0
    ]
  },
  "baseline_minus_expanded": {
    "mean": 0.0005348721484135907,
    "bootstrap_interval": [
      0.00024610420380818834,
      0.0008729805517770983
    ],
    "source_means": [
      0.0012777676918303428,
      0.00012130044204877503,
      0.0001572833030402969,
      0.00011441310190542726,
      0.0001882024259630344,
      0.0020339389115267906,
      0.0009137493660588614,
      0.001131683997930249,
      0.00001754572011531756,
      0.0006746681081191446,
      0,
      0.00010706434111594862,
      0.0015936053250789274,
      0.0002267316398843351,
      0,
      0
    ]
  }
}
edge contrasts
{
  "original_minus_expanded": {
    "mean": 0.0000010556069970359275,
    "bootstrap_interval": [
      -0.0000033566988014414386,
      0.000007862129691962832
    ],
    "source_means": [
      0.00004591483764178563,
      0.0000012105015729779587,
      -0.000002323752247645788,
      0,
      -0.000010837187179283756,
      0,
      0,
      0,
      0,
      -0.000010306518596609225,
      0,
      0,
      -0.000006768169238649984,
      0,
      0,
      0
    ]
  },
  "direct_minus_expanded": {
    "mean": -0.0000642958045761359,
    "bootstrap_interval": [
      -0.00010047541135036113,
      -0.00003571986053135564
    ],
    "source_means": [
      -0.00008953922508670891,
      -0.000007660476242390866,
      -0.00005932325490157883,
      -0.000018368988100042,
      -0.0001078731354299082,
      -0.000037026956958277385,
      -0.00003312789849627908,
      -0.000271913619288023,
      -0.0000032942629304280866,
      -0.00005460950183549317,
      -0.000013911155588266493,
      -0.00013057229265411825,
      -0.00005298018067423215,
      -0.00011308001673985732,
      -0.00002784131649478854,
      -0.000007610591797782138
    ]
  }
}
criteria
{
  "engineering": true,
  "improves_mean_rgb": true,
  "useful_coverage": true,
  "provisional_rgb_harm": true
}
supported expanded gainFail
useful candidatePass
value beyond directFail
disruption supportedPass
strata
{
  "held_seen": {
    "baseline": {
      "mean_error": 0.0010549226490038466,
      "improved_operations": 0,
      "improved_sources": 0,
      "worsened_operations": 0,
      "unchanged_operations": 32,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0,
      "maximum_absolute_increase": 0
    },
    "original": {
      "mean_error": 0.0001986189592421618,
      "improved_operations": 17,
      "improved_sources": 12,
      "worsened_operations": 0,
      "unchanged_operations": 15,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0,
      "maximum_absolute_increase": 0
    },
    "expanded": {
      "mean_error": 0.00019949219907966351,
      "improved_operations": 17,
      "improved_sources": 12,
      "worsened_operations": 0,
      "unchanged_operations": 15,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0,
      "maximum_absolute_increase": 0
    },
    "direct": {
      "mean_error": 0.000046505117631187264,
      "improved_operations": 27,
      "improved_sources": 16,
      "worsened_operations": 5,
      "unchanged_operations": 0,
      "harmful_operations": 4,
      "severe_operations": 3,
      "positive_excess_error": 0.00003488832614451719,
      "maximum_absolute_increase": 0.000011802035306237571
    },
    "disrupted": {
      "mean_error": 0.001170648280413252,
      "improved_operations": 6,
      "improved_sources": 6,
      "worsened_operations": 11,
      "unchanged_operations": 15,
      "harmful_operations": 10,
      "severe_operations": 3,
      "positive_excess_error": 0.006732872243627883,
      "maximum_absolute_increase": 0.0014015975757732857
    }
  },
  "reserved": {
    "baseline": {
      "mean_error": 0.0003323587583313179,
      "improved_operations": 0,
      "improved_sources": 0,
      "worsened_operations": 0,
      "unchanged_operations": 32,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0,
      "maximum_absolute_increase": 0
    },
    "original": {
      "mean_error": 0.00012253917006290504,
      "improved_operations": 9,
      "improved_sources": 7,
      "worsened_operations": 1,
      "unchanged_operations": 22,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0.00002092958157452499,
      "maximum_absolute_increase": 0.00002092958157452499
    },
    "expanded": {
      "mean_error": 0.00011804491142831964,
      "improved_operations": 9,
      "improved_sources": 7,
      "worsened_operations": 1,
      "unchanged_operations": 22,
      "harmful_operations": 0,
      "severe_operations": 0,
      "positive_excess_error": 0.00002092958157452499,
      "maximum_absolute_increase": 0.00002092958157452499
    },
    "direct": {
      "mean_error": 0.0000335274049762951,
      "improved_operations": 25,
      "improved_sources": 16,
      "worsened_operations": 7,
      "unchanged_operations": 0,
      "harmful_operations": 7,
      "severe_operations": 5,
      "positive_excess_error": 0.00016173982585958828,
      "maximum_absolute_increase": 0.00012554196120027558
    },
    "disrupted": {
      "mean_error": 0.00046885676677168903,
      "improved_operations": 1,
      "improved_sources": 1,
      "worsened_operations": 9,
      "unchanged_operations": 22,
      "harmful_operations": 9,
      "severe_operations": 4,
      "positive_excess_error": 0.004443589520453903,
      "maximum_absolute_increase": 0.0011613627187880729
    }
  }
}
individual regressions
[
  {
    "index": 0,
    "source_index": 0,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.00008276975352044142,
    "after": 0.0002539076268132487,
    "absolute_increase": 0.0001711378732928073,
    "ratio_with_floor": 3.0676378267882827
  },
  {
    "index": 0,
    "source_index": 0,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "edge",
    "before": 0.00003705552680713867,
    "after": 0.00014799158760940467,
    "absolute_increase": 0.000110936060802266,
    "ratio_with_floor": 3.9937790759162657
  },
  {
    "index": 1,
    "source_index": 0,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "mse",
    "before": 0.00005001861713247089,
    "after": 0.0002002716305282135,
    "absolute_increase": 0.00015025301339574264,
    "ratio_with_floor": 4.003941772276667
  },
  {
    "index": 1,
    "source_index": 0,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "edge",
    "before": 0.000041735416817163405,
    "after": 0.0001308248038072453,
    "absolute_increase": 0.0000890893869900819,
    "ratio_with_floor": 3.134623151851319
  },
  {
    "index": 2,
    "source_index": 0,
    "stratum": "held_seen",
    "reference": "original",
    "measure": "edge",
    "before": 0.000262007781960231,
    "after": 0.00028631219440002987,
    "absolute_increase": 0.00002430441243979884,
    "ratio_with_floor": 1.0927621777413004
  },
  {
    "index": 2,
    "source_index": 0,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.0002656751267103582,
    "after": 0.00045355545950730034,
    "absolute_increase": 0.00018788033279694215,
    "ratio_with_floor": 1.707180740339954
  },
  {
    "index": 2,
    "source_index": 0,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "edge",
    "before": 0.0001137472426422629,
    "after": 0.00028631219440002987,
    "absolute_increase": 0.00017256495175776697,
    "ratio_with_floor": 2.5170912960104608
  },
  {
    "index": 3,
    "source_index": 0,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "mse",
    "before": 0.00004707733522131241,
    "after": 0.0000601384070760394,
    "absolute_increase": 0.000013061071854726991,
    "ratio_with_floor": 1.2774386399171995
  },
  {
    "index": 4,
    "source_index": 1,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.00004451933482296378,
    "after": 0.00010685323125061176,
    "absolute_increase": 0.00006233389642764799,
    "ratio_with_floor": 2.4001533642747774
  },
  {
    "index": 4,
    "source_index": 1,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "edge",
    "before": 0.00001815939945393653,
    "after": 0.00004455303085190922,
    "absolute_increase": 0.000026393631397972693,
    "ratio_with_floor": 2.453441864359186
  },
  {
    "index": 5,
    "source_index": 1,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "mse",
    "before": 0.00001373721858925054,
    "after": 0.000045289471903670064,
    "absolute_increase": 0.00003155225331441952,
    "ratio_with_floor": 3.296844380063178
  },
  {
    "index": 5,
    "source_index": 1,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "edge",
    "before": 0.00000920193381355866,
    "after": 0.00001703307954330183,
    "absolute_increase": 0.00000783114572974317,
    "ratio_with_floor": 1.8510326077551555
  },
  {
    "index": 6,
    "source_index": 1,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.000004897471577943445,
    "after": 0.0000050333627650942065,
    "absolute_increase": 1.3589118715076188e-7,
    "ratio_with_floor": 1.02774721302371
  },
  {
    "index": 8,
    "source_index": 2,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.000051302339294607897,
    "after": 0.0008288527295624691,
    "absolute_increase": 0.0007775503902678612,
    "ratio_with_floor": 16.15623655683056
  },
  {
    "index": 8,
    "source_index": 2,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "edge",
    "before": 0.000020351530626721885,
    "after": 0.00018735143182255744,
    "absolute_increase": 0.00016699990119583557,
    "ratio_with_floor": 9.205766153851938
  },
  {
    "index": 9,
    "source_index": 2,
    "stratum": "reserved",
    "reference": "original",
    "measure": "mse",
    "before": 0.00005904291060095261,
    "after": 0.0000744355626492329,
    "absolute_increase": 0.00001539265204828029,
    "ratio_with_floor": 1.260702798889998
  },
  {
    "index": 9,
    "source_index": 2,
    "stratum": "reserved",
    "reference": "original",
    "measure": "edge",
    "before": 0.00004815752587005343,
    "after": 0.00005745253486063658,
    "absolute_increase": 0.000009295008990583151,
    "ratio_with_floor": 1.1930125940370042
  },
  {
    "index": 9,
    "source_index": 2,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "mse",
    "before": 0.00001054132045528532,
    "after": 0.0000744355626492329,
    "absolute_increase": 0.00006389424219394758,
    "ratio_with_floor": 7.06131295078043
  },
  {
    "index": 9,
    "source_index": 2,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "edge",
    "before": 0.00000897422103192879,
    "after": 0.00005745253486063658,
    "absolute_increase": 0.00004847831382870779,
    "ratio_with_floor": 6.4019522871377905
  },
  {
    "index": 10,
    "source_index": 2,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.000012656305170386185,
    "after": 0.00009425059642336375,
    "absolute_increase": 0.00008159429125297756,
    "ratio_with_floor": 7.446928242841024
  },
  {
    "index": 10,
    "source_index": 2,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "edge",
    "before": 0.0000067619202009992965,
    "after": 0.00003016134249667,
    "absolute_increase": 0.000023399422295670703,
    "ratio_with_floor": 4.460470044028717
  },
  {
    "index": 11,
    "source_index": 2,
    "stratum": "reserved",
    "reference": "direct",
    "measure": "mse",
    "before": 0.000010482124667917097,
    "after": 0.00001493413638075006,
    "absolute_increase": 0.000004452011712832965,
    "ratio_with_floor": 1.424724171279831
  },
  {
    "index": 12,
    "source_index": 3,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "mse",
    "before": 0.000013668691000090228,
    "after": 0.00005705461347677018,
    "absolute_increase": 0.00004338592247667995,
    "ratio_with_floor": 4.174109538096483
  },
  {
    "index": 12,
    "source_index": 3,
    "stratum": "held_seen",
    "reference": "direct",
    "measure": "edge",
    "before": 0.000010119552697755883,
    "after": 0.000030928126777664226,
    "absolute_increase": 0.00002080857407990834,
    "ratio_with_floor": 3.0562740964353945
  },
  {
    "_indexOmission": "87 further items"
  }
]
bootstrap
{
  "samples": 10000,
  "seed": 20261010,
  "unit": "source",
  "confidence": 0.95
}
harm rule
{
  "relative_increase": 0.1,
  "permitted_harmful_operations": 4,
  "severe_ratio": 2,
  "permitted_severe_operations": 0,
  "denominator_floor": 1e-8,
  "scope": "Regional RGB only; edge harms are reported separately"
}

Results and visual artifacts

Open a figure for its input, comparison, and result. Click an image to enlarge it.

Lower error means closer to the requested clean-feature exchange, not closer to the unchanged source photograph. The operation moves overlapping feature contributions, not rectangular image cutouts. All requests remain in the aggregate comparisons. This public record includes 3 of 6 saved figures: summary comparisons and fixed examples, including every figure referenced by the guide. Reported aggregates include every case; individual records and complete outputs remain in the research archive.

What the acquired vocabulary changed
What the acquired vocabulary changed
All operation outcomes and mean errors; newly acquired handle use is distinct from useful decoded change.
Gain, usefulness and the direct-prediction comparison
Gain, usefulness and the direct-prediction comparison
Whole-photograph uncertainty separates original-bank improvement from added value beyond direct prediction.
Fixed exchange from photograph 1
Fixed exchange from photograph 1
Source context, exact-feature reference and all actual operation arms. Example selection was fixed before evaluation.

Limits and next question

One frozen codec and readout; supplied feature positions and exchanges. The photographs are independent of recorded acquisition and fitting, but this does not establish object recognition, autonomous goals or pose invariance. Regional targets use observer-only clean features through the same decoder. The original runtime path remains unchanged.

Next question. Proposed under milestone 1.3: test whether fixed acquired patterns preserve useful distinctions across placement, rotation, scale and context, and avoid harmful joins. Use independent correspondences and downstream partial recall with a no-cleanup baseline to guide refinement and consolidation. This next study is not implemented or evaluated; existing defaults remain.

Inspect the evidence

Download the methods and measurements for this experiment. Large training and saved-state files are not included.