run record~/research/cliste/runsAll Cliste runs

Type a section name and press Enter. Use “help” for the list.

Figures: softened for dark viewingDisplay only; image files are unchanged.
← All Cliste runs

Cliste experiment

Some learning transfers; large feature gains can yield small image gains

Execution: completedScientific verdict: fixed training development diagnostic complete

The question

Distinguish improvement in the learned feature objective from useful decoded predictions, on training examples and separate development videos.

Why this experiment?

Missing-pixel prediction did not establish coherent construction. Video endpoints provide another concrete question: can a mechanism construct an intermediate scene while using the shared VSA interface?

How it works

Perform no new fitting. Run the frozen models on all 128 training cases and 32 cases from separate development videos, using endpoint-only inputs. Compare each learned output with its matched untrained blend in feature space and decoded images.

Follow this part of the investigation: Which mechanism should construct new visual content? →
Implementation and comparison details

Evaluate the existing fixed constructors and their matching interpolation controls. No weights, inputs, budgets or criteria are tuned in this diagnostic.

What happened

Original-feature transport lowers training image error 6.09% but raises development error 5.14%. Recovered synthesis lowers training feature error 32.06%, mostly in the coarse overview, while image error improves about 1% on both training and development. The audit passed all 960 comparisons. Fixed-panel visual review finds recognizable scenes and persistent blur or overlapping moving contours, not consistently coherent middle frames.

Results and visual artifacts

Open a figure for its input, comparison, and result. Click an image to enlarge it.

Nine images per case: supplied endpoints and the true middle, then recovered-feature interpolation/transport/synthesis, then original-feature interpolation/transport/synthesis. Only frozen first/last chronological cases per source are pictured; all cases are measured. Training/development labels stay visible. The middle is observer-only during prediction. This public record includes 2 of 18 saved figures: summary comparisons and fixed examples, including every figure referenced by the guide. Reported aggregates include every case; individual records and complete outputs remain in the research archive.

Development video: separate from constructor training: development-0142
Development video: separate from constructor training: development-0142
Prospectively selected first/last chronological case from its source. Top: endpoints and true middle; middle: recovered-feature control and fixed predictors; bottom: privileged original-feature control and fixed predictors.
Training video: previously used for learning: train-0047
Training video: previously used for learning: train-0047
Prospectively selected first/last chronological case from its source. Top: endpoints and true middle; middle: recovered-feature control and fixed predictors; bottom: privileged original-feature control and fixed predictors.

Limits and next question

Training examples were previously used for learning. Development videos are separate from constructor training but are existing diagnostic data, not a fresh test set. Original encoder features are privileged inputs. Feature error is not image quality or coherence; low error on dark or static regions is not temporal understanding. All outputs pass through VSA before the frozen renderer.

Next question. Compare a learning objective tied to useful output with the existing feature-only objective on the same broader data and frozen output path, using matched learned arms and unexamined source videos. No further fit begins automatically.

Inspect the evidence

Download the methods and measurements for this experiment. Large training and saved-state files are not included.