Compression & memory · Research & Algorithms

Discard the measurements, change the prior, reconstruct again

Discarding raw observations need not freeze the first reconstruction. But the future questions that remain answerable depend on exactly what was retained.

A retained quadratic objective supports a changed reconstruction priorMeasured samples become a fixed data term. That term branches to a smoothness prior and a total-variation prior within a shared coefficient space.REUSABLE INFERENCE INTERFACEmeasured samples½cᵀGc − bᵀcsmoothness priorTV priorthe data term stays fixed; the reconstruction choice changes
Illustrative information-flow map. The archived CT experiment keeps the measured scan inside the article; this cover distinguishes the reusable-objective idea from the separate reconstruction comparison.

Follow the information

From input to outcome

The recipient can change the prior while preserving the data term in the retained space. It cannot infer correlations with a genuinely new measurement direction from statistics that never recorded them.

Scroll the diagram horizontally to follow the route. Keyboard: focus the diagram, then use the arrow keys.

Linear observations y → Form quadratic evidence → Retain / transmit summary → Recipient reconstruction → New reconstructed field. The recipient can change the prior while preserving the data term in the retained space. It cannot infer correlations with a genuinely new measurement direction from statistics that never recorded them.
Information-flow map. The scalar yᵀy is needed for absolute objective values, not the minimizer. Original vector schematic based on the method and evidence discussed in this article; signal shapes and icons are illustrative, not additional measurements. Open full-size diagram ↗

Read the main route from left to right; labelled side branches show additional inputs, checks or feedback. The sections below explain the operations and their experimental limits.

Keep a problem, not only its first answer

A scan may initially be reconstructed with a smoothness prior and later need an edge-preserving prior. If a fixed linear measurement model and squared loss remain appropriate, its normal matrix and right-hand side retain the data-dependent part of both problems. The recipient can change the prior without receiving the original measurements again.

A recipient can change the prior, not the past

The donor sends the quadratic data term in a fixed measurement space. The recipient can later prefer smoothness, impose positivity, or use a different prior without receiving the raw observations again. The measurement model and its coefficient space remain shared. Absolute likelihood-like values additionally need the discarded constant term.

Now imagine adding a feature outside that measurement span. Two original records can agree on every transmitted statistic and disagree on the correlation with that new feature. No decoder can tell them apart. Exact spline refinement preserves an old reconstructed function; it does not restore the unmeasured directions of its fitting evidence.

What crosses the measurement boundary?
What crosses the measurement boundary?. Original scientific diagram; the stated component and information flow, not an additional experiment. Open full-size figure ↗

The identity is simple and powerful

Expanding the squared residual produces a quadratic form, a linear term, and a constant. The first two determine the minimizer for any later prior in that same coefficient space. The constant is needed for absolute objective values. This is classical least-squares sufficiency, not a new privacy guarantee or arbitrary compression of a sensor history.

12∥Hc−y∥2+R(c)=12cT(HTH)c−(HTy)Tc+R(c)+constant\begin{gathered}\tfrac12\|Hc-y\|^2+R(c)=\tfrac12c^T(H^TH)c-(H^Ty)^Tc+R(c)+\text{constant}\end{gathered}
Changing R preserves this data term only while H and its coefficient space remain fixed.

A model can carry the same information

If the recipient knows the donor’s normal matrix and regularizer, an invertible regularized fit can be multiplied back to recover its right-hand side. Fitted coefficients and explicit statistics can therefore be information-equivalent messages. Comparing pooled statistics only with a naive average of predictions would create an artificially weak baseline.

New coordinates can require new evidence

Suppose a new feature has a component outside the old measurement span. Two observation vectors can agree on every old statistic and differ on the new one. No deterministic decoder can know which new value is correct. Refining a spline can preserve the old function perfectly while still lacking historical information for the new degrees of freedom.

A memory of answerable future questions

This is a precise form of reusable scientific memory. It is valuable when future questions are known well enough to define the retained space. The walnut experiment also shows why that capability should not be confused with a unique spline codec: matched model messages and ordinary cosine spaces can retain the same kind of information.

The experiment confirms the boundary, not a compression win

The walnut study reproduces fixed-space reconstructions closely from retained statistics, including a nonlinear TV prior. But its spline messages lose to matched cosines and quantized raw controls. The enduring result is an explicit interface: what can be revised, which matrices are shared, and which future changes need additional measurements or richer retained information.

Evidence & further reading

The links below distinguish the project record from foundational literature. This revised story does not add a new application-validation experiment.

  1. Measured inspection-memory admission and information boundaries. Daniel Schmitter (2026). Local archive snapshot.
  2. PASS-GLM: polynomial approximate sufficient statistics for scalable Bayesian GLM inference. Jonathan H. Huggins, Ryan P. Adams and Tamara Broderick (2017). Primary literature.
  3. An Inner-Product Calculus for Periodic Functions and Curves. Anaïs Badoual, Daniel Schmitter and Michael Unser (2016). Primary literature.