Scientific ML · Research & Algorithms

Better coordinates or a bigger network?

A model cannot learn information its inputs erase. Sometimes the decisive architectural change is to expose the right state, not add more parameters.

EXPLORE THE IDEA

One position. Two futures.

Velocity separates states that a snapshot merges.

POSITION VIEWEqual now does not mean equal nextv = +1v = −1Time from crossing 0.00STATE VIEWPosition × velocitypositionvelocityThe two trajectories remain distinct in state
50%
Computed free-motion example: x₁(t)=t and x₂(t)=−t. The position view merges the two at t=0; the phase portrait keeps their velocities distinct. No measured robot data is implied.

Follow the information

From input to outcome

Recent commands leave different traces even when the current command is identical. Those state coordinates allow the readout to distinguish histories that a memoryless function merges. The time constants are supplied, not discovered physical truth.

Scroll the diagram horizontally to follow the route. Keyboard: focus the diagram, then use the arrow keys.

Command history → Exponential traces → Physical state features → Fitted readout → Future response. Recent commands leave different traces even when the current command is identical. Those state coordinates allow the readout to distinguish histories that a memoryless function merges. The time constants are supplied, not discovered physical truth.
Information-flow map. Memory ablation helped on the named panel; generic spline capacity did not. Original vector schematic based on the method and evidence discussed in this article; signal shapes and icons are illustrative, not additional measurements. Open full-size diagram ↗

Read the main route from left to right; labelled side branches show additional inputs, checks or feedback. The sections below explain the operations and their experimental limits.

The same snapshot can have two futures

A mass passing a point from the left and the same mass passing from the right share a position but not a state. No deterministic position-only predictor can give both correct next positions. Adding more units to that predictor does not recover the missing velocity. History, a measurement, or a justified state estimator must supply the distinction.

xt(1)=xt(2),vt(1)≠vt(2) ⟹ xt+Δt(1)≠xt+Δt(2)\begin{gathered}x_t^{(1)}=x_t^{(2)},\quad v_t^{(1)}\ne v_t^{(2)}\ \Longrightarrow\ x_{t+\Delta t}^{(1)}\ne x_{t+\Delta t}^{(2)}\end{gathered}
For locally free motion, equal position does not determine the future. A representation must retain the state relevant to its prediction.

What the readout cannot infer from a snapshot

A compact head receives only the information its state exposes. If two command histories produce the same instantaneous input but different actuator conditions, a memoryless head cannot distinguish them regardless of how many spline coefficients it stores. An exponential trace gives the head a coordinate describing the recent command history at a particular time scale. Several traces expose several scales.

The drone program uses six held-input recurrences with time constants from 0.02 to 1 second. Their state joins physical rotor mixtures and kinematic features before direct horizon readout. This is a supplied representation of possible memory, followed by fitted coefficients; it is not a claim that the exact physical time constants were discovered.

Compress the state, then fit the response
Compress the state, then fit the response. Original scientific diagram; the stated component and information flow, not an additional experiment. Open full-size figure ↗

Memory can be a physical coordinate

A first-order actuator state summarizes how recent commands are still affecting force. Several stable exponential states offer different time scales. Their recurrence has an exact solution for held input; learning can focus on how the state relates to the measured output. This is not a proof that a small bank is sufficient for every physical system. It is a way to make the memory assumption inspectable.

The ablation tells us what mattered

In the nano-drone archive, removing exponential-memory columns worsens the score from 0.41192 to 0.52886. Removing a much larger set of generic cardinal horizon/state/input columns instead improves it to 0.39438. Within that exposed panel, physical memory contributes more than broad spline capacity. This is a specific ablation, not a universal argument against flexible networks.

A teacher can help choose the coordinates

The aircraft compiler inherits response directions from a neural teacher but replaces its feedback history with a stable carrier. This combination approaches the teacher’s measured accuracy using fewer deployment arrays. The teacher’s computation remains part of acquisition cost. Distillation can be valuable precisely because learning and deployment have different budgets.

Give the learner a state it can use

This offers a useful design test for small ML models: before enlarging the readout, ask whether the hidden physical state is observable in its inputs. The ablation makes that question concrete. Removing memory hurt; removing broad generic spline features helped in the named panel. The right state can be more valuable than a larger function approximator.

The architectural question to ask first

What histories are indistinguishable to this model, and can they require different answers? That question precedes optimizer tuning. If the representation merges decision-relevant states, the experiment needs more information or a different state construction. If the representation is adequate, exact calculus and efficient fitting can then make its use cheaper.

Evidence & further reading

The links below distinguish the project record from foundational literature. This revised story does not add a new application-validation experiment.

  1. Consolidated research results, including constitutive edges and continual memory. Daniel Schmitter (2026). Local archive snapshot.
  2. Experiment-family evidence map. Spline research archive (2026). Local archive snapshot.
  3. Consolidated limitations and research boundaries. Daniel Schmitter (2026). Local archive snapshot.