All field notes

Published field note · Research note

· 5 min read

A 50 Hz action stream is not a 50 Hz control loop

A robot can receive targets at 50 Hz while observation, replanning, and local stabilization run on different clocks with different authority.

Relay, a fictional mobile manipulator in a workshop tool crib, is reaching for a blue torque wrench. Its policy returns one second of wrist targets spaced 20 milliseconds apart. The dashboard calls this “50 Hz control.” Then the next policy request stalls for 280 milliseconds while the arm continues moving. The rate label has hidden the operational question: which component is still observing the arm and correcting its motion during that stall?

Three clocks are active. Relay’s camera and policy produce a new observation-conditioned plan when inference completes. The returned chunk contains targets at a regular spacing. A local servo reads joint state and updates the actuator command much faster. Only now do the terms help: observation/replanning cadence is how often the policy incorporates new evidence; generated target cadence is the spacing of samples inside its proposed trajectory; servo cadence is how often the local controller measures error and changes its command.

Three robot clocks with separate feedback authorityRead three horizontally aligned timelines from left to right. The top OBSERVE/PLAN row has sparse, uneven observation markers and a visibly delayed planning interval. The middle ACTION TARGETS row contains evenly spaced target marks at 20-millisecond intervals, including targets already buffered while planning jitters. The bottom LOCAL SERVO row contains a much denser uninterrupted sequence of local ticks. Vertical connectors show that one plan can generate many targets and each target can be tracked by many servo updates. A coral validity boundary stops old targets, and a lime conclusion states that rate labels do not transfer authority between loops.THREE CLOCKS / THREE AUTHORITIESOBSERVE / PLANACTION TARGETSLOCAL SERVOJITTER / STALL20 ms TARGET SPACING / 50 HzVALIDITY BOUNDARYRATE LABELS DO NOT TRANSFER AUTHORITY BETWEEN LOOPS
Jittering observation and planning can replenish 50 Hz action targets while a faster local servo continues; target spacing does not transfer feedback authority between loops.

Those clocks can have the same nominal number and still differ in timing, inputs, and authority. They can also have different numbers without conflict. A policy may observe at 10 Hz, generate 50 Hz targets, and feed a 1 kHz servo. During a 300-millisecond inference stall, that servo still runs about 300 updates. It can track the last admitted target, interpolate between targets, or enter a local fallback when the chunk expires. It cannot manufacture a fresh scene observation for the policy.

What the rate label leaves out

The distinction is visible in the hardware studied by the ACT paper at Robotics: Science and Systems 2023. The ALOHA system sent joint targets to follower robots at 50 Hz while proprietary actuator PID controllers tracked position at more than 1 kHz. ACT then predicted multi-step joint-action chunks and temporally combined overlapping predictions. The paper reports results on six ALOHA manipulation tasks; it does not turn the learned policy into the actuator PID loop or certify either path for production control.

Action chunking changes where commitment sits. A longer chunk gives Relay useful motion to execute while the next inference runs, which can hide average inference latency. It also means more future targets were chosen from an older observation. Temporal ensembling can smooth overlapping predictions, but smoothness does not establish freshness, stability, or physical admissibility. Relay still needs a local rule for how much of a chunk may execute, when it expires, and what happens when no replacement arrives.

The SmolVLA preprint makes this separation explicit in software: it describes a roughly 450-million-parameter flow-matching vision-language-action model with an asynchronous inference stack that decouples perception and action prediction from chunk execution. The authors report training on one GPU and deployment paths for consumer GPUs or CPUs. That supports the feasibility of letting execution continue while a compact model generates the next chunk. As a frontier preprint, it does not establish hard real-time deadlines, a stability proof, or production safety.

The practical test is to inspect what each clock reads and writes. If the 50 Hz producer emits precomputed position targets but does not see new joint or scene state between them, it is an action stream at that cadence, not a 50 Hz closed-loop stabilizing controller. The local servo may close a joint-error loop around those targets, but that does not transfer its feedback authority upward. A perfectly stable servo can track a stale or geometrically wrong target.

A credible countercase is a small, fully local policy that truly observes current state, replans, and produces the actuator command every 20 milliseconds with measured worst-case completion inside that period. For a slow, low-inertia mechanism, that may legitimately be the relevant 50 Hz feedback loop. Even there, motor-current regulation, protective limits, and watchdog behavior may remain faster and separate. The correct conclusion comes from the measured feedback path, not the model’s output tensor shape.

What this does not prove

This note does not prove that action chunks are unsafe, that 50 Hz is too slow, that a faster servo can rescue a bad target, or that ACT or SmolVLA generalizes beyond its reported tasks and hardware. It proposes a book-synthesis diagnostic for Relay: record observation age, replan completion, target time, servo tick, chunk expiry, and rejection reason as separate events. The three timelines should remain separate because rate labels do not transfer authority between loops.

Which two clocks in your current robot stack are most often collapsed into one rate label, and what failure does that hide?

Open question

What I'm testing

Which two clocks in your current robot stack are most often collapsed into one rate label, and what failure does that hide?

Evidence boundary

Sources and boundaries

A linked source supports only its named role below. This note connects and tests ideas; the note itself is not evidence.

  • empirical study
    ACT, Robotics: Science and Systems 2023

    Studies action chunking and temporal ensembling on six ALOHA tasks; it supports the mechanism but does not guarantee production control timing, safety, or transfer to arbitrary robots.

  • frontier preprint
    SmolVLA preprint

    Describes a roughly 450M flow-matching VLA and asynchronous chunk generation/execution on consumer hardware; it does not establish hard real-time deadlines or production safety.

Back to all field notes