System OneSystem One

A project to build with System One models

A robot's next action, decided on the device

Choose a robot's next action (pick, skip, move, stop) from a text description of what its sensors report, on a small board without a GPU.

Robotics and edgeAdvanced4 stepsSuggested by @biplov

The decision

A choice over actions (pick the item, skip it, move to the next bin, stop and alert) and a noul question, "the path ahead is clear". The state is a short text built from sensor readings and a vision model's labels.

How to build it

  1. Turn the sensors' output into a few lines of text every cycle.
  2. Run a small encoder model on the device. Julia 1 is 144M parameters.
  3. Act on the top choice only above a threshold, and fall back to a safe default below it.
  4. Log every cycle, with the decision and what happened next.

Make it better

Put it on a ROS 2 node and record a 60-second demo. Robotics communities share demos widely, and it shows why a decision needs a probability.

More projects to build

All projects