A project to build with System One models

A robot's next action, decided on the device

Choose a robot's next action (pick, skip, move, stop) from a text description of what its sensors report, on a small board without a GPU.

Robotics and edgeAdvanced4 stepsSuggested by @biplov

The decision

A choice over actions (pick the item, skip it, move to the next bin, stop and alert) and a noul question, "the path ahead is clear". The state is a short text built from sensor readings and a vision model's labels.

How to build it

  1. Turn the sensors' output into a few lines of text every cycle.
  2. Run a small encoder model on the device. Julia 1 is 144M parameters.
  3. Act on the top choice only above a threshold, and fall back to a safe default below it.
  4. Log every cycle, with the decision and what happened next.

Make it better

Put it on a ROS 2 node and record a 60-second demo. Robotics communities share demos widely, and it shows why a decision needs a probability.

More projects to build

All projects

Robotics and edgeIntermediate

Smart home voice commands, decided on a Raspberry Pi

Turn a spoken command into one of your home's actions, such as lights, heating, music or a timer, on a Raspberry Pi with no cloud service, and ask again when the model is unsure.

5 stepswith julia-1, laya

Tools and appsAdvanced

A browser agent that fills in web forms

Decide, for each field on a form, whether to type a value, tick a box, click or skip, using a model small enough to run in the loop.

4 stepswith cua-s1-forms