RoverCam / QNN / On-device perception

Camera to
silicon.

A custom eight-class YOLO26m detector trained locally, exported to ONNX and deployed through Qualcomm QNN on the Snapdragon Hexagon HTP in a Galaxy S24 Ultra.

[01] DEPLOYMENT TARGET

Move through the electrical field.

Move your pointer across the module. The live field traces the path from the Snapdragon compute mark to your position.

Mobile platform8 Gen 3 for Galaxy
Qualcomm QNNHexagon HTP v75

Official Snapdragon wordmark used for platform identification. Snapdragon and Qualcomm are trademarks of Qualcomm Incorporated; this is an independent project.

[02] VERIFIED RUN

Measured on the held-out test.

The public baseline uses the final 306-image held-out test, not an earlier validation or smoke run. The newer RoverCam26m checkpoint remains documented separately.

88.7%mAP@0.50 on the final held-out test.
69.5%mAP@0.50:0.95 across eight classes.
15,450Custom training images in the final setup.
~35hLocal scratch training on an RTX 3050 Laptop GPU.
[03] PIPELINE

One model. Two deployment paths.

The raw ONNX build keeps the work portable and testable. The QNN build takes the same perception problem onto the phone’s dedicated accelerator.

01Train

YOLO26m trains from scratch at 736 × 736 on a custom Cars4Mars dataset.

02Export

ONNX creates a portable graph with 4 box channels and 8 class scores.

03Accelerate

Qualcomm QNN routes the Android session to the Hexagon HTP/NPU backend.

04Act

CameraX, box decoding and class-aware NMS deliver rover-ready detections.

[04] DETECTION SET

Eight objects. Competition context.

The model sees the objects needed for target localisation and the rover’s ordered autonomous sequence.

  1. Hammer
  2. Tennis ball
  3. Traffic cone
  4. Black balloon
  5. Blue balloon
  6. Pink balloon
  7. White balloon
  8. Yellow balloon
[05] OPEN EVIDENCE

Inspect the system.

The repository includes the browser model, Android source, QNN deployment model, training notes, file hashes and the device-discovery fix.

Perception that reaches the hardware.

Discuss RoverCam