shipwithjev

Catalog / Robotics & devices

0273GitHub

jev-drone

A simulated drone that asks Jev for a judgment 2.5 times a second.

RomanSlack/jev-droneREADME ↗
# jev-drone

An autonomous quadrotor flies a five-station obstacle course in MuJoCo using
**only its onboard camera**. A small judgment model ([TypeSafe](https://typesafe.ai)'s
Jev) sits at ~2.5 Hz and decides *what the situation means*; everything
time-critical stays in ordinary code.



The drone is the Skydio X2 from [MuJoCo Menagerie](https://github.com/google-deepmind/mujoco_menagerie)
- a real airframe with four rotors, flown by a geometric controller. Nothing
about the flight is scripted.

## The idea

Jev is **not** a vision model. It takes JSON and returns typed answers with
probabilities. So it cannot be the perception layer, and it cannot run at
control rate. What it can do is answer small questions about a situation that
ordinary code finds hard to phrase.

```
 500 Hz   geometric controller       flight.Pilot    thrust-priority mixing, slew-limited
  50 Hz   guidance + safety reflex   run.Guidance    ALWAYS owns safety
  15 Hz   camera -> symbolic scene   flight.Eye      depth + segmentation, no ground truth
~2.5 Hz   tactical judgment          tactics.py      Jev, advisory only
```

Classical CV turns the depth and segmentation buffers into a compact scene:
five forward range sectors, the height of whatever is blocking the path,
whether its top edge is even visible, and where the target is. Jev reads that
and answers three questions in one call:

| question | type | options |
|---|---|---|
| `maneuver` | **Choice** | hold_course / gap_left / gap_right / climb / brake / reacquire |
| `risk` | **Score** | clear and open -> tight -> about to hit something |
| `target_truly_lost` | **Noul** | genuinely lost, or just briefly occluded? |

Code decides *when* to ask. On an open corridor with the target in view there
is nothing to decide, so no call is made. Scene

Also filed under Robotics & devices

ラプター | ロボコン ビジコン優勝

@Raptor_zip

型付き意思決定AIモデル「Jev」で双腕ロボを動かした結果まとめてみた🦾 3層制御のうち意思決定(2層)をJevに任せ、IKや物理計算はコード側に分離する構造を作りました。500msの応答と0.5円/試行で早くて激安。

X postRobotics & devices

A dual-arm robot with Jev in the middle layer

Response
~500 ms
Cost per attempt
~¥0.5

Aditya Singh

@xyz04274951

I made this for fun. Wired a mic over Fusion 360: click, speak, Fusion runs the feature. @typesafeai ‘s Jev only decides if the utterance is a command.

X postRobotics & devices

Voice control over Fusion 360

a bo

github.com

A MuJoCo workbench for robot decisions, with Jev in the loop.

GitHubRobotics & devices

EmbodiedJev

Stars
101

lyk

github.com

Two-stage Jev control of a Franka Panda arm in MuJoCo.

GitHubRobotics & devices

RoboJEV

Stars
10