Skip to content
Meir Dick
anon@meirdick
More in Lab
~/lab
Where next
~/lab/next
Clef-omni, watching
~/lab/clef-watch

Clef-omni, watching

A decision model watches your camera in 4-second video clips and answers nine fixed questions, each with a probability.

Camera off. Start it, or pick a photo.

Your camera records one 4-second clip at a time, video only. Not stored. Stops after about 2 minutes.

    clips
    0
    last call
    —
    tokens
    0
    cost
    $0.000000

    About this demo
    ~/lab/clef-watch/notes

    What

    Clef-omni is a decision model, so it doesn't write text. It answers fixed questions about a video clip, each with a probability, in a fraction of a second. Here it watches your camera.

    How

    model
    Clef-omni
    id
    @cf/cloudflare/clef-omni
    runs on
    Cloudflare Workers AI, through this site's Worker
    costs
    about $0.0002 a clip
    1. Your browser records a 4-second clip, video only.
    2. This site's Worker sends it to Clef-omni with nine standing questions. Clef-omni samples the clip at 2 frames a second.
    3. Each answer comes back with a probability. A bar lights up at 0.6 or more.

    Why

    A camera sends 30 frames a second, and no one can afford a language model call on every frame. A decision model can ask "what changed?" across whole clips of video, and call the big model only when it matters. That is the first layer of the router in Inference That Knows Where to Run. See it place work in Where should it run?

    Try

    • Start the camera, then wave, smile or hold something up; "something is moving" climbs.
    • Turn away, or cover the lens, and watch "a person in frame" drop.
    • No camera? Pick a photo of a person; it answers the eight picture questions.

    Limits

    • One 4-second clip at a time here, to keep the cost low. A real watcher would read every frame on the device.
    • The questions are fixed. You cannot ask your own.
    • A probability is not a fact. Dim light lowers it.
    Contact
    ~/contact

    Write to me about the problem you want to fix.

    Write to me
    ~/mail/new
    Ctrl+Enter sends.
    1 – 5 switch workspace n b where next: the next step, or back Enter go to the menu ↑ ↓ Enter in the menu: move, open space / Ctrl K launcher: essays, builds, eras, themes, commands h l j k move focus: h l between columns, j k within one H L resize: move the split left or right J K resize: grow or shrink the focused side window f fullscreen the focused window w or q close the window under the mouse (reopen it from the launcher) t pick a theme m or c contact: write to me Esc leave a text box, the menu, fullscreen or a dialog Ctrl Enter send the message in the mail window ? this list