Y·B← Back home
Projects · computer vision · signal processing

Software that senses you.

Experiments that turn an ordinary laptop's camera, microphone, speakers, keyboard and mouse into instruments. They measure your vitals, hear the room, read your gestures and recognise how you type and move. Every one runs live in your browser, so you can try them right now.

● Everything runs on your device. No video or audio ever leaves your browser.
9live projects
0servers involved
5sensors: camera, mic, speaker, keyboard, mouse

Try them

click any card · camera or mic permission asked per demo
new · all sensors at once
Platform

Health OS

One webcam session measures heart rate, breathing, heart-rate variability, blinks and fatigue, focus, posture and screen distance at the same time. A guided 30-second check-in explains your numbers and keeps a private, on-device history so you can track trends.

live vitals · 30-s check-in · trends · report export →
new · 3 clinical tests
Neurology

Neuro Lab

Three tests neurologists use at the bedside, rebuilt for a webcam and touchscreen: finger tapping for speed and fatigue, hand tremor frequency from a power spectrum, and spiral drawing for wobble. Ends with a plain-English report.

hand tracking · Welch spectrum · spiral analysis →
new · phone video
Sports science

Run Form Lab

A lab-style running gait analysis from a side-view video: cadence, bounce, overstriding, knee angle at landing, lean and left/right symmetry, with coaching tips.

pose estimation · Zeni foot-strike method →
new · hold phone to chest
Cardiology

Phone stethoscope

Press your phone's mic to your chest. Filters isolate your heart sounds, label S1 and S2, and measure heart rate. Listen along through headphones.

band-pass · Shannon energy · autocorrelation →
16–20 kHz
Acoustics

Laptop sonar

Near-ultrasonic chirps from the speakers and their echoes on the mic. A matched filter turns them into a live radar display of your hand.

matched filter · range-time plot →
pinch to click
Hand tracking

Hand cursor

A mouse you control with gestures. The web version lets you point and pinch to pop orbs. The Mac desktop version drives the real cursor.

One-Euro filter · pinch hysteresis →
no permissions needed
Biometrics

Typing fingerprint

Type one phrase five times and it learns your rhythm: how long you hold each key and the gaps between them. Then it can tell you apart from anyone typing the same words.

keystroke dynamics · scaled Manhattan →
12 clicks
Motor control

Human or bot?

Click 12 targets and it judges from your mouse movement whether a person or a script is in control, then measures your Fitts's law throughput. Watch three bots try to fool it.

minimum-jerk model · Fitts's law →
hum or sing
Audio

Voice lab

Live pitch tracking to within a few cents, a spectrogram of your voice, your vocal range and closest voice type, and a match-the-note game.

YIN pitch detection · spectrogram →