OtherIn progress
Invisible Piano
Any desk becomes a piano
The engineering constraint that made this interesting is latency: anything above roughly 40ms between a fingertip landing and a note sounding stops feeling like an instrument. Multi-threading the capture and audio paths keeps it under 33ms.
What it does
- MediaPipe detects 21 hand landmarks per hand in real time
- Real piano samples trigger when fingertips cross a calibratable line
- Multi-threaded, under 33ms latency