Tag
ON Device
Every published article tagged with ON Device.
Running 125M Parameter Transformer On-Device for Real-Time MIDI Completion
Run 125M parameter transformer locally for real-time music generation. Deploy on device midi autocomplete to eliminate network latency.
7 min read
Real-Time WebGPU Inference for MIDI Autocomplete with ONNX Runtime
Deploy a lightweight on device midi model for real-time piano autocomplete in the browser. Learn to optimize WebAssembly and reduce memory footprint.