ADx Studio
A Mac app I built for making lyric videos. It listens to a song, times every word to the vocal and renders the finished video in one of seven animated styles, all on your own computer.
- 10 msmedian gap between auto-synced words and a hand-timed reference
- 96%of words placed within 60 ms
- 4K60renders split across parallel workers, with the Mac's hardware encoder
Terminal
How it's built
A local Python server with a browser UI. Frames are drawn with Skia and shaped with HarfBuzz, vocals are separated and aligned with ONNX speech models, and ffmpeg does the encoding.
PythonSkiaHarfBuzzOpenCVNumPyONNX Runtimesherpa-onnxffmpegVideoToolboxJavaScript
About
Independent singer-songwriter from India, writing in Hindi and English.
I write, sing and release my own songs, starting with Tumse Mil Ke in 2020. I'm also a software developer and build the tools behind my visuals: ADx Studio started as the editor for my own lyric videos.