Dia-Jax – A Jax port of the Dia text-to-speech dialogue model
Dia-Jax – A Jax port of the Dia text-to-speech dialogue model
I've created a JAX port of Dia, the 1.6B parameter text-to-speech model that generates realistic dialogue from transcripts. This experimental port explores running Dia with JAX's functional paradigm and hardware flexibility potential. Key features: - Command-line interface for generating audio - Support for multi-speaker dialogue with [S1]/[S2] tags - Non-verbal sounds like (laughs), (coughs), etc. - Plans for voice cloning capability Current status: Functional but with memory optimization challenges. The PyTorch version can generate minutes of audio in <10GB VRAM, while this port currently has higher memory usage. Contributions from JAX optimization experts welcome! GitHub: [ https://github.com/jaco-bro/diajax ]
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Djoom3 – a doom 3 java port
Opening the Tesla charging port with WebUSB and HackRF
BookML – a bookdown flavoured GitBook port for LaTeXML
HTML5 port of Civilization 2: MGE
CuTile for Java Port
Gameboy port of 2048
XMoto Port in HTML5/CoffeeScript
Knockles – eBPF Port Knocking Tool
Port tunneling tools
Chocolate Doom Web Port