tipi/kyutai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Fix instructions on how to install the Rust server (#65)

Browse Source 
* Fix instructions on Rust server installation

* Plug Unmute
This commit is contained in:
Václav Volhejn 2025-07-07 18:00:23 +02:00 committed by GitHub
parent 70500c620e
commit 7336d7a3da
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 7 additions and 10 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
README.md
View File

@ -5,6 +5,7 @@ This repo contains instructions and examples of how to run
and [Kyutai Text-To-Speech](#kyutai-text-to-speech) models. and [Kyutai Text-To-Speech](#kyutai-text-to-speech) models.
These models are powered by delayed streams modeling (DSM), These models are powered by delayed streams modeling (DSM),
a flexible formulation for streaming, multimodal sequence-to-sequence learning. a flexible formulation for streaming, multimodal sequence-to-sequence learning.
See also [Unmute](https://github.com/kyutai-labs/unmute), an voice AI system built using Kyutai STT and Kyutai TTS.
But wait, what is "Delayed Streams Modeling"? It is a technique for solving many streaming X-to-Y tasks (with X, Y in `{speech, text}`) But wait, what is "Delayed Streams Modeling"? It is a technique for solving many streaming X-to-Y tasks (with X, Y in `{speech, text}`)
that formalize the approach we had with Moshi and Hibiki. A pre-print paper is coming soon! that formalize the approach we had with Moshi and Hibiki. A pre-print paper is coming soon!
@ -248,17 +249,13 @@ and just prefix the command above with `uvx --with moshi`.
The Rust implementation provides a server that can process multiple streaming The Rust implementation provides a server that can process multiple streaming
queries in parallel. queries in parallel.
In order to run the server, install the [moshi-server Installing the Rust server is a bit tricky because it uses our Python implementation under the hood,
crate](https://crates.io/crates/moshi-server) via the following command. The which also requires installing the Python dependencies.
server code can be found in the Use the [start_tts.sh](https://github.com/kyutai-labs/unmute/blob/main/dockerless/start_tts.sh) script to properly install the Rust server.
[kyutai-labs/moshi](https://github.com/kyutai-labs/moshi/tree/main/rust/moshi-server) If you already installed the `moshi-server` crate before and it's not working, you might need to force a reinstall by running `cargo uninstall moshi-server` first.
repository. Feel free to open an issue if the installation is still broken.
```bash
cargo install --features cuda moshi-server
```
Once installed, the server can be started via the following command using the config file
Then the server can be started via the following command using the config file
from this repository. from this repository.
```bash ```bash