Compare commits
2 Commits
main
...
vv/rust-se
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
55632edfb2 | ||
|
|
c565c7ab6d |
17
README.md
17
README.md
|
|
@ -5,6 +5,7 @@ This repo contains instructions and examples of how to run
|
||||||
and [Kyutai Text-To-Speech](#kyutai-text-to-speech) models.
|
and [Kyutai Text-To-Speech](#kyutai-text-to-speech) models.
|
||||||
These models are powered by delayed streams modeling (DSM),
|
These models are powered by delayed streams modeling (DSM),
|
||||||
a flexible formulation for streaming, multimodal sequence-to-sequence learning.
|
a flexible formulation for streaming, multimodal sequence-to-sequence learning.
|
||||||
|
See also [Unmute](https://github.com/kyutai-labs/unmute), an voice AI system built using Kyutai STT and Kyutai TTS.
|
||||||
|
|
||||||
But wait, what is "Delayed Streams Modeling"? It is a technique for solving many streaming X-to-Y tasks (with X, Y in `{speech, text}`)
|
But wait, what is "Delayed Streams Modeling"? It is a technique for solving many streaming X-to-Y tasks (with X, Y in `{speech, text}`)
|
||||||
that formalize the approach we had with Moshi and Hibiki. A pre-print paper is coming soon!
|
that formalize the approach we had with Moshi and Hibiki. A pre-print paper is coming soon!
|
||||||
|
|
@ -248,17 +249,13 @@ and just prefix the command above with `uvx --with moshi`.
|
||||||
The Rust implementation provides a server that can process multiple streaming
|
The Rust implementation provides a server that can process multiple streaming
|
||||||
queries in parallel.
|
queries in parallel.
|
||||||
|
|
||||||
In order to run the server, install the [moshi-server
|
Installing the Rust server is a bit tricky because it uses our Python implementation under the hood,
|
||||||
crate](https://crates.io/crates/moshi-server) via the following command. The
|
which also requires installing the Python dependencies.
|
||||||
server code can be found in the
|
Use the [start_tts.sh](https://github.com/kyutai-labs/unmute/blob/main/dockerless/start_tts.sh) script to properly install the Rust server.
|
||||||
[kyutai-labs/moshi](https://github.com/kyutai-labs/moshi/tree/main/rust/moshi-server)
|
If you already installed the `moshi-server` crate before and it's not working, you might need to force a reinstall by running `cargo uninstall moshi-server` first.
|
||||||
repository.
|
Feel free to open an issue if the installation is still broken.
|
||||||
```bash
|
|
||||||
cargo install --features cuda moshi-server
|
|
||||||
```
|
|
||||||
|
|
||||||
|
Once installed, the server can be started via the following command using the config file
|
||||||
Then the server can be started via the following command using the config file
|
|
||||||
from this repository.
|
from this repository.
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue
Block a user