Created my own local neuro sama with tauri, live2d, ollama and kokoro | Tauri Apps | Page 1

leaden halo Feb 20, 2025, 12:17 AM

#

Sort of a proof of concept and WIP but getting everything working together was cool. I uploaded a video so you can see the response: https://www.youtube.com/watch?v=hKu2ERtyNTA

I'm glad that even the model's chain of thought I was weird for making this 😂

YouTube

Nano Fruitsnack

Creating a local neuro sama with tauri, live2d, ollama and kokoro

Just a little demo of a quick tauri app stitched together with ollama and kokoro fast api... everything running locally. Used an example live2d model to test with.

It's pretty slow but I'm sure this model is overkill. I'm working on fine tuning another model for more novel responses that are a bit more... fun? haha

Edit: I am aware of the do...

▶ Play video

proud anchor Feb 20, 2025, 1:07 PM

#

Nice. Are you using a python sidecar to talk to Kokoro? Being try to do this myself. Edit, just found a kokoro js library. Gonna try it out

leaden halo Feb 21, 2025, 12:55 AM

#

I used this https://github.com/remsky/Kokoro-FastAPI and have rust communicate with the backend, gives me a chance to get around some WebKit audio issues their web interface ships with.

GitHub

GitHub - remsky/Kokoro-FastAPI: Dockerized FastAPI wrapper for Koko...

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching - remsky/Kokoro-FastAPI

#

If I build for a computer other than my own I might sidecar it, for now this works for me 😄

proud anchor Feb 21, 2025, 1:21 AM

#

Oh okay, I guess I could do a flask api to run locally but I wanted to have the whole thing self contained. You may be able to get kokoro.js working, I had trouble likely due to my inexperience with tauri

#Created my own local neuro sama with tauri, live2d, ollama and kokoro