Skip to content

Genius-Society/dyber_genshin_ai_vits

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Dyber Genshin AI VITS

license Python application itch hf ms bili

DyberPet_GenshinImpact + KimiChat + BertVITS2

DyberPet_GenshinImpact is an open-source desktop pet framework that serves as the foundation for custom virtual companions. We have augmented this framework by integrating a large language model (LLM) alongside a VITS-based (Variational Inference with adversarial learning for end-to-end Text-to-Speech) text-to-speech (TTS) module, which together enable intelligent, context-aware dialogue with designated Genshin Impact characters. VITS is a state-of-the-art, single-stage TTS model that delivers natural, high-quality voice synthesis without external alignment annotations. As such, dyber_genshin_ai_vits represents an AI-enhanced desktop pet game.

Environment

Please note that to achieve real-time or near-real-time voice inference, the application requires an NVIDIA GeForce GTX 1080 Ti or a more powerful GPU; on lesser hardware, audio synthesis latency may become unacceptably high.

conda create -n py311 python=3.11 -y
conda activate py311
pip install -r requirements.txt

Code download

git clone git@github.com:Genius-Society/dyber_genshin_ai_vits.git
cd dyber_genshin_ai_vits

Run

python main.py

Build

python build.py
# Fetch the DyberGenshinAI-win10x64-*.zip from ./dist

Thanks

About

DyberPet + KimiChat + BertVITS2 for Genshin Impact Characters

Topics

Resources

License

Stars

Watchers

Forks

Contributors