Skip to content

VoiceStudio: A unified toolkit for text-style prompted speech synthesis, voice adaptation, and editing

License

Notifications You must be signed in to change notification settings

latentforge/VoiceStudio

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

224 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

VoiceStudio

Python PyTorch License

Your Complete Voice Adaptation Research Workspace


🎯 Overview

VoiceStudio is a unified toolkit for text-style prompted speech synthesis, enabling instant voice adaptation and editing through natural language descriptions. Built on cutting-edge research in voice style prompting, LoRA adaptation, and language-audio models.

Key Features:

  • Text-Conditional Generation: Generate voice characteristics using natural language descriptions like "young female voice with warm tone"
  • Multimodal Input: Support both text descriptions and audio feature vectors
  • Voice Editing: Modify existing voices with simple instructions (Future Work)
  • Instant Adaptation: Generate LoRA weights in a single forward pass without fine-tuning
  • Architecture Agnostic: Works with multiple TTS architectures
  • Zero-shot Generalization: Adapt to unseen voice characteristics not present in training data
  • Parameter Efficiency: Minimal computational overhead compared to full model fine-tuning

🛠️ Installation

From PyPI (Recommended)

uv add voicestudio[all]  # Install with all available base TTS models

From Source

git clone https://github.com/LatentForge/voicestudio.git
cd voicestudio
uv pip install -e ".[all]"

Development Installation

git clone https://github.com/LatentForge/voicestudio.git
cd voicestudio
uv pip install -e ".[all,web]"

Building and Publishing

# Build package
uv build

# Upload to PyPI
uv publish

📊 Supported Models

VoiceStudio works with various TTS architectures:

Model Status Notes
Parler-TTS ✅ Supported Required further testing
Higgs-Audio ✅ Supported Required further testing
Qwen3-TTS ✅ Supported Required further testing
Chroma ✅ Supported Required further testing
Spark 🔄 Experimental Coming soon
Dia ✅ Supported Fully tested (by HF)
CozyVoice 🔄 Experimental Coming soon
F5-TTS 🔄 Experimental Coming soon

Add your own model: See our Integration Guide


🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

Areas we need help with:

  • 🔧 Additional TTS model adapters
  • 📚 Documentation improvements
  • 🐛 Bug fixes and testing
  • 🌍 Multi-language support
  • 🎨 New voice editing techniques

📝 License

This project is licensed under the MIT License - see LICENSE file for details.

The base TTS models supported by this project are subject to their own respective licenses. Users are responsible for reviewing and complying with each model’s license before use.


🙏 Acknowledgments

  • Sakana AI for the original Text-to-LoRA concept
  • HyperTTS authors for hypernetwork applications in TTS
  • The open-source community for tools and datasets
  • CLAP: Microsoft & LAION-AI for CLAP model
  • LoRA: Microsoft for LoRA technique
  • HuggingFace: For transformers library and model hub

📚 Citation

If you use VoiceStudio in your research, please cite:

@software{voicestudio2026,
  title={VoiceStudio: A Unified Toolkit for Voice Style Adaptation},
  author={Your Name},
  year={2026},
  url={https://github.com/LatentForge/voicestudio}
}
@article{t2a-lora-2025,
  title={T2A-LoRA: Text-to-Audio LoRA Generation via Hypernetworks for Real-time Voice Adaptation},
  author={LatentForge},
  journal={arXiv preprint arXiv:2501.XXXXX},
  year={2025}
}

🔗 Links


📞 Contact


Stars Forks Watchers

Made with ❤️ by LatentForge Team

About

VoiceStudio: A unified toolkit for text-style prompted speech synthesis, voice adaptation, and editing

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 5