OpenBMB / VoxCPM

Tokenizer-free TTS using diffusion autoregressive architecture for natural multilingual speech and controllable voice cloning

正常维护 Apache 2.0 Python Tracked
40.7k 4.6k 18 天前
CIPyPI
audio deeplearning minicpm python pytorch speech speech-synthesis text-to-speech tts tts-model voice-cloning multilingual voice-design voxcpm

星标趋势

数据积累中,暂无足够数据生成趋势图

AI 分析

项目摘要

VoxCPM2 is a tokenizer-free Text-to-Speech system that generates continuous speech representations using an end-to-end diffusion autoregressive architecture, bypassing discrete tokenization. Built on the efficient MiniCPM-4 backbone with 2B parameters trained on 2+ million hours of multilingual data, it supports 30 languages, creative voice design, and controllable voice cloning with 48kHz studio-quality output.

为什么值得关注

Its tokenizer-free approach achieves highly natural synthesis by avoiding discrete tokenization artifacts, while delivering state-of-the-art multilingual coverage and voice cloning capabilities with strong community adoption (39K+ stars).

优势

  • Tokenizer-free architecture produces more natural, expressive speech without discrete tokenization artifacts
  • Comprehensive 30-language multilingual support with studio-quality 48kHz output
  • Advanced voice design and controllable cloning capabilities built on efficient MiniCPM backbone
  • Active development with CI/CD, comprehensive docs, and strong community support

局限性

  • Relatively new project (Sept 2025), still maturing with potential breaking changes
  • 2B parameter model may require significant compute resources for inference

使用场景

  • Multilingual speech synthesis and content dubbing for global audiences
  • Creative voice design for content creators and game/audio production
  • Personalized voice cloning for virtual assistants and accessibility tools
  • Studio-quality audio production with fine-grained voice control
目标用户: AI researchers, developers building speech synthesis applications, content creators, and companies needing production-ready multilingual TTS
学习曲线: 中
分析模型:LongCat-2.0 | 分析时间:13 天前