ComfyUI-VoxCPMTTS¶
ComfyUI-VoxCPMTTS is a lightweight ComfyUI node for VoxCPM 1.5, featuring built-in automatic speech recognition for reference audio transcription.
Note
For LoRA training and dual-model support, see ComfyUI-VoxCPM.
VoxCPM 1.0 (0.5B) |
✅ Available in UI (16 kHz) |
VoxCPM 1.5 |
✅ Default and recommended (44.1 kHz) |
VoxCPM 2 |
❌ Not supported |
This extension provides two node variants:
AILab_VoxCPMTTS — simplified node with hidden advanced parameters
AILab_VoxCPMTTS_Advanced — full control over all generation parameters
Features¶
TTS and voice cloning with VoxCPM 1.5 (44.1 kHz output); VoxCPM 0.5B also available in the UI
Auto-transcription of reference audio via faster-whisper (requires enabling
auto_transcribe_reference)Fade-in post-processing for smoother audio output (configurable
fade_in_mson Advanced node)Simplified node uses fixed defaults (
cfg_value=2.0,inference_steps=10); Advanced node exposes full manual controlREFERENCE_TEXToutput port for inspecting ASR resultsConfigurable ASR model via environment variable
VOXCPM_ASR_MODEL(tiny/small/medium/large)Multi-device: auto (auto-detect), CUDA, MPS, CPU
Prerequisites¶
ComfyUI installed and running
PyTorch with appropriate backend
~1.2 GB disk space for model downloads
Installation¶
Via ComfyUI Manager: search for
VoxCPMTTSand install.
Manual installation:
cd ComfyUI/custom_nodes/
git clone https://github.com/1038lab/ComfyUI-VoxCPMTTS.git
pip install -r ComfyUI-VoxCPMTTS/requirements.txt
# Restart ComfyUI
Models are auto-downloaded on first use. Default path is ComfyUI/models/TTS/VoxCPM1.5/ for the 1.5 model, or ComfyUI/models/TTS/VoxCPM-0.5B/ if 0.5B is selected.
Basic usage¶
Text-to-Speech¶
Add the VoxCPM TTS node (simplified) or VoxCPM TTS (Advanced) node
Enter the
textto synthesizeThe simplified node uses sensible defaults (
cfg_value=2.0,inference_steps=10)The Advanced node lets you manually set
cfg_value,inference_steps, and other parameters
Voice cloning¶
Connect
reference_audiowith a reference audio clipFor auto-transcription: enable
auto_transcribe_referenceon the node (required — leavingreference_textempty alone is not sufficient)Alternatively, provide the transcript manually in
reference_textThe
REFERENCE_TEXToutput shows the detected/provided transcript for verification
Recommended parameter tuning¶
The README suggests the following parameter combinations for different speed/quality trade-offs (set manually on the Advanced node):
Profile |
CFG Value |
Inference Steps |
Speed |
|---|---|---|---|
Fast |
1.5 |
5 |
Fastest |
Balanced |
2.0 |
10 |
Moderate |
High Quality |
3.0 |
20 |
Slowest |
Advanced node parameters¶
Parameter |
Description |
|---|---|
|
Classifier-free guidance scale |
|
LocDiT diffusion steps |
|
Maximum generation token length |
|
Fade-in duration for audio smoothing |
|
Maximum retries for bad outputs |
|
Threshold for bad-case detection |
|
Enable ASR for reference audio |
|
Enable text normalization |
|
Unload model after inference to free VRAM |
Troubleshooting¶
Out of Memory (OOM)¶
VoxCPM 1.5 requires significant VRAM. If you encounter OOM errors:
Enable
unload_modelto release GPU memory after each generationSwitch
devicetocpu(slower but uses system RAM)Close other GPU-intensive applications
Try the Fast quality preset to reduce memory usage
Model download issues¶
If auto-download fails, manually download from Hugging Face and place files in ComfyUI/models/TTS/VoxCPM1.5/.
For debug logging, set COMFYUI_LOG_LEVEL=DEBUG.
Comparing with ComfyUI-VoxCPM¶
Feature |
ComfyUI-VoxCPM |
ComfyUI-VoxCPMTTS |
|---|---|---|
Model support |
VoxCPM 1.5 + 0.5B |
VoxCPM 1.5 (recommended) + 0.5B |
LoRA training |
✅ Built-in |
❌ |
Auto-transcription |
❌ Manual only |
✅ faster-whisper |
Node variants |
Single node |
Simple + Advanced |
Quality presets |
Manual parameters |
Fast / Balanced / HQ |
Dependencies |
Heavier (LoRA training) |
Lighter |