Aller au contenu

echo model guide

Overview

echo is a VoiceHub text to speech integration. This page is generated from the model registry and its executable data and training contracts, so the documented support stays aligned with code. Open the echo Colab notebook.

Quickstart

python -m pip install voicehub
  1. Install VoiceHub and the provider extra shown above.
  2. Choose a checkpoint that matches this integration.
  3. Set the input text and generation options for your use case.
  4. Generate audio and inspect the returned sample rate and metadata.
from pathlib import Path

from voicehub import AutoModelForTextToSpeech, TTSGenerationConfig

model = AutoModelForTextToSpeech.from_pretrained(
    'jordand/echo-tts-base',
    model_type='echo',
    device="cuda",
    lazy_load=True,
)
generation_kwargs = {
}
output = model.generate(
    "VoiceHub keeps model integrations consistent and easy to extend.",
    generation_config=TTSGenerationConfig(
        seed=42,
        output_file=Path("output.wav"),
    ),
    **generation_kwargs,
)
print(output.file_path, output.sample_rate)

Use only authorized recordings for reference voice, transcription, detection, or evaluation. The example selects a concrete device; verify checkpoint-specific hardware needs and pin an immutable revision before production use.

Supported tasks and capabilities

Property Value
Task Text to speech
Architecture echo-dit
Runtime VoiceHub-native
Capabilities text-to-speech, voice-cloning, fine-tuning, flow-matching, safetensors, voicehub-native, native-runtime
Reusable components

Data contract

Property Value
Readiness preprocessed
Data architecture diffusion
Sample rate Model/checkpoint specific
Contract getter get_tts_dataset_spec('echo')
Variant Required fields One of Boundary Other rules
flow-batch target_latents, text_input_ids, text_mask, speaker_latents, speaker_mask Prepared

Conditional flow-matching, rectified-flow, or diffusion data. Follow the shared data workflow for manifest loading, audio validation, leakage-safe splits, and model-owned preprocessing.

Checkpoints, provenance, and license

Property Value
Default checkpoint jordand/echo-tts-base
Checkpoint status Registry default; pin an immutable revision for production and reproducible evidence
Implementation voicehub.models.echo.modeling_echo.EchoTTSForTextToSpeech
Configuration voicehub.models.echo.configuration_echo.EchoTTSConfig
Source provenance voicehub/models/echo/source/SOURCE.json
License Checkpoint-specific

No VoiceHub-specific license override is registered. Verify the checkpoint and upstream source terms before use.

The default checkpoint identifies the expected family, not every compatible variant. Confirm the selected checkpoint's revision, access terms, provenance, and license before downloading or redistributing it.

Optimization and training support

All public optimizations enter this model through the shared BaseSpeechModel lifecycle. Use available_optimization_passes() to discover the public pass registry, then apply, inspect, serialize, or restore a plan through the common model API. Application remains fail-closed when the active runtime or hardware cannot satisfy a pass.

Training contract

Property Value
Support preprocessed
Family flow-matching
Recipe single-phase
Default phase flow
Training checkpoint jordand/echo-tts-base
Native training graph no
Phase Kind Components Required inputs Loss keys
flow objective model target_latents, text_input_ids, text_mask, speaker_latents, speaker_mask loss, flow_loss

Prepare the exact tensors listed in the data contract before this step. Call model.validate_training_support() before constructing a trainer. Follow the shared training workflow for a one-step smoke test, validation, checkpoint resume, optimization, and portable export.

Public API

Purpose Public object
Discover get_model_spec('echo')
Load and run AutoModelForTextToSpeech
Configure EchoTTSConfig
Model implementation EchoTTSForTextToSpeech
Normalized output TTSOutput
Training contract get_training_spec('echo')
Optimization lifecycle available_optimization_passes, apply_optimization_plan, optimization_manifest, restore_optimization_plan

Related shared documentation: