dograh/api/services/pipecat
Harshita Jain e79cb42f31
feat: add Smallest AI TTS and STT provider integration (#444)
* feat: add Smallest AI TTS and STT provider integration

Integrates Smallest AI's Waves (TTS) and Pulse (STT) APIs as selectable
providers in the Dograh platform. Dograh's pipecat fork already contains
the pipecat-level service implementations; this wires them into the API
configuration registry and service factory.

- Added `SMALLEST = "smallest"` to `ServiceProviders` enum
- Registered `SmallestAITTSConfiguration` (lightning-v3.1/v2, voices,
  language, speed) and `SmallestAISTTConfiguration` (pulse model, 30+
  languages) Pydantic config classes with the TTS/STT registries
- Added factory branches in `create_tts_service` and `create_stt_service`
  routing to `SmallestTTSService` and `SmallestSTTService` from pipecat

* fix: update Smallest AI models to v4 naming convention

- TTS: rename lightning-v3.1 → lightning_v3.1, add lightning_v3.1_pro, drop deprecated lightning-v2
- STT: keep pulse only (pulse-pro is not a streaming model)

* fix: change default TTS voice from emily to sophia for lightning_v3.1

emily is not a verified lightning_v3.1 voice; sophia is the pipecat
SmallestTTSService default and confirmed to work with the standard pool.

* fix: replace 9 invalid lightning_v3.1 voice IDs with verified ones

jasmine, james, michael, aria, lara, asel, sarah, rishi, deepika do not
exist in the lightning_v3.1 voice catalog. Replaced with avery, liam,
lucas, olivia, freya, devansh, maya, dhruv, maithili — all verified
against the API.

* fix: smallest ai config validation and tts model compatibility

* chore: ruff fix

* chore: updated smallest ai schema in openapi.json

---------

Co-authored-by: Sabiha Khan <sabihak89@gmail.com>
Co-authored-by: Sabiha Khan <87858386+chewwbaka@users.noreply.github.com>
2026-06-17 12:55:53 +05:30
..
realtime feat: add Azure AI multi-provider support (TTS, STT, Embeddings, Realtime) (#381) 2026-06-02 12:50:00 +05:30
__init__.py Initial Commit 🚀 🚀 2025-09-09 14:37:32 +05:30
audio_config.py feat: refactor telephony to support multiple telephony configurations (#251) 2026-04-29 11:39:57 +05:30
audio_file_cache.py feat: add full document mode in knowledge base 2026-04-09 13:49:20 +05:30
audio_mixer.py feat: refactor telephony to support multiple telephony configurations (#251) 2026-04-29 11:39:57 +05:30
audio_playback.py feat: refactor node spec and add mcp tools (#244) 2026-04-21 07:56:16 +05:30
event_handlers.py feat: persist split user and bot audio 2026-06-16 15:19:49 +05:30
exceptions.py Initial Commit 🚀 🚀 2025-09-09 14:37:32 +05:30
in_memory_buffers.py feat: persist split user and bot audio 2026-06-16 15:19:49 +05:30
minimax_tts.py feat: add MiniMax provider support (Chat + TTS) (#309) 2026-05-22 13:09:41 +05:30
pipeline_builder.py chore: update pipecat to 1.3.0 (#379) 2026-05-29 16:19:42 +05:30
pipeline_engine_callbacks_processor.py feat: abort immediately on max call duration exceed 2026-05-31 13:21:37 +05:30
pipeline_metrics_aggregator.py chore: upgrade pipecat 2026-03-06 16:49:14 +05:30
pre_call_fetch.py chore: update docs for pre-call data fetch 2026-06-05 14:16:56 +05:30
realtime_feedback_events.py feat: add chat based testing for voice agent (#308) 2026-05-21 15:20:02 +05:30
realtime_feedback_observer.py fix: fix rtf logs and gemini live turn taking 2026-05-31 16:05:03 +05:30
recording_audio_cache.py feat: add recording audio option in tool and node transitions (#232) 2026-04-10 17:53:42 +05:30
recording_router_processor.py feat: add recording audio option in tool and node transitions (#232) 2026-04-10 17:53:42 +05:30
run_pipeline.py feat: billing and credit management v2 (#429) 2026-06-12 14:55:30 +05:30
service_factory.py feat: add Smallest AI TTS and STT provider integration (#444) 2026-06-17 12:55:53 +05:30
tracing_config.py feat: add chat based testing for voice agent (#308) 2026-05-21 15:20:02 +05:30
transport_params.py feat: add openai realtime models (#298) 2026-05-16 18:05:23 +05:30
transport_setup.py feat: add openai realtime models (#298) 2026-05-16 18:05:23 +05:30
turn_context.py chore: bump pipecat version 2026-02-11 18:18:32 +05:30
worker_runner.py chore: update pipecat to 1.3.0 (#379) 2026-05-29 16:19:42 +05:30
ws_sender_registry.py feat: add transcript panel during live call for better visibility (#116) 2026-01-13 22:48:18 +05:30