dograh/api/services/pipecat
Vishal Dhateria 7ba95c0fbe
feat: add Azure AI multi-provider support (TTS, STT, Embeddings, Realtime) (#381)
* feat: add Azure AI multi-provider support (TTS, STT, Embeddings, Realtime)

Enables Azure AI services across all model layers so users with Azure
credits can consolidate billing on a single provider.

- Voice (TTS): AzureSpeechTTSConfiguration via azure_speech provider
- Transcriber (STT): AzureSpeechSTTConfiguration via azure_speech provider
- Embedding: AzureOpenAIEmbeddingsConfiguration via azure provider
- Realtime: AzureRealtimeLLMConfiguration via azure_realtime provider

New files:
- api/services/pipecat/realtime/azure_realtime.py
- api/services/gen_ai/embedding/azure_openai_service.py
- api/tests/test_azure_speech_service_factory.py

The UI picks up all four providers automatically from the schema —
no frontend changes required.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix: add validation for URL and params

---------

Co-authored-by: Vishal Dhateria <vishal@finela.ai>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Abhishek Kumar <abhishek@a6k.me>
2026-06-02 12:50:00 +05:30
..
realtime feat: add Azure AI multi-provider support (TTS, STT, Embeddings, Realtime) (#381) 2026-06-02 12:50:00 +05:30
__init__.py Initial Commit 🚀 🚀 2025-09-09 14:37:32 +05:30
audio_config.py feat: refactor telephony to support multiple telephony configurations (#251) 2026-04-29 11:39:57 +05:30
audio_file_cache.py feat: add full document mode in knowledge base 2026-04-09 13:49:20 +05:30
audio_mixer.py feat: refactor telephony to support multiple telephony configurations (#251) 2026-04-29 11:39:57 +05:30
audio_playback.py feat: refactor node spec and add mcp tools (#244) 2026-04-21 07:56:16 +05:30
event_handlers.py chore: update pipecat to 1.3.0 (#379) 2026-05-29 16:19:42 +05:30
exceptions.py Initial Commit 🚀 🚀 2025-09-09 14:37:32 +05:30
in_memory_buffers.py feat: add chat based testing for voice agent (#308) 2026-05-21 15:20:02 +05:30
minimax_tts.py feat: add MiniMax provider support (Chat + TTS) (#309) 2026-05-22 13:09:41 +05:30
pipeline_builder.py chore: update pipecat to 1.3.0 (#379) 2026-05-29 16:19:42 +05:30
pipeline_engine_callbacks_processor.py feat: abort immediately on max call duration exceed 2026-05-31 13:21:37 +05:30
pipeline_metrics_aggregator.py chore: upgrade pipecat 2026-03-06 16:49:14 +05:30
pre_call_fetch.py feat: add pre call fetch configuration (#222) 2026-04-06 12:30:37 +05:30
realtime_feedback_events.py feat: add chat based testing for voice agent (#308) 2026-05-21 15:20:02 +05:30
realtime_feedback_observer.py fix: fix rtf logs and gemini live turn taking 2026-05-31 16:05:03 +05:30
recording_audio_cache.py feat: add recording audio option in tool and node transitions (#232) 2026-04-10 17:53:42 +05:30
recording_router_processor.py feat: add recording audio option in tool and node transitions (#232) 2026-04-10 17:53:42 +05:30
run_pipeline.py feat: add Azure AI multi-provider support (TTS, STT, Embeddings, Realtime) (#381) 2026-06-02 12:50:00 +05:30
service_factory.py feat: add Azure AI multi-provider support (TTS, STT, Embeddings, Realtime) (#381) 2026-06-02 12:50:00 +05:30
tracing_config.py feat: add chat based testing for voice agent (#308) 2026-05-21 15:20:02 +05:30
transport_params.py feat: add openai realtime models (#298) 2026-05-16 18:05:23 +05:30
transport_setup.py feat: add openai realtime models (#298) 2026-05-16 18:05:23 +05:30
turn_context.py chore: bump pipecat version 2026-02-11 18:18:32 +05:30
worker_runner.py chore: update pipecat to 1.3.0 (#379) 2026-05-29 16:19:42 +05:30
ws_sender_registry.py feat: add transcript panel during live call for better visibility (#116) 2026-01-13 22:48:18 +05:30