mirror of
https://github.com/katanemo/plano.git
synced 2026-05-10 16:22:42 +02:00
updating the implementation of /v1/chat/completions to use the generi… (#548)
* updating the implementation of /v1/chat/completions to use the generic provider interfaces * saving changes, although we will need a small re-factor after this as well * more refactoring changes, getting close * more refactoring changes to avoid unecessary re-direction and duplication * more clean up * more refactoring * more refactoring to clean code and make stream_context.rs work * removing unecessary trait implemenations * some more clean-up * fixed bugs * fixing test cases, and making sure all references to the ChatCOmpletions* objects point to the new types * refactored changes to support enum dispatch * removed the dependency on try_streaming_from_bytes into a try_from trait implementation * updated readme based on new usage * updated code based on code review comments --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-2.local> Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-4.local>
This commit is contained in:
parent
1fdde8181a
commit
89ab51697a
22 changed files with 1044 additions and 972 deletions
|
|
@ -13,14 +13,14 @@
|
|||
//!
|
||||
//! ```rust
|
||||
//! use hermesllm::apis::{
|
||||
//! AnthropicMessagesRequest, ChatCompletionsRequest, MessagesRole, MessagesMessage,
|
||||
//! MessagesRequest, ChatCompletionsRequest, MessagesRole, MessagesMessage,
|
||||
//! MessagesMessageContent, MessagesSystemPrompt,
|
||||
//! };
|
||||
//! use hermesllm::clients::TransformError;
|
||||
//! use std::convert::TryInto;
|
||||
//!
|
||||
//! // Transform Anthropic to OpenAI
|
||||
//! let anthropic_req = AnthropicMessagesRequest {
|
||||
//! let anthropic_req = MessagesRequest {
|
||||
//! model: "claude-3-sonnet".to_string(),
|
||||
//! system: None,
|
||||
//! messages: vec![],
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue