plano/crates/llm_gateway/Cargo.toml

[package]
name = "llm_gateway"
version = "0.1.0"
authors = ["Katanemo Inc <info@katanemo.com>"]
edition = "2021"

[lib]
crate-type = ["cdylib"]

[dependencies]
proxy-wasm = "0.2.1"
log = "0.4"
serde = { version = "1.0", features = ["derive"] }
serde_yaml = "0.9.34"
serde_json = "1.0"
md5 = "0.7.0"
common = { path = "../common" }
http = "1.1.0"
governor = { version = "0.6.3", default-features = false, features = ["no_std"]}
acap = "0.3.0"
rand = "0.8.5"
thiserror = "1.0.64"
derivative = "2.2.0"
sha2 = "0.10.8"
hermesllm = { version = "0.1.0", path = "../hermesllm" }
bytes = "1.10"

[dev-dependencies]
serial_test = "3.1.1"
initial commit 2024-07-09 13:36:17 -07:00			`[package]`
split wasm filter (#186) * split wasm filter * fix int and unit tests * rename public_types => common and move common code there * rename * fix int test 2024-10-16 14:20:26 -07:00			`name = "llm_gateway"`
initial commit 2024-07-09 13:36:17 -07:00			`version = "0.1.0"`
			`authors = ["Katanemo Inc <info@katanemo.com>"]`
comments Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-07-10 13:47:26 -07:00			`edition = "2021"`
initial commit 2024-07-09 13:36:17 -07:00
Add initial scaffolding Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-07-10 10:06:02 -07:00			`[lib]`
			`crate-type = ["cdylib"]`

initial commit 2024-07-09 13:36:17 -07:00			`[dependencies]`
Add initial scaffolding Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-07-10 10:06:02 -07:00			`proxy-wasm = "0.2.1"`
			`log = "0.4"`
Parse katanemo config using serde/yaml package (#6) * Parse katanemo config using serde/yaml package - load yaml file into typed classes - pass katanemo config to plugin using envoy wasm plugin config - add tests in configuration.rs file 2024-07-16 14:50:32 -07:00			`serde = { version = "1.0", features = ["derive"] }`
			`serde_yaml = "0.9.34"`
			`serde_json = "1.0"`
add embedding store (#10) 2024-07-18 14:04:51 -07:00			`md5 = "0.7.0"`
split wasm filter (#186) * split wasm filter * fix int and unit tests * rename public_types => common and move common code there * rename * fix int test 2024-10-16 14:20:26 -07:00			`common = { path = "../common" }`
Improve error handling (#23) Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-07-29 12:15:26 -07:00			`http = "1.1.0"`
Fix wasm load error (#45) Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-09-05 16:29:41 -07:00			`governor = { version = "0.6.3", default-features = false, features = ["no_std"]}`
Improve prompt target intent matching (#51) 2024-09-16 19:20:07 -07:00			`acap = "0.3.0"`
Revert "Revert "Add support for multiple LLM Providers (#60)"" (#83) * Revert "Revert "Add support for multiple LLM Providers (#60)"" This reverts commit 43d6bc80e9ff5a7bed368c1933de2c7fa1f24663. * wip Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> * Revert "wip" This reverts commit 7c4dde5d1f27face2f2a194ea772c2ff55c947e5. * fix parameter name Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> * force use openai --------- Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> Co-authored-by: Adil Hafeez <adil@katanemo.com> 2024-09-26 00:15:17 -06:00			`rand = "0.8.5"`
Add the ability to use LLM Providers from the Arch config (#112) Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-10-03 10:57:01 -07:00			`thiserror = "1.0.64"`
Implement Client trait for StreamContext (#134) Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-10-07 19:50:15 -04:00			`derivative = "2.2.0"`
Serialize tool calls for Arch FC (#131) * Serialize tool calls * fix int tests 2024-10-07 00:03:25 -07:00			`sha2 = "0.10.8"`
Introduce hermesllm library to handle llm message translation (#501) 2025-06-10 12:53:27 -07:00			`hermesllm = { version = "0.1.0", path = "../hermesllm" }`
Add support for Amazon Bedrock Converse and ConverseStream (#588) * first commit to get Bedrock Converse API working. Next commit support for streaming and binary frames * adding translation from BedrockBinaryFrameDecoder to AnthropicMessagesEvent * Claude Code works with Amazon Bedrock * added tests for openai streaming from bedrock * PR comments fixed * adding support for bedrock in docs as supported provider * cargo fmt * revertted to chatgpt models for claude code routing --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-288.local> Co-authored-by: Adil Hafeez <adil.hafeez@gmail.com> 2025-10-22 11:31:21 -07:00			`bytes = "1.10"`
Add initial integration style tests (#20) Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-07-25 14:41:36 -07:00
			`[dev-dependencies]`
Improve error handling (#23) Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com> 2024-07-29 12:15:26 -07:00			`serial_test = "3.1.1"`