Commit graph

351 commits

Author SHA1 Message Date
Adil Hafeez
47dcbf9469
Merge branch 'main' into adil/add_endpoint_http_headers 2025-02-06 11:19:26 -08:00
Adil Hafeez
e82f8f216f
Encode parameter values in http path and ... (#395)
* Encode parameter values in http path and ...

- don't send param values in request body in http get request
- send param values in http post request

* rust tests

* refactor code

* add tests
2025-02-06 11:00:47 -08:00
Adil Hafeez
a62f906432
remove unused cargo.lock files (#396) 2025-02-05 20:25:41 -08:00
Adil Hafeez
afa2142d93
run rust tests for all crates upon commit (#393) 2025-02-05 18:57:01 -08:00
Adil Hafeez
8263cf1c4f
remov spotify demo 2025-02-05 17:26:19 -08:00
Adil Hafeez
d4eacb1f5f
fix rust tests 2025-02-05 17:25:30 -08:00
Adil Hafeez
8d59586dfb
use shuguang's prompt targets 2025-02-05 16:12:41 -08:00
Adil Hafeez
b960862baf
add post and get method query param processing 2025-02-05 15:43:56 -08:00
Adil Hafeez
b4aa4cf43e
Merge branch 'main' into adil/add_endpoint_http_headers 2025-02-05 13:04:02 -08:00
Adil Hafeez
7e9059f4f8
fix tests 2025-02-05 12:53:48 -08:00
Adil Hafeez
16f5025bc9
path replacement 2025-02-04 17:42:27 -08:00
Adil Hafeez
800e227399
Publish both arm64 and amd64 in docker on main (#392) 2025-02-04 15:30:06 -08:00
Adil Hafeez
fa089ef32d
Publish both arm64 and amd64 in docker on main (#392) 2025-02-04 15:04:09 -08:00
Salman Paracha
e9d69e4f7b updated the search API for spotify in the demo 2025-02-04 14:44:07 -08:00
Salman Paracha
8f29210688 updating the sysmtem prompt for the spotify demo 2025-02-03 22:07:43 -08:00
Adil Hafeez
97aa98c311
update arch_config.yaml 2025-02-03 17:46:11 -08:00
Adil Hafeez
c6dd657ec6
fix http response 2025-02-03 16:16:47 -08:00
Adil Hafeez
96b300f100
fix more 2025-02-03 15:03:38 -08:00
Adil Hafeez
cf5577c781
Merge branch 'main' into adil/add_endpoint_http_headers 2025-02-03 14:54:08 -08:00
Adil Hafeez
254eb42ac2
more changes 2025-02-03 14:53:54 -08:00
Adil Hafeez
631d2d591f
Infer port from protocol if port is not specified and add ability to override hostname in clusters def (#389) 2025-02-03 14:52:42 -08:00
obinnascale3
d8970d4334
Add Langtrace as a supported observability tool (#376)
* add langtrace as a tracing tool

* add setup step for Arch installation

---------

Co-authored-by: Obinna Okafor <obinna.okafor01@gmail.com>
2025-02-03 14:52:42 -08:00
Adil Hafeez
962727f244
Infer port from protocol if port is not specified and add ability to override hostname in clusters def (#389) 2025-02-03 14:51:59 -08:00
Salman Paracha
6da3f42707 adding demo for spotify 2025-01-31 18:08:53 -08:00
Adil Hafeez
9ca8d2a418
add pending changes 2025-01-31 17:38:48 -08:00
Adil Hafeez
c3f9824032
fix 2025-01-31 16:34:55 -08:00
obinnascale3
25692bbbfc
Add Langtrace as a supported observability tool (#376)
* add langtrace as a tracing tool

* add setup step for Arch installation

---------

Co-authored-by: Obinna Okafor <obinna.okafor01@gmail.com>
2025-01-31 11:16:30 -08:00
Adil Hafeez
586c860bce
Merge branch 'main' into adil/add_endpoint_http_headers 2025-01-31 10:38:20 -08:00
Adil Hafeez
39266b5084
log improvements and some code refactor (#379) 2025-01-31 10:37:53 -08:00
Salman Paracha
e79d16ec81
Updated README layout (#387)
* Updated README layout

* minor fixes

* minor fixes

* minor fixes

* minor fixes

* minor fixes

* minor clean up

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2025-01-30 17:36:11 -08:00
Adil Hafeez
a0db504fe4
add ability to specify custom http headers in api endpoint 2025-01-29 14:18:42 -08:00
Adil Hafeez
a7feb6bffb
fix llm_provider format (#385) 2025-01-24 20:35:56 -08:00
Adil Hafeez
7830f4b431
release 0.2.0 (#384)
* release 0.2.0

* update versions
2025-01-24 17:31:48 -08:00
Adil Hafeez
38f7691163
add support for custom llm with ssl support (#380)
* add support for custom llm with ssl support

Add support for using custom llm that are served through https protocol.

* add instructions on how to add custom inference endpoint

* fix formatting

* add more details

* Apply suggestions from code review

Co-authored-by: Salman Paracha <salman.paracha@gmail.com>

* Apply suggestions from code review

* fix precommit

---------

Co-authored-by: Salman Paracha <salman.paracha@gmail.com>
2025-01-24 17:14:24 -08:00
Adil Hafeez
2c67fa3bc0
Fix llm_routing provider element (#382)
* Fix llm_routing provider element

We replaced provider with provider_interface to make it more clear to developers about provider api/backend being used. During that upgrade we removed support for mistral in provider to encourage developers to start using provider_interface. But this demo was not updated to use provider_interface as it was using mistral. This code change fixes it by replacing provider with provider_interface.

Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>

* fix the path

* move

* add more details

* fix

* Apply suggestions from code review

* fix

* fix

---------

Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>
2025-01-24 16:34:11 -08:00
Guy Stone
84af476c75
Add run_demo.sh for llm_routing demo (#381)
* Create run_demo.sh for llm_routing demo

* Update run_demo.sh
2025-01-24 14:41:51 -08:00
Salman Paracha
1e75c1c5e0 updating README 2025-01-23 11:31:10 -08:00
Salman Paracha
1d9bfcb7db
Update README.md 2025-01-23 11:26:21 -08:00
Salman Paracha
f9bed5d75c
Update README.md 2025-01-23 11:25:46 -08:00
Adil Hafeez
6740a09952
add docker-compose file for honeycomb tracing (#377) 2025-01-22 14:02:59 -08:00
Adil Hafeez
6887d52750
When using ollama token count was not coming in (#375)
When using ollama token count was not coming in resulting in token count and other metrics to show up as zero. This was not causing tracing to break.
2025-01-21 18:01:56 -08:00
Aayush
fcd8cfb9fc
add in honeycomb support for weather-forecast demo (#345) 2025-01-21 17:15:27 -08:00
Salman Paracha
bea0dd4a83
Update README.md 2025-01-21 10:56:17 -08:00
Salman Paracha
4bbf6c382e
Update README.md 2025-01-20 15:03:19 -08:00
Salman Paracha
8d1f132b75
Update README.md 2025-01-20 15:02:43 -08:00
Salman Paracha
966901d2a5
Update README.md 2025-01-20 14:46:14 -08:00
Salman Paracha
0fe0e775ee
Update README.md 2025-01-20 14:45:51 -08:00
Salman Paracha
e2ec2f6bb8
Salmanap/fix readme 019a (#373)
* updated README based on feedback on reddit

* fixed typo

* updating README with minor fixes

* more fixes to README

* updated README

* updated README

* updated README

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2025-01-20 14:44:40 -08:00
Salman Paracha
c8b5137d37
updated README based on feedback on reddit (#372)
* updated README based on feedback on reddit

* fixed typo

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2025-01-20 13:56:09 -08:00
Adil Hafeez
452084423c
add PR to release 0.1.9 (#371) 2025-01-17 18:47:26 -08:00