Commit graph

356 commits

Author SHA1 Message Date
Adil Hafeez
723a70753a
add more files 2025-01-29 16:14:20 -08:00
Adil Hafeez
69b43a7abf
add more files 2025-01-29 16:11:44 -08:00
Adil Hafeez
6afdc7f57c
add policy details 2025-01-29 13:16:11 -08:00
Adil Hafeez
fc217fc5e8
Merge branch 'main' into adil/add_acm_demo 2025-01-28 13:33:42 -08:00
Adil Hafeez
a7feb6bffb
fix llm_provider format (#385) 2025-01-24 20:35:56 -08:00
Adil Hafeez
7830f4b431
release 0.2.0 (#384)
* release 0.2.0

* update versions
2025-01-24 17:31:48 -08:00
Adil Hafeez
38f7691163
add support for custom llm with ssl support (#380)
* add support for custom llm with ssl support

Add support for using custom llm that are served through https protocol.

* add instructions on how to add custom inference endpoint

* fix formatting

* add more details

* Apply suggestions from code review

Co-authored-by: Salman Paracha <salman.paracha@gmail.com>

* Apply suggestions from code review

* fix precommit

---------

Co-authored-by: Salman Paracha <salman.paracha@gmail.com>
2025-01-24 17:14:24 -08:00
Adil Hafeez
2c67fa3bc0
Fix llm_routing provider element (#382)
* Fix llm_routing provider element

We replaced provider with provider_interface to make it more clear to developers about provider api/backend being used. During that upgrade we removed support for mistral in provider to encourage developers to start using provider_interface. But this demo was not updated to use provider_interface as it was using mistral. This code change fixes it by replacing provider with provider_interface.

Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>

* fix the path

* move

* add more details

* fix

* Apply suggestions from code review

* fix

* fix

---------

Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>
2025-01-24 16:34:11 -08:00
Guy Stone
84af476c75
Add run_demo.sh for llm_routing demo (#381)
* Create run_demo.sh for llm_routing demo

* Update run_demo.sh
2025-01-24 14:41:51 -08:00
Adil Hafeez
5d4cd624c1 more changes 2025-01-23 17:36:56 -08:00
Adil Hafeez
5ed7e0b185 Merge branch 'adil/log_improvements' into adil/add_acm_demo 2025-01-23 14:23:06 -08:00
Adil Hafeez
4ab7665c30 log improvements 2025-01-23 14:22:16 -08:00
Salman Paracha
1e75c1c5e0 updating README 2025-01-23 11:31:10 -08:00
Salman Paracha
1d9bfcb7db
Update README.md 2025-01-23 11:26:21 -08:00
Salman Paracha
f9bed5d75c
Update README.md 2025-01-23 11:25:46 -08:00
Adil Hafeez
411b6904b7 fix http hosts header 2025-01-23 11:05:24 -08:00
Adil Hafeez
613192f71c Merge branch 'main' into adil/add_acm_demo 2025-01-22 14:10:18 -08:00
Adil Hafeez
6740a09952
add docker-compose file for honeycomb tracing (#377) 2025-01-22 14:02:59 -08:00
Adil Hafeez
6887d52750
When using ollama token count was not coming in (#375)
When using ollama token count was not coming in resulting in token count and other metrics to show up as zero. This was not causing tracing to break.
2025-01-21 18:01:56 -08:00
Aayush
fcd8cfb9fc
add in honeycomb support for weather-forecast demo (#345) 2025-01-21 17:15:27 -08:00
Salman Paracha
bea0dd4a83
Update README.md 2025-01-21 10:56:17 -08:00
Salman Paracha
4bbf6c382e
Update README.md 2025-01-20 15:03:19 -08:00
Salman Paracha
8d1f132b75
Update README.md 2025-01-20 15:02:43 -08:00
Salman Paracha
966901d2a5
Update README.md 2025-01-20 14:46:14 -08:00
Salman Paracha
0fe0e775ee
Update README.md 2025-01-20 14:45:51 -08:00
Salman Paracha
e2ec2f6bb8
Salmanap/fix readme 019a (#373)
* updated README based on feedback on reddit

* fixed typo

* updating README with minor fixes

* more fixes to README

* updated README

* updated README

* updated README

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2025-01-20 14:44:40 -08:00
Salman Paracha
c8b5137d37
updated README based on feedback on reddit (#372)
* updated README based on feedback on reddit

* fixed typo

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2025-01-20 13:56:09 -08:00
Adil Hafeez
452084423c
add PR to release 0.1.9 (#371) 2025-01-17 18:47:26 -08:00
Adil Hafeez
253017e93d Merge branch 'main' into adil/add_acm_demo 2025-01-17 18:26:27 -08:00
Adil Hafeez
07ef3149b8
add support for using custom upstream llm (#365) 2025-01-17 18:25:55 -08:00
Adil Hafeez
5c066c9825 add more changes 2025-01-17 18:24:59 -08:00
Adil Hafeez
c532a5f4c7 Merge branch 'adil/fix_prompt_target_name' into adil/add_acm_demo 2025-01-17 17:50:40 -08:00
Adil Hafeez
1b3c1b8ba5 fix tests 2025-01-17 16:52:38 -08:00
Adil Hafeez
36c9c0d414 fix tests 2025-01-17 16:41:55 -08:00
Adil Hafeez
c235eaf762 fix test 2025-01-17 16:39:13 -08:00
Adil Hafeez
aca1631b49 add more changes 2025-01-17 16:33:17 -08:00
Adil Hafeez
a7b9458e5a fix rust tests 2025-01-17 11:00:36 -08:00
Adil Hafeez
46cca42040 fix more 2025-01-16 18:31:40 -08:00
Adil Hafeez
aa649d5d80 add schema validator for provider 2025-01-16 17:18:26 -08:00
Adil Hafeez
00e4ba55a8 ensure that only openai is used for provider 2025-01-16 17:13:45 -08:00
Adil Hafeez
c7f8c2cef9 add demo for ollama 2025-01-16 16:34:17 -08:00
Adil Hafeez
2928b7630f Merge branch 'main' into adil/fix_prompt_target_name 2025-01-16 15:14:57 -08:00
Adil Hafeez
3fc21de60c
Send per prompt target system prompt (#368)
* update prompt target name after arch_fc has identified tool

* add test for currency exchange
2025-01-16 15:11:37 -08:00
Adil Hafeez
5017e7931e fix tracing 2025-01-16 14:37:09 -08:00
Adil Hafeez
2413f56980 pending changes 2025-01-16 14:33:59 -08:00
Adil Hafeez
1a10b82724 pending changes 2025-01-14 16:32:52 -08:00
Adil Hafeez
9570b167db fix tracing 2025-01-14 11:56:10 -08:00
Adil Hafeez
35065e2e41 Merge branch 'main' into adil/fix_prompt_target_name 2025-01-14 10:20:49 -08:00
Adil Hafeez
a24d62af1a
add github pull request in vscode (#367) 2025-01-14 10:20:27 -08:00
Adil Hafeez
b8474f42c9 Merge branch 'main' into adil/fix_prompt_target_name 2025-01-13 15:53:40 -08:00