* add support for custom llm with ssl support
Add support for using custom llm that are served through https protocol.
* add instructions on how to add custom inference endpoint
* fix formatting
* add more details
* Apply suggestions from code review
Co-authored-by: Salman Paracha <salman.paracha@gmail.com>
* Apply suggestions from code review
* fix precommit
---------
Co-authored-by: Salman Paracha <salman.paracha@gmail.com>
* Fix llm_routing provider element
We replaced provider with provider_interface to make it more clear to developers about provider api/backend being used. During that upgrade we removed support for mistral in provider to encourage developers to start using provider_interface. But this demo was not updated to use provider_interface as it was using mistral. This code change fixes it by replacing provider with provider_interface.
Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>
* fix the path
* move
* add more details
* fix
* Apply suggestions from code review
* fix
* fix
---------
Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>
* updated docs for 0.1.8 support
* updated REAMDE on root
* updated version reference to 0.1.8 in other parts of the repo
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* updating doc versions, images and cleaning up section for prompt-guard
* updating based on feedback
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* updated all demo READMes and minor doc changes
* minor typo fixes
* updated main Readme
* fixed README and docs
* fixed README and docs
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* staging my changes to re-based from main
* adding debug statements to rust
* merged with main
* ready to push network agent
* removed the incomplete sql example
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* Fix link issues and add icons
* Improve Doc
* fix test
* making minor modifications to shuguangs' doc changes
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
* ensure that we can call the new api.fc.archgw.com url, logging fixes and minor cli bug fixes
* fixed a bug where model_server printed on terminal after start script stopped running
* updating the logo and fixing the website styles
* updated the branch with feedback from Co and Adil
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* init update
* Update terminology.rst
* fix the branch to create an index.html, and fix pre-commit issues
* Doc update
* made several changes to the docs after Shuguang's revision
* fixing pre-commit issues
* fixed the reference file to the final prompt config file
* added google analytics
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* updated model serving, updated the config references, architecture docs and added the llm_provider section
* several documentation changes to improve sections like life_of_a_request, model serving subsystem
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* updated docs (again)
* updated the LLMs section, prompt processing section and the RAG section of the docs
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
* added the first set of docs for our technical docs
* more docuemtnation changes
* added support for prompt processing and updated life of a request
* updated docs to including getting help sections and updated life of a request
* committing local changes for getting started guide, sample applications, and full reference spec for prompt-config
* updated configuration reference, added sample app skeleton, updated favico
* fixed the configuration refernce file, and made minor changes to the intent detection. commit v1 for now
* Updated docs with use cases and example code, updated what is arch, and made minor changes throughout
* fixed imaged and minor doc fixes
* add sphinx_book_theme
* updated README, and make some minor fixes to documetnation
* fixed README.md
* fixed image width
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
* added the first set of docs for our technical docs
* more docuemtnation changes
* added support for prompt processing and updated life of a request
* updated docs to including getting help sections and updated life of a request
* committing local changes for getting started guide, sample applications, and full reference spec for prompt-config
* updated configuration reference, added sample app skeleton, updated favico
* fixed the configuration refernce file, and made minor changes to the intent detection. commit v1 for now
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
