apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-02 04:12:56 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Salmanap/docs v1 push (#92)

Browse source 
* updated model serving, updated the config references, architecture docs and added the llm_provider section

* several documentation changes to improve sections like life_of_a_request, model serving subsystem

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
This commit is contained in:
Salman Paracha 2024-09-27 15:37:49 -07:00 • committed by GitHub
parent 8a4e11077c
commit 7168b14ed3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
19 changed files with 375 additions and 119 deletions
Download patch file Download diff file Expand all files Collapse all files

5
docs/source/intro/what_is_arch.rst
View file

@ -9,12 +9,17 @@ attempts, intelligently calling “backend” APIs to fulfill the user's request
and offering disaster recovery between upstream LLMs, and managing the observability of prompts and LLM interactions
in a centralized way.
.. image:: /_static/img/arch-logo.png
:width: 100%
:align: center
**The project was born out of the belief that:**
*Prompts are nuanced and opaque user requests, which require the same capabilities as traditional HTTP requests
including secure handling, intelligent routing, robust observability, and integration with backend (API)
systems for personalization - all outside business logic.*
In practice, achieving the above goal is incredibly difficult. Arch attempts to do so by providing the
following high level features: