apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-05 22:02:43 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

V1 docs push (#86)

Browse source 
* updated docs (again)

* updated the LLMs section, prompt processing section and the RAG section of the docs

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
This commit is contained in:
Salman Paracha 2024-09-25 23:43:34 -07:00 • committed by GitHub
parent 3511798fa8
commit 48a2c1800c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
13 changed files with 222 additions and 79 deletions
Download patch file Download diff file Expand all files Collapse all files

8
docs/source/observability/stats.rst
View file

@ -1,3 +1,7 @@
Metrics and Statistics
======================
Monitoring
==========
Arch offers several monitoring metrics that help you understand three critical aspects of your application:
latency, token usage, and error rates by an upstream LLM provider. Latency measures the speed at which your
application is responding to users, which includes metrics like time to first token (TFT), time per output
token (TOT) metrics, and the total latency as perceived by users.

14
docs/source/observability/tracing.rst
View file

@ -175,33 +175,33 @@ specialized services and external systems.
Trace Breakdown:
****************
- **Customer Interaction**:
- Customer Interaction:
- Span 1: Customer initiates a request via the AI-powered chatbot for billing support (e.g., asking for payment details).
- **AI Agent 1 (Main - Arch)**:
- AI Agent 1 (Main - Arch):
- Span 2: AI Agent 1 (Main) processes the request and identifies it as related to billing, forwarding the request
to an external payment service.
- Span 3: AI Agent 1 determines that additional technical support is needed for processing and forwards the request
to AI Agent 2.
- **External Payment Service**:
- External Payment Service:
- Span 4: The external payment service processes the payment-related request (e.g., verifying payment status) and sends
the response back to AI Agent 1.
- **AI Agent 2 (Tech - Arch)**:
- AI Agent 2 (Tech - Arch):
- Span 5: AI Agent 2, responsible for technical queries, processes a request forwarded from AI Agent 1 (e.g., checking for
any account issues).
- Span 6: AI Agent 2 forwards the query to Internal Tech Support for further investigation.
- **Internal Tech Support**:
- Internal Tech Support:
- Span 7: Internal Tech Support processes the request (e.g., resolving account access issues) and responds to AI Agent 2.
- **AI Agent 3 (Orders - Arch)**:
- AI Agent 3 (Orders - Arch):
- Span 8: AI Agent 3 handles order-related queries. AI Agent 1 forwards the request to AI Agent 3 after payment verification
is completed.
- Span 9: AI Agent 3 forwards a request to the Inventory Management system to confirm product availability for a pending order.
- **Inventory Management**:
- Inventory Management:
- Span 10: The Inventory Management system checks stock and availability and returns the information to AI Agent 3.
Integrating with Tracing Tools