Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
# HTTP Server (`omnigraph-server`)
|
|
|
|
|
|
2026-05-24 16:46:00 +01:00
|
|
|
Axum 0.8 + tokio + utoipa-generated OpenAPI. Single graph per process; deploy multiple processes for multi-tenant.
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
|
|
|
|
|
## Endpoint inventory
|
|
|
|
|
|
|
|
|
|
| Method | Path | Auth | Action | Handler |
|
|
|
|
|
|---|---|---|---|---|
|
|
|
|
|
| GET | `/healthz` | none | — | `server_health` |
|
|
|
|
|
| GET | `/openapi.json` | none | — | `server_openapi` (strips security if auth disabled) |
|
|
|
|
|
| GET | `/snapshot?branch=` | bearer + `read` | snapshot of branch | `server_snapshot` |
|
2026-05-23 13:34:28 +00:00
|
|
|
| POST | `/query` | bearer + `read` | run inline read query (canonical; clean field names `query`/`name`; mutations → 400) | `server_query` |
|
|
|
|
|
| POST | `/read` | bearer + `read` | **deprecated** alias of `/query` for legacy clients (legacy field names `query_source`/`query_name`, byte-stable response); response carries `Deprecation: true` + `Link: </query>; rel="successor-version"` | `server_read` |
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
| POST | `/export` | bearer + `export` | NDJSON stream | `server_export` |
|
2026-05-23 13:34:28 +00:00
|
|
|
| POST | `/mutate` | bearer + `change` | mutation query (canonical; `query`/`name`; accepts legacy `query_source`/`query_name` as serde aliases) | `server_mutate` |
|
|
|
|
|
| POST | `/change` | bearer + `change` | **deprecated** alias of `/mutate` for legacy clients; response carries `Deprecation: true` + `Link: </mutate>; rel="successor-version"` | `server_change` |
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
| GET | `/schema` | bearer + `read` | get current `.pg` source | `server_schema_get` |
|
|
|
|
|
| POST | `/schema/apply` | bearer + `schema_apply` (target=`main`) | migrate | `server_schema_apply` |
|
|
|
|
|
| POST | `/ingest` | bearer + `branch_create` (if new) + `change` | bulk load | `server_ingest` (32 MB body limit) |
|
|
|
|
|
| GET | `/branches` | bearer + `read` | list branches | `server_branch_list` |
|
|
|
|
|
| POST | `/branches` | bearer + `branch_create` | create | `server_branch_create` |
|
|
|
|
|
| DELETE | `/branches/{branch}` | bearer + `branch_delete` | delete | `server_branch_delete` |
|
|
|
|
|
| POST | `/branches/merge` | bearer + `branch_merge` | merge `source → target` | `server_branch_merge` |
|
|
|
|
|
| GET | `/commits?branch=` | bearer + `read` | list | `server_commit_list` |
|
|
|
|
|
| GET | `/commits/{commit_id}` | bearer + `read` | show | `server_commit_show` |
|
|
|
|
|
|
feat(MR-656): inline query strings in CLI and HTTP server
CLI:
- Add -e / --query-string <STRING> to omnigraph read and omnigraph change
- Exactly one of --query, --query-string, --alias is required (3-way XOR)
- Empty --query-string is rejected with a clear error
HTTP:
- New POST /query (read-only, clean field names: query/name/params/branch/snapshot)
- Mutations on /query are rejected with 400 -- use POST /change instead
- ChangeRequest fields polished: query (alias query_source), name (alias query_name)
- POST /read and POST /change remain byte-compatible for existing clients
Tests:
- cli.rs: -e happy-path on read/change, mutex error vs --query, empty -e rejected
- system_local.rs: inline -e read and -e change exercise the local flow
- system_remote.rs: inline -e read/change over HTTP plus direct /query 200/400
- server.rs: /query 200, /query 400 on mutation, /change legacy field alias
- openapi.rs: new /query path, QueryRequest schema, ChangeRequest field-name polish
Docs: cli.md (-e examples), cli-reference.md (read/change rows), server.md (/query)
Co-Authored-By: Ragnor Comerford <ragnor.comerford@gmail.com>
2026-05-22 17:54:26 +00:00
|
|
|
## Inline read queries (`POST /query`)
|
|
|
|
|
|
|
|
|
|
`POST /query` is the read-only, agent-friendly twin of `POST /read`. The
|
|
|
|
|
request body uses clean field names that match the CLI `-e` flag and the GQ
|
|
|
|
|
`query` keyword:
|
|
|
|
|
|
|
|
|
|
```json
|
|
|
|
|
{
|
|
|
|
|
"query": "query find($n: String) { match { $p: Person { name: $n } } return { $p.name } }",
|
|
|
|
|
"name": "find",
|
|
|
|
|
"params": { "n": "Alice" },
|
|
|
|
|
"branch": "main",
|
|
|
|
|
"snapshot": null
|
|
|
|
|
}
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Response shape is identical to `/read` (`ReadOutput`). If the inline source
|
|
|
|
|
contains mutations (`insert` / `update` / `delete`), the request is rejected
|
2026-05-23 13:34:28 +00:00
|
|
|
with HTTP 400 and an error pointing the caller at `POST /mutate` — the
|
feat(MR-656): inline query strings in CLI and HTTP server
CLI:
- Add -e / --query-string <STRING> to omnigraph read and omnigraph change
- Exactly one of --query, --query-string, --alias is required (3-way XOR)
- Empty --query-string is rejected with a clear error
HTTP:
- New POST /query (read-only, clean field names: query/name/params/branch/snapshot)
- Mutations on /query are rejected with 400 -- use POST /change instead
- ChangeRequest fields polished: query (alias query_source), name (alias query_name)
- POST /read and POST /change remain byte-compatible for existing clients
Tests:
- cli.rs: -e happy-path on read/change, mutex error vs --query, empty -e rejected
- system_local.rs: inline -e read and -e change exercise the local flow
- system_remote.rs: inline -e read/change over HTTP plus direct /query 200/400
- server.rs: /query 200, /query 400 on mutation, /change legacy field alias
- openapi.rs: new /query path, QueryRequest schema, ChangeRequest field-name polish
Docs: cli.md (-e examples), cli-reference.md (read/change rows), server.md (/query)
Co-Authored-By: Ragnor Comerford <ragnor.comerford@gmail.com>
2026-05-22 17:54:26 +00:00
|
|
|
read-only contract is enforced at the URL.
|
|
|
|
|
|
2026-05-23 13:34:28 +00:00
|
|
|
`POST /mutate` is the canonical mutation endpoint. It accepts the same clean
|
|
|
|
|
field names (`query`, `name`); the legacy field names `query_source` and
|
|
|
|
|
`query_name` continue to deserialize as serde aliases so existing clients keep
|
|
|
|
|
working without changes.
|
|
|
|
|
|
|
|
|
|
## Deprecated names (`/read`, `/change`)
|
|
|
|
|
|
|
|
|
|
`POST /read` and `POST /change` are kept for back-compat indefinitely — they
|
|
|
|
|
are byte-stable on the request side and otherwise behave identically to
|
|
|
|
|
`/query` / `/mutate`. They are flagged as deprecated through three independent
|
|
|
|
|
channels:
|
|
|
|
|
|
|
|
|
|
- **OpenAPI**: the operations carry `deprecated: true` in `openapi.json`, so
|
|
|
|
|
every OpenAPI codegen (typescript-fetch, openapi-generator, oapi-codegen,
|
|
|
|
|
…) emits a `@deprecated` marker on the generated SDK method.
|
|
|
|
|
- **Response headers (RFC 9745)**: every response carries `Deprecation: true`.
|
|
|
|
|
- **Response headers (RFC 8288)**: every response carries a `Link` header
|
|
|
|
|
pointing at the canonical successor:
|
|
|
|
|
`Link: </query>; rel="successor-version"` for `/read`, and
|
|
|
|
|
`Link: </mutate>; rel="successor-version"` for `/change`. SDKs and HTTP
|
|
|
|
|
proxies can pick the successor up automatically.
|
|
|
|
|
|
|
|
|
|
Migration is purely cosmetic on the client side — swap the URL path, leave
|
|
|
|
|
the request body and response handling alone.
|
feat(MR-656): inline query strings in CLI and HTTP server
CLI:
- Add -e / --query-string <STRING> to omnigraph read and omnigraph change
- Exactly one of --query, --query-string, --alias is required (3-way XOR)
- Empty --query-string is rejected with a clear error
HTTP:
- New POST /query (read-only, clean field names: query/name/params/branch/snapshot)
- Mutations on /query are rejected with 400 -- use POST /change instead
- ChangeRequest fields polished: query (alias query_source), name (alias query_name)
- POST /read and POST /change remain byte-compatible for existing clients
Tests:
- cli.rs: -e happy-path on read/change, mutex error vs --query, empty -e rejected
- system_local.rs: inline -e read and -e change exercise the local flow
- system_remote.rs: inline -e read/change over HTTP plus direct /query 200/400
- server.rs: /query 200, /query 400 on mutation, /change legacy field alias
- openapi.rs: new /query path, QueryRequest schema, ChangeRequest field-name polish
Docs: cli.md (-e examples), cli-reference.md (read/change rows), server.md (/query)
Co-Authored-By: Ragnor Comerford <ragnor.comerford@gmail.com>
2026-05-22 17:54:26 +00:00
|
|
|
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
## Streaming
|
|
|
|
|
|
|
|
|
|
Only `/export` streams (`application/x-ndjson`, MPSC channel + `Body::from_stream`). Everything else is buffered JSON.
|
|
|
|
|
|
|
|
|
|
## Error model
|
|
|
|
|
|
2026-05-09 20:58:17 +00:00
|
|
|
Uniform `ErrorOutput { error, code?, merge_conflicts[], manifest_conflict? }` with `code ∈ unauthorized | forbidden | bad_request | not_found | conflict | too_many_requests | internal`. Merge conflicts attach structured `MergeConflictOutput { table_key, row_id?, kind, message }`.
|
2026-04-30 08:52:50 +02:00
|
|
|
|
|
|
|
|
`manifest_conflict` is set on **publisher CAS rejections** (HTTP 409): the
|
|
|
|
|
caller's pre-write view of one table's manifest version was stale.
|
|
|
|
|
`ManifestConflictOutput { table_key, expected, actual }` tells the client
|
|
|
|
|
which table to refresh and retry. This is the conflict shape produced by
|
2026-05-23 13:34:28 +00:00
|
|
|
concurrent `/mutate` (or its `/change` alias) or `/ingest` calls landing
|
|
|
|
|
the same `(table, branch)` race.
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
|
2026-05-09 20:58:17 +00:00
|
|
|
HTTP status codes used: 200, 400, 401, 403, 404, 409, 429, 500.
|
2026-05-07 17:09:49 +02:00
|
|
|
|
2026-05-10 14:16:26 +00:00
|
|
|
## Per-actor admission control
|
2026-05-07 17:09:49 +02:00
|
|
|
|
2026-05-10 14:16:26 +00:00
|
|
|
Disjoint
|
2026-05-07 17:09:49 +02:00
|
|
|
`(table, branch)` writes from different actors now run concurrently,
|
|
|
|
|
guarded only by the engine's per-(table, branch) write queue. To keep
|
|
|
|
|
one heavy actor from exhausting shared capacity (Lance I/O, manifest
|
|
|
|
|
churn, network), the server gates mutating handlers through a
|
|
|
|
|
`WorkloadController` configured per-process from environment variables:
|
|
|
|
|
|
|
|
|
|
| Env var | Default | Purpose |
|
|
|
|
|
|---|---|---|
|
|
|
|
|
| `OMNIGRAPH_PER_ACTOR_INFLIGHT_MAX` | 16 | Concurrent in-flight mutations per actor |
|
|
|
|
|
| `OMNIGRAPH_PER_ACTOR_BYTES_MAX` | 4 GiB | In-flight estimated bytes per actor |
|
|
|
|
|
|
|
|
|
|
When an actor exceeds its in-flight count or byte budget, the server
|
|
|
|
|
returns **HTTP 429 Too Many Requests** with `code: too_many_requests`
|
|
|
|
|
and a `Retry-After` header (seconds). The actor should back off; other
|
|
|
|
|
actors are unaffected.
|
|
|
|
|
|
|
|
|
|
Cedar policy authorization runs **before** admission accounting so
|
|
|
|
|
denied requests don't consume admission slots.
|
|
|
|
|
|
2026-05-23 13:34:28 +00:00
|
|
|
Today admission gates every mutating handler: `/mutate` (and its
|
|
|
|
|
deprecated alias `/change`), `/ingest`, `/branches/{create,delete,merge}`,
|
|
|
|
|
and `/schema/apply`. Read-only endpoints (`/snapshot`, `/query`, `/read`,
|
|
|
|
|
`/export`, `/branches` GET, `/commits`, `/schema` GET) are not
|
|
|
|
|
admission-gated.
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
|
|
|
|
|
## Body limits
|
|
|
|
|
|
|
|
|
|
- Default: 1 MB
|
|
|
|
|
- `/ingest`: 32 MB
|
|
|
|
|
|
|
|
|
|
## Auth model (`bearer + SHA-256`)
|
|
|
|
|
|
|
|
|
|
- Tokens are SHA-256 hashed on startup; plaintext is never persisted in memory.
|
|
|
|
|
- Constant-time comparison via `subtle::ConstantTimeEq`.
|
|
|
|
|
- Three sources, in precedence:
|
|
|
|
|
1. `OMNIGRAPH_SERVER_BEARER_TOKENS_AWS_SECRET` — AWS Secrets Manager (build with `--features aws`)
|
|
|
|
|
2. `OMNIGRAPH_SERVER_BEARER_TOKENS_FILE` or `OMNIGRAPH_SERVER_BEARER_TOKENS_JSON` — JSON `{actor_id: token, …}`
|
|
|
|
|
3. `OMNIGRAPH_SERVER_BEARER_TOKEN` — single legacy token, actor `default`
|
|
|
|
|
- If no tokens configured, server runs unauthenticated (local dev) and `/openapi.json` strips the security scheme.
|
|
|
|
|
|
|
|
|
|
See [deployment.md](deployment.md) for token-source operational details.
|
|
|
|
|
|
|
|
|
|
## Tracing & observability
|
|
|
|
|
|
|
|
|
|
- `tower_http::TraceLayer::new_for_http()`
|
|
|
|
|
- Policy decisions logged at INFO level with actor, action, branch, decision, matched rule
|
2026-05-24 16:46:00 +01:00
|
|
|
- Startup logs: token source name, graph URI, bind address
|
Refactor AGENTS.md from encyclopedia to map; move spec into docs/
Splits the 990-line AGENTS.md into a 184-line map (architecture,
where-to-find index, always-on invariants, capability matrix,
maintenance contract) plus 18 new docs/*.md files holding the deep
content per topic (storage, schema and query languages, indexes,
embeddings, branches/commits, runs, merge, changes, execution, policy,
server, CLI reference, audit, errors, CI, constants, v0.3.1 notes).
Adds scripts/check-agents-md.sh and a check_agents_md CI job that
verifies every docs/ link in AGENTS.md resolves and every doc in the
canonical set is linked. CLAUDE.md remains a symlink to AGENTS.md.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-28 23:31:08 +02:00
|
|
|
- Graceful SIGINT shutdown
|
|
|
|
|
|
|
|
|
|
## Not implemented (by design or "TBD")
|
|
|
|
|
|
|
|
|
|
- CORS — not configured; add `tower_http::cors` if needed.
|
2026-05-23 13:34:28 +00:00
|
|
|
- Rate limiting — per-actor admission control gates `/mutate` (alias
|
|
|
|
|
`/change`), `/ingest`, `/branches/{create,delete,merge}`,
|
|
|
|
|
`/schema/apply` (see "Per-actor
|
2026-05-08 16:59:45 +02:00
|
|
|
admission control" above). No global rate limiter is configured;
|
|
|
|
|
add `tower_http::limit` if a graph-wide cap is needed.
|
2026-04-30 08:52:50 +02:00
|
|
|
- Pagination — none (commits/branches return everything; export streams).
|
2026-05-24 16:46:00 +01:00
|
|
|
- Multi-tenant routing — one graph per process.
|