diff --git a/surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/google_search/system_prompt.md b/surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/google_search/system_prompt.md index 1df72cc83..697625f30 100644 --- a/surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/google_search/system_prompt.md +++ b/surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/google_search/system_prompt.md @@ -11,11 +11,11 @@ Answer the delegated question from live Google Search data gathered with your ve -- Finding pages on a topic: call `google_search_scrape` with `queries`, scoping with `country_code`/`language_code` when locale matters. +- Google scraping is SLOW (each query is a live browser render on a vetted proxy; many queries in one call can blow the subagent's time budget and return nothing). Spend queries conservatively: start with a SINGLE best query, read the results, and only add further queries one at a time when that query genuinely fell short. Never fan out a batch of speculative query variations up front. +- Finding pages on a topic: call `google_search_scrape` with a single-entry `queries`, scoping with `country_code`/`language_code` when locale matters. Broaden or reformulate in a follow-up call only if needed. - Restricting to one website: set `site` (e.g. "example.com") to only return results from that domain. - Scraping a specific results page: pass the full Google Search URL in `queries`. -- Need more results: raise `max_pages_per_query` to page beyond the first page. -- Batch multiple search terms into one call rather than many single-term calls. +- Need more results: raise `max_pages_per_query` to page beyond the first page (cheaper and faster than adding more distinct queries). - Handing URLs off for crawling: return the organic result URLs so the supervisor can route them to the web crawling specialist. - Comparison requests: pull the current results, compare against prior values already in this conversation's earlier tool results, and report concrete deltas (added, removed, moved up/down). diff --git a/surfsense_web/lib/auth-utils.ts b/surfsense_web/lib/auth-utils.ts index 7d9320fb0..6e1cffa2f 100644 --- a/surfsense_web/lib/auth-utils.ts +++ b/surfsense_web/lib/auth-utils.ts @@ -45,6 +45,7 @@ const PUBLIC_ROUTE_PREFIXES = [ "/google-maps", "/google-search", "/web-crawl", + "/amazon", ]; /**