CREDO23
b4ad8c5f4c
feat(google_search): register scrape capability
2026-07-04 20:49:58 +02:00
CREDO23
fcf1c6e052
feat(google_search): add scrape executor
2026-07-04 20:49:58 +02:00
CREDO23
b568dbefda
feat(google_search): add scrape verb schemas
2026-07-04 20:49:58 +02:00
Anish Sarkar
82141d8047
chore: fix docs
2026-07-04 17:45:43 +05:30
Anish Sarkar
0a83bf6192
test(native-connector): cover reddit schemas and url resolver
2026-07-04 17:28:21 +05:30
Anish Sarkar
0ef02c43cc
test(native-connector): cover reddit parser mappings
2026-07-04 17:28:17 +05:30
Anish Sarkar
1b1e612e20
test(native-connector): cover reddit fetch resilience
2026-07-04 17:28:13 +05:30
Anish Sarkar
4d950ddcb5
test(native-connector): add reddit post fixture
2026-07-04 17:28:08 +05:30
Anish Sarkar
672f79d620
test(native-connector): add reddit listing fixture
2026-07-04 17:28:02 +05:30
Anish Sarkar
83f52b17b1
test(native-connector): add reddit comment fixture
2026-07-04 17:27:56 +05:30
Anish Sarkar
f14bf1f06d
test(native-connector): add reddit scraper test package
2026-07-04 17:27:53 +05:30
Anish Sarkar
975fdad0ef
test(native-connector): add live reddit scraper e2e check
2026-07-04 17:27:47 +05:30
Anish Sarkar
3956045221
feat(native-connector): classify reddit scrape urls
2026-07-04 17:27:44 +05:30
Anish Sarkar
eaa8239e36
feat(native-connector): add reddit scraper orchestrator
2026-07-04 17:27:38 +05:30
Anish Sarkar
dd43ab8505
feat(native-connector): add reddit scraper schemas
2026-07-04 17:27:33 +05:30
Anish Sarkar
0745f433ab
feat(native-connector): add reddit json parsers
2026-07-04 17:27:22 +05:30
Anish Sarkar
7151465e12
feat(native-connector): add anonymous reddit fetch layer
2026-07-04 17:27:13 +05:30
Anish Sarkar
1115d647cb
feat(native-connector): expose reddit scraper public API
2026-07-04 17:26:58 +05:30
Anish Sarkar
54eab56b25
docs(native-connector): document anonymous reddit scraper design
2026-07-04 17:26:12 +05:30
DESKTOP-RTLN3BA\$punk
0d83916cc5
feat(native-connector): added google search results scraper
2026-07-03 20:51:45 -07:00
Rohan Verma
de04ef7111
Merge pull request #1567 from CREDO23/feature-ci_phase-4-7
...
[Feat] CI: unified web.crawl + per-platform subagents; retire legacy connectors
2026-07-03 14:55:07 -07:00
CREDO23
dd61728111
refactor(subagents): drop automation/monitoring framing from prompts (keep in-chat comparison)
2026-07-03 18:36:48 +02:00
CREDO23
7691e95e36
refactor(capabilities): drop Apify references from web/youtube docstrings
2026-07-03 17:57:13 +02:00
CREDO23
b5d221c19c
fix(capabilities): map any executor fault to 502 at the REST door
2026-07-03 17:57:07 +02:00
CREDO23
0844dd581f
refactor(routes): drop duplicate /google-maps/* routes (use capability doors)
2026-07-03 17:56:59 +02:00
CREDO23
2c76ef1f57
feat(subagents): add google_maps builtin subagent
2026-07-03 17:56:53 +02:00
CREDO23
f31823f765
feat(google_maps): add scrape + reviews capability verbs
2026-07-03 17:56:43 +02:00
CREDO23
d5d673384f
Merge upstream/ci_mvp (google maps scrapers) into feature-ci_phase-4-7
...
Resolve conflicts against the new native google-maps actor + repo-wide
ruff-format pass:
- Keep legacy webcrawler KB indexer + its test deleted (modify/delete).
- test_validators: keep WEBCRAWLER case removed (validator gone).
- test_fetch_resilience: keep platforms.youtube import path (our reorg).
- Relocate google_maps actor + tests scrapers/ -> platforms/ to match the
reorg convention (youtube already there); rewrite imports + fixture paths.
- Add missing __init__.py across the capabilities/ test subtree so duplicate
test basenames get unique module paths under importlib mode.
Note: google_maps fixture-backed tests error on ci_mvp too (fixtures/*.json
never committed upstream) - pre-existing, out of scope here.
2026-07-03 12:37:12 +02:00
CREDO23
817ec0e9f4
refactor(youtube): remove legacy KB ingestion; use actor get_youtube_video_id
2026-07-03 12:00:22 +02:00
CREDO23
ab6be6cbda
refactor(connectors): remove legacy web-crawler KB indexer paths (keep enums)
2026-07-03 11:53:33 +02:00
CREDO23
e3ed3b2be3
refactor(subagents): remove dormant research subagent
2026-07-03 11:43:26 +02:00
CREDO23
62cb0efb44
refactor(youtube): drop duplicate POST /youtube/scrape+comments routes (use capability doors)
2026-07-03 11:38:56 +02:00
CREDO23
c66b2f0e0e
refactor(automations): remove phase-6 chat watch (watch service/routes + chat_message action)
2026-07-03 11:20:22 +02:00
CREDO23
5da624399d
refactor(subagents): split scraping into web_crawler + youtube builtins
2026-07-03 11:20:09 +02:00
CREDO23
3312a442f3
refactor(proprietary): move scrapers/ -> platforms/ (one subpackage per platform)
2026-07-03 11:01:58 +02:00
CREDO23
9fe9c5b71d
feat(capabilities): replace web.scrape/web.discover with unified web.crawl
...
web.crawl scrapes a single URL (maxCrawlDepth=0) or spiders a whole site,
backed by the proprietary site_crawler engine. Rewires the scraping subagent
tools and capability tests onto the new verb.
2026-07-03 10:51:05 +02:00
CREDO23
f82fae3973
feat(web-crawler): add site_crawler spider + url_policy over the fetch engine
2026-07-03 10:50:41 +02:00
DESKTOP-RTLN3BA\$punk
7185079bd6
feat(native-connector): added google maps places & reviews scrapers
2026-07-02 21:58:24 -07:00
CREDO23
5d0bd8125b
test(capabilities): cover youtube verb schemas, executors, and registry
2026-07-02 20:18:53 +02:00
CREDO23
f967cebe92
docs(scraping-agent): surface youtube in description and prompt
2026-07-02 20:18:53 +02:00
CREDO23
c467a99dc6
feat(scraping-agent): wire youtube verbs into subagent tools
2026-07-02 20:18:53 +02:00
CREDO23
0b2dba7a57
feat(capabilities): expose youtube.* verbs on the REST door
2026-07-02 20:18:53 +02:00
CREDO23
6c3735db19
feat(capabilities): add youtube.scrape and youtube.comments verbs
2026-07-02 20:18:53 +02:00
CREDO23
af3e70ea56
Merge upstream/ci_mvp: add YouTube scraper actor under app/proprietary
...
Resolved modify/delete conflicts on the old 'revamp phases 4-7/' plan docs
by keeping our deletion (superseded by flattened plans/backend/00-*.md).
2026-07-02 20:01:11 +02:00
CREDO23
6bd0d640e6
refactor(capabilities): group framework into core/, keep verbs top-level
2026-07-02 19:54:20 +02:00
CREDO23
87df0bb629
fix(web.discover): cap results to top_k
2026-07-02 19:40:37 +02:00
CREDO23
43893fc1f8
docs(plans): drop remaining intelligence_agent references
2026-07-02 19:05:45 +02:00
CREDO23
df09654db7
docs(plans): sync phase 4-7 state; rename to scraping subagent
2026-07-02 19:04:26 +02:00
CREDO23
9738392161
refactor(agents): rename intelligence_agent subagent to scraping
2026-07-02 18:59:34 +02:00
CREDO23
790507d107
feat(capabilities): meter captcha, truncate scrape, bound discover
2026-07-02 18:32:42 +02:00
