Commit graph

322 commits

Author SHA1 Message Date
Bukely_
190f8b378b
Merge commit from fork
fix(security): patch prompt injection in PDF ingestion pipeline
2026-07-17 13:57:21 +08:00
Bukely_
c58cd62b50
Merge pull request #250 from VectifyAI/feat/md-bold-heading-recognition
Recognize whole-line bold as level-1 heading in markdown parser
2026-07-16 19:37:45 +08:00
BukeLy
01dbcbf47f fix(markdown): skip empty bold headings 2026-07-16 19:36:52 +08:00
BukeLy
b625906c78 fix(security): harden document boundary validation 2026-07-16 19:33:27 +08:00
BukeLy
3367144d50 fix(security): validate TOC identity before index updates 2026-07-16 18:44:01 +08:00
Savio Dsouza
9bcc7cff89
Refactor TOC entry update logic in page_index.py 2026-07-15 19:18:09 +05:30
Savio Dsouza
9470b63960
Fix indentation and formatting in page_index.py 2026-07-11 19:56:33 +05:30
Savio Dsouza
2e0c7b0e3b
Refactor TOC page number addition logic
Refactor page number addition logic in TOC processing to use current entries for updates.
2026-07-08 21:34:01 +05:30
Savio Dsouza
56ff64c108
Fix formatting and variable name inconsistencies 2026-07-06 16:44:28 +05:30
Savio Dsouza
94a882b394
Preserve prior physical index values in TOC
Store prior physical index values to restore them later.
2026-07-05 16:33:54 +05:30
Shreyansh Dubey
f413c66fee
fix: prevent KeyError crash and context exhaustion in TOC processing (#188)
* fix: prevent KeyError crash and context exhaustion in TOC processing

- Use .get() with safe defaults for all LLM response dict accesses
- Optimize extract_toc_content retry loop to grow chat_history
  incrementally instead of rebuilding with full accumulated response
- Optimize toc_transformer retry loop to use chat_history instead of
  re-embedding the entire raw TOC and incomplete JSON in each prompt
- Return best-effort results on max retries instead of raising
- Add 14 mock-based tests covering all fix scenarios

Closes #163

* fix: address review feedback on retry behavior and None guard

- Restore explicit Exception on max retries instead of silent warning
- Move truncation logic before the retry loop so it only runs once
  on the initial incomplete response, not on every iteration
- Add explicit None guard for physical_index before passing to
  convert_physical_index_to_int to prevent potential TypeError
- Update test to expect Exception on max retries

---------

Co-authored-by: Your Name <you@example.com>
2026-07-03 20:20:31 +08:00
dependabot[bot]
076dd07bd7
Bump actions/checkout from 4 to 7 (#338)
Bumps [actions/checkout](https://github.com/actions/checkout) from 4 to 7.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v4...v7)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-07-03 17:24:52 +08:00
Kylin
27f01e9e7d
fix: bump litellm to 1.84.0 to resolve python-dotenv install conflict (#342)
litellm 1.83.7 hard-pins python-dotenv==1.0.1, which conflicts with
python-dotenv==1.2.2 in requirements.txt and makes a fresh install fail
(ResolutionImpossible under both pip 25.2 and uv). Downgrading dotenv to
1.0.1 is not an option: python-dotenv < 1.2.2 is affected by
GHSA-mf9w-mj56-hr94 (moderate).

litellm 1.84.0 relaxed its pin to python-dotenv<2.0,>=1.0.0, allowing the
patched python-dotenv==1.2.2 to remain. Full requirements.txt resolves
cleanly under both pip and uv.

Closes #286
2026-07-03 16:40:28 +08:00
Mouli
2cf46689f9
Adds missing re import (#281) 2026-07-03 16:14:58 +08:00
Savio Dsouza
6d75f96fdd
Refactor section title handling and index validation
Updated section title logging to use secure document text formatting and improved physical index validation logic.
2026-07-02 08:33:17 +05:30
Savio Dsouza
abdca8efca
Update page_index.py 2026-06-30 12:59:44 +05:30
Savio Dsouza
ab23db0a9f
fix identation error and correct function 2026-06-28 17:22:01 +05:30
Savio Dsouza
2d8a14fd32
Update page_index.py 2026-06-26 19:51:37 +05:30
Ray
293730afbd
edit readme (#337) 2026-06-23 03:56:30 +08:00
Ray
42aa805339
edit readme (#336) 2026-06-23 01:11:20 +08:00
Ray
54346716bd
edit readme (#335) 2026-06-22 23:28:08 +08:00
Savio Dsouza
77e3c59e60
fixed typo 2026-06-20 16:31:29 +05:30
Ray
fe89f246f2
update readme 2026-06-19 07:44:04 +08:00
Savio Dsouza
624fcb48a6
Update page_index.py 2026-06-18 20:12:09 +05:30
Savio Dsouza
56e73a9ef1
Update page_index.py 2026-06-17 20:26:02 +05:30
Savio Dsouza
150d3aa28c
Update page_index.py 2026-06-17 20:20:09 +05:30
Savio Dsouza
536bf83668
Update page_index.py 2026-06-17 20:09:20 +05:30
Savio Dsouza
4dfef9d023
Update page_index.py 2026-06-16 21:32:37 +05:30
Savio Dsouza
9681cdab65
Implement document text sanitization and validation
Added functions to sanitize and secure document text against prompt injection patterns. Implemented validation for physical indices in the table of contents.
2026-06-08 00:32:04 +05:30
Ray
5a18553284 update readme 2026-06-06 06:08:19 +08:00
Ray
415288b4b2 update readme 2026-06-05 01:15:23 +08:00
Ray
4d4d14a38a update readme 2026-06-05 00:47:28 +08:00
Ray
7d2bdb9f28 update readme 2026-06-02 01:16:56 +08:00
Ray
c13eed7d6c Tighten FinanceBench sentence in README 2026-06-02 00:50:02 +08:00
Ray
f21c90fa2b Update README: Connect with Us buttons and header tagline
- Add Website and Book a Demo buttons; reorder and recolor to brand palette
- Replace removed/invalid shields logos (LinkedIn, envelope) and the Website
  icon with inline white SVGs so all badges show an icon
- Reword header tagline (No Vector DB, No Chunking; Context-Aware Retrieval; Human-like)
- Rename top-nav Homepage -> Website
2026-06-01 19:19:53 +08:00
Ray
dd064dc39a
Update README (#307) 2026-05-30 18:51:40 +08:00
Ray
aad68cac7d
Update README (#305) 2026-05-30 18:38:11 +08:00
Ray
7592163e2a
Update README (#271)
Some checks failed
CodeQL / Analyze (actions) (push) Has been cancelled
2026-05-12 03:28:29 +08:00
Ray
f50e529753
update README (#262)
Some checks failed
CodeQL / Analyze (actions) (push) Has been cancelled
2026-05-08 02:08:33 +08:00
Ray
c1a0f94fd3
update README (#261) 2026-05-08 01:57:33 +08:00
Ray
e7dfc5e1ff
update README (#259) 2026-05-07 20:57:14 +08:00
Ray
dcda5656ba Fix Agentic RAG entry formatting in Updates
Some checks failed
CodeQL / Analyze (actions) (push) Has been cancelled
2026-05-06 04:53:41 +08:00
Ray
495e8929b5 Trim Cloud Service note in README 2026-05-06 04:40:32 +08:00
Ray
46244aed33 update README
Some checks are pending
CodeQL / Analyze (actions) (push) Waiting to run
2026-05-06 00:57:25 +08:00
BukeLy
6fd237986e Recognize whole-line bold as level-1 heading in markdown parser
extract_nodes_from_markdown now matches `**Title**` lines as level-1
headings (alongside ATX `#` headings) and attaches the heading level
on the producer side. extract_node_text_content reads the level from
the node instead of re-running a `^#{1,6}` regex on the source line,
which was silently dropping bold-heading nodes from OCR / MinerU output.

Bold maps to level 1 even when mixed with `#` / `##` / `###` — bold-as-
heading is a courtesy heuristic for non-ATX markdown sources, and
CommonMark has no concept of bold heading depth.
2026-04-28 15:23:34 +08:00
Bukely_
a51d97f63c
Add security CI workflows (#248)
Some checks failed
CodeQL / Analyze (actions) (push) Has been cancelled
* Add security CI workflows

* Remove duplicate Python CodeQL workflow
2026-04-25 00:46:01 +08:00
dependabot[bot]
40073375ff
Bump the pip group across 1 directory with 2 updates (#247)
Bumps the pip group with 2 updates in the / directory: [litellm](https://github.com/BerriAI/litellm) and [python-dotenv](https://github.com/theskumar/python-dotenv).


Updates `litellm` from 1.83.0 to 1.83.7
- [Release notes](https://github.com/BerriAI/litellm/releases)
- [Commits](https://github.com/BerriAI/litellm/commits)

Updates `python-dotenv` from 1.1.0 to 1.2.2
- [Release notes](https://github.com/theskumar/python-dotenv/releases)
- [Changelog](https://github.com/theskumar/python-dotenv/blob/main/CHANGELOG.md)
- [Commits](https://github.com/theskumar/python-dotenv/compare/v1.1.0...v1.2.2)

---
updated-dependencies:
- dependency-name: litellm
  dependency-version: 1.83.7
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: python-dotenv
  dependency-version: 1.2.2
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-25 00:19:47 +08:00
Bukely_
29b240a689
Add Dependabot config for GitHub Actions updates (#241)
Weekly scan to open PRs upgrading third-party actions used in CI.
pip dependencies remain pinned and are covered by Dependabot security
updates separately.
2026-04-23 23:59:26 +08:00
Xinyan Zhou
f2dcffc0b7
Merge pull request #214 from VectifyAI/dependabot/pip/pip-480c85e8a1
Bump litellm from 1.82.0 to 1.83.0 in the pip group across 1 directory
2026-04-08 18:19:25 +08:00
dependabot[bot]
eb57d2a10c
Bump litellm from 1.82.0 to 1.83.0 in the pip group across 1 directory
Bumps the pip group with 1 update in the / directory: [litellm](https://github.com/BerriAI/litellm).


Updates `litellm` from 1.82.0 to 1.83.0
- [Release notes](https://github.com/BerriAI/litellm/releases)
- [Commits](https://github.com/BerriAI/litellm/commits)

---
updated-dependencies:
- dependency-name: litellm
  dependency-version: 1.83.0
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-04-03 22:16:59 +00:00