Commit graph

414 commits

Author SHA1 Message Date
Alex Garcia
804cea5e07 forgot to update aux snapshot? 2024-11-20 00:50:29 -08:00
Alex Garcia
e414b97851 Merge branch 'main' into metadata-filtering 2024-11-20 00:44:11 -08:00
Alex Garcia
9bfeaa7842
Auxiliary column support (#123)
* initial pass at PARTITION KEY support.

* Initial pass, allow auxiliary columns on vec0 virtual tables

* update TODO

* unit tests

* gha this PR branch

* fixup tests

* doc internal

* fix tests, KNN/rowids in

* define SQLITE_INDEX_CONSTRAINT_OFFSET

* whoops

* update tests, syrupy, use uv

* un ignore pyproject.toml

* dot

* tests/

* type error?

* win: .exe, update error name

* try fix macos python, paren around expr?

* win bash?

* dbg :(

* explicit error

* op

* dbg win

* win ./tests/.venv/Scripts/python.exe

* block UPDATEs on partition key values for now

* test this branch

* accidentally removved "partition key type mistmatch" block during merge

* typo ugh

* bruv

* start aux snapshots

* drop aux shadow table on destroy

* enforce column types

* block WHERE constraints on auxiliary columns in KNN queries

* support delete

* support UPDATE on auxiliary columns
2024-11-20 00:30:23 -08:00
Alex Garcia
6658624172
PARTITION KEY support (#122)
* initial pass at PARTITION KEY support.

* unit tests

* gha this PR branch

* fixup tests

* doc internal

* fix tests, KNN/rowids in

* define SQLITE_INDEX_CONSTRAINT_OFFSET

* whoops

* update tests, syrupy, use uv

* un ignore pyproject.toml

* dot

* tests/

* type error?

* win: .exe, update error name

* try fix macos python, paren around expr?

* win bash?

* dbg :(

* explicit error

* op

* dbg win

* win ./tests/.venv/Scripts/python.exe

* block UPDATEs on partition key values for now
2024-11-20 00:02:04 -08:00
Alex Garcia
672868d910 _info shadow table 2024-11-19 23:55:10 -08:00
Alex Garcia
a12c0d73e6 SQLITE_VEC_VERSION_MAJOR SQLITE_VEC_VERSION_MINOR and SQLITE_VEC_VERSION_PATCH in sqlite-vec.h 2024-11-19 22:52:27 -08:00
Alex Garcia
86df498910 _metadata_text_NN shadow tables to _metadatatextNN 2024-11-19 22:25:11 -08:00
Alex Garcia
0b17547778 rename _metadata_chunksNN shadown table to _metadatachunksNN, for proper shadowName detection 2024-11-19 22:15:19 -08:00
Alex Garcia
e99e31feb7 add broken shadow table test 2024-11-19 22:03:31 -08:00
Alex Garcia
a657b3a216 fixes and tests 2024-11-19 21:46:50 -08:00
Alex Garcia
4039328eda else in guard? 2024-11-19 15:26:27 -08:00
Alex Garcia
0123b249ea guard sqlite3_vtab_in 2024-11-19 15:24:59 -08:00
Alex Garcia
d0993b7496 unblock aux failures for now 2024-11-19 15:21:33 -08:00
Alex Garcia
7b67c78530 vtab_in handling 2024-11-18 22:43:24 -08:00
Alex Garcia
0db2e52974 clean 2024-11-18 14:09:21 -08:00
Alex Garcia
018e9789de text knn LT/LE 2024-11-18 14:09:07 -08:00
Alex Garcia
df29e31ddc text knn GT/GE fixes 2024-11-18 14:05:47 -08:00
Alex Garcia
1ec1b89f60 GT 2024-11-18 12:25:01 -08:00
Alex Garcia
3db69bd8ed test cases diff 2024-11-18 12:16:46 -08:00
Alex Garcia
4ba167c315 text knn NE 2024-11-18 12:15:25 -08:00
Alex Garcia
31622209eb add failing test causes for non eq text knn 2024-11-18 12:10:01 -08:00
Alex Garcia
07793b3ecc refactor 2024-11-18 11:56:47 -08:00
Alex Garcia
b527a3d9ec rowids blob read only on text metadata filters 2024-11-18 11:28:02 -08:00
Alex Garcia
10a2216845 refactor some text knn filtering 2024-11-18 11:21:49 -08:00
Alex Garcia
1a216a684d fix aux column error when using non-default rowid values, needs test 2024-11-17 15:12:39 -08:00
Alex Garcia
da29ace630 updates 2024-11-17 14:56:31 -08:00
Alex Garcia
7f47409e60 test-case 2024-11-17 08:45:57 -08:00
Alex Garcia
f55e14cce8 ann-filtering-benchmark directory 2024-11-17 08:38:57 -08:00
Alex Garcia
ee3654701f v0.1.5 2024-11-15 11:22:50 -08:00
Alex Garcia
5183ab4b34 v0.1.5-alpha.1 2024-11-15 11:18:19 -08:00
Alex Garcia
9780f6d445 bump dist to fix linux arm builds 2024-11-15 11:17:55 -08:00
Alex Garcia
67f8ff8517 v0.1.4 2024-11-15 11:02:10 -08:00
Alex Garcia
e412860897 v0.1.4-alpha.3 2024-11-15 10:51:26 -08:00
Alex Garcia
04c6da4c62 update linux arm builds 2024-11-15 10:43:44 -08:00
Alex Garcia
f7730ac12e experimental metadata docs 2024-11-15 10:40:44 -08:00
Alex Garcia
052ba4b089 typo whoops 2024-11-14 16:58:44 -08:00
Alex Garcia
c337129d0a new version string for beta builds 2024-11-14 16:57:08 -08:00
Alex Garcia
1c13c91e03 ensure error is raised when long string constraint 2024-11-14 16:52:55 -08:00
Alex Garcia
a1a64427fc boolean comparison handling 2024-11-14 16:36:53 -08:00
Alex Garcia
3965029726 small fixes 2024-11-14 12:06:50 -08:00
Alex Garcia
ab1f6f2c99 drop not-used in eqp 2024-11-14 11:42:37 -08:00
Alex Garcia
c4ece98705 fix snapshot names 2024-11-14 11:39:56 -08:00
Alex Garcia
c1055ab3f8 UPDATE support 2024-11-14 11:32:48 -08:00
Alex Garcia
ae601dcbc3 DELETE support 2024-11-14 10:37:05 -08:00
Alex Garcia
8132f26f3b long text support 2024-11-13 23:36:46 -08:00
Alex Garcia
f12be5292b finish type checking 2024-11-13 22:26:06 -08:00
Alex Garcia
9fffdc4d1b rm double/int32, just float/int64 2024-11-13 22:23:47 -08:00
Alex Garcia
06e28da3a5 more snpashot tests 2024-11-13 21:52:35 -08:00
Alex Garcia
b04b64759c stress test 2024-11-13 19:16:50 -08:00
Alex Garcia
fef4997b68 memzero text buffer 2024-11-13 18:02:31 -08:00