apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-27 09:26:22 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add token chunker (#14)

Browse source
This commit is contained in:
cybermaggedon 2024-08-21 16:51:33 +01:00 • committed by GitHub
parent 0e2db095e3
commit 7113d04f21
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
16 changed files with 253 additions and 138 deletions
Download patch file Download diff file Expand all files Collapse all files

6
scripts/chunker-token Executable file
View file

@ -0,0 +1,6 @@
#!/usr/bin/env python3
from trustgraph.chunking.token import run
run()