Commit graph

120 commits

Author SHA1 Message Date
thierryverse
9c959baadd clean up comments 2025-11-11 19:17:41 +02:00
thierryverse
cfb62ff73b fix typo 2025-11-11 19:15:45 +02:00
thierryverse
55e5b45a42 fix podcast generation 2025-11-11 04:02:04 +02:00
thierryverse
678d8fbbcd fix podcast re-generation 2025-11-06 21:52:45 +02:00
CREDO23
cc3e04031e update the chat state version with messages 2025-11-06 21:52:45 +02:00
CREDO23
666ea87a9d reference the chat in the podcast 2025-11-06 21:52:45 +02:00
CREDO23
aaa6ee22ed implement chat/podcast staleness 2025-11-06 21:52:45 +02:00
DESKTOP-RTLN3BA\$punk
9466bf595c feat: Implement LLM configuration validation in create and update routes
- Added `validate_llm_config` function to `llm_service.py` for validating LLM configurations via test API calls.
- Integrated validation in `create_llm_config` and `update_llm_config` routes in `llm_config_routes.py`, raising HTTP exceptions for invalid configurations.
- Enhanced error handling to provide detailed feedback on configuration issues.
2025-11-05 12:15:05 -08:00
samkul-swe
e49c455c01 Making async 2025-11-04 15:27:57 -08:00
samkul-swe
b03365cded Add web crawling 2025-11-04 13:05:09 -08:00
Rohan Verma
97ed791ca0
Merge pull request #463 from codeBunny2022/fix/pdfminer-warning-fix
fix: suppress pdfminer warnings to prevent upload halting
2025-11-03 20:22:38 -08:00
DESKTOP-RTLN3BA\$punk
a3a5b13f48 chore: linting 2025-11-03 16:00:58 -08:00
DESKTOP-RTLN3BA\$punk
e65d74f2e2 refactor: added batch commits and Increased task time limits in celery_app.py
- Increased task time limits in celery_app.py for longer processing times.
- Enhanced pagination logic in NotionHistoryConnector to handle large result sets.
- Implemented batch commits every 10 documents across various indexers (Airtable, ClickUp, Confluence, Discord, GitHub, Google Calendar, Gmail, JIRA, Linear, Luma, Notion, Slack) to improve performance and reduce database load.
- Updated final commit logging for clarity on total documents processed.
2025-11-03 15:57:19 -08:00
Chirag
b3026e4412 fix: resolve ruff F823 error by importing getLogger and ERROR directly 2025-11-02 12:03:03 +05:30
Chirag
094bdfad45 fix: suppress pdfminer warnings to prevent upload halting
- Added warning suppression for pdfminer warnings during Docling PDF processing
- Suppresses 'Cannot set gray non-stroke color' warnings that cause uploads to halt
- Temporarily sets pdfminer logger to ERROR level during document processing
- Fixes issue where files ~34MB would fail due to pdfminer warning spam

Resolves issue where PDF uploads would halt with repeated pdfminer warnings
2025-11-01 17:42:23 +05:30
DESKTOP-RTLN3BA\$punk
4be9d099bf feat: added file limit tracking for a user 2025-10-30 14:58:08 -07:00
DESKTOP-RTLN3BA\$punk
d76da8a59d fix: podcast tasks for Windows compatibility
- Added WindowsProactorEventLoopPolicy for better async subprocess support on Windows.
- Ensured proper cleanup of the event loop after task execution.
- Removed redundant asyncio import from the generate_chat_podcast_task function.
2025-10-30 12:05:06 -07:00
DESKTOP-RTLN3BA\$punk
81ddc81026 feat(removed): sub_section_writer
- Its bad and not needed.
2025-10-27 20:30:10 -07:00
MSI\ModSetter
8706df6716 feat: added meta-scheduler for running periodic tasks 2025-10-22 19:49:44 -07:00
MSI\ModSetter
a90767a478 feat: added meta-scheduler for running periodic tasks 2025-10-22 19:49:30 -07:00
DESKTOP-RTLN3BA\$punk
18adf79649 feat(fix): document type filtering 2025-10-21 21:53:55 -07:00
DESKTOP-RTLN3BA\$punk
0e6669ac4e fix: celery_app path and gmail indexing 2025-10-21 21:11:41 -07:00
DESKTOP-RTLN3BA\$punk
c80bbfa867 feat: added celery and removed background_tasks for MQ's
- removed pre commit hooks
- updated docker setup
- updated github docker actions
- updated docs
2025-10-20 00:30:00 -07:00
DESKTOP-RTLN3BA\$punk
5b957ec21c feat: bumped version to v0.0.8 2025-10-16 22:44:12 -07:00
Anish Sarkar
bbb2abfc02 fix: ran formatter as per coderrabbitai 2025-10-17 02:44:44 +05:30
Anish Sarkar
0ff1b586a2 feat: update Elasticsearch integration and logging
- revised Elasticsearch connector enum revision IDs
- added `TaskLoggingService` to elasticsearch_indexer
- integrated Elasticsearch into prompts.py as requested
2025-10-17 02:21:56 +05:30
Anish Sarkar
82438c7396 refactor: streamline Elasticsearch indexing by removing unused services and integrating document chunking, also added documentation 2025-10-16 17:48:28 +05:30
Anish Sarkar
929035f802 Merge remote-tracking branch 'upstream/main' into feature/elasticsearch-connector 2025-10-16 16:24:37 +05:30
DESKTOP-RTLN3BA\$punk
c99cd710ea feat: add unique identifier hash for documents to prevent duplicates across various connectors 2025-10-14 21:11:19 -07:00
DESKTOP-RTLN3BA\$punk
31982cea9a chore: removed content trunking for better UI 2025-10-14 14:19:48 -07:00
Tarun
045537aa79 feat: add language support across configurations and prompts 2025-10-12 13:13:42 +05:30
Anish Sarkar
72e8d98f40 feat: enhance Elasticsearch connector to handle missing index configuration 2025-10-12 10:10:19 +05:30
Anish Sarkar
55d752e3c8 feat: added elasticsearch connector 2025-10-12 09:39:04 +05:30
DESKTOP-RTLN3BA\$punk
633ea3ac0f feat: moved LLMConfigs from User to SearchSpaces
- RBAC soon??
- Updated various services and routes to handle search space-specific LLM preferences.
- Modified frontend components to pass search space ID for LLM configuration management.
- Removed onboarding page and settings page as part of the refactor.
2025-10-10 00:50:29 -07:00
DESKTOP-RTLN3BA\$punk
aea09a5dad feat: Moved searchconnectors association from user to searchspace
- Need to move llm configs to searchspace
2025-10-08 21:13:01 -07:00
DESKTOP-RTLN3BA\$punk
94367e4226 chore: linting and formatting 2025-09-28 22:26:26 -07:00
Rohan Verma
ef361e16b4
Merge pull request #337 from samkul-swe/feature/add-luma-connector
[Feature] Add Luma connector
2025-09-28 22:14:15 -07:00
Rohan Verma
3fec106c31
Merge pull request #335 from CREDO23/connector-airtable-refresh-token
[Feature] Airtable connector | Refresh access token when expired
2025-09-28 20:58:38 -07:00
samkul-swe
9d2b808e66 Added Luma connector 2025-09-28 14:59:10 -07:00
sandeeppainuly
7bb8e77ee1 Update transcript processing to use new API object attributes 2025-09-28 12:09:17 +02:00
sandeeppainuly
c08508c0c4 Fix YouTube transcript API: replace deprecated get_transcript with fetch method 2025-09-28 12:03:36 +02:00
CREDO23
8f9f66b7f8 handle token token refreshing when expired 2025-09-21 21:14:03 +02:00
Rohan Verma
662212d4e2
Merge pull request #295 from CREDO23/feature/airtable-connector
[Feature]  Add Airtable connector
2025-09-03 12:49:14 -07:00
Rohan Verma
c2030cec48
Merge pull request #275 from CREDO23/improvement/persist-refreshed-token-in-google-related-connector
[Improvement] Google connectors | Update the connector config after refreshing the token
2025-08-26 18:47:36 -07:00
CREDO23
45d2c18c16 update airtable indexer 2025-08-26 19:17:46 +02:00
CREDO23
55d0cc4d0d Add sirtable indexer 2025-08-26 15:42:42 +02:00
CREDO23
ecbb1f27e0 clean up 2025-08-26 11:53:27 +02:00
CREDO23
85664f2ff8 update the connector config after refreshing google calendar access token 2025-08-26 11:49:31 +02:00
DESKTOP-RTLN3BA\$punk
3b87ecc3c5 fix: made notion indexing async 2025-08-21 14:43:04 -07:00
DESKTOP-RTLN3BA\$punk
f443a6636f fix: slack indexing
- Indivisual messages as Document instead of concatinating it.
2025-08-21 14:23:52 -07:00