Commit Graph

1599 Commits

Author SHA1 Message Date
yangdx
d25386ff1b refactor: simplify storage configuration handling while maintaining the same functionality 2025-02-13 04:04:51 +08:00
yangdx
11c7af7fd8 refactor: use vdb instance's cosine threshold instead of global constant
• Remove global COSINE_THRESHOLD
• Use instance-level threshold config
• Update logging statements
• Reference vdb threshold directly
2025-02-13 03:34:31 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
3308ecfa69 Refactor logging for vector similarity search with configurable threshold 2025-02-13 02:14:32 +08:00
yangdx
9a77d91023 Add LLM response cache to registered RagServer components 2025-02-13 01:30:21 +08:00
yangdx
7a89916bab Add method to retrieve in-progress documents in DocStatusStorage
• Add get_processing_docs() abstract method
• Override get_processing_docs() in PG storage
• Method retrieves docs with PROCESSING status
• Keep consistent with existing status methods
2025-02-13 01:27:27 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00
yangdx
7c7cac1cfd fix: remove unnecessary param binding, use direct workspace string interpolation 2025-02-13 00:39:40 +08:00
yangdx
274cd73a8f refactor: improve storage initialization with named instances to aid logging
• Add storage names to instance list
• Use tuples to store name with instance
• Update type hints for storage instances
• Improve logging with actual storage names
• Clean up loop variable naming
2025-02-12 22:55:47 +08:00
yangdx
3372af7c3d refactor: remove injected db field from PGDocStatusStorage, it must be injected after object is created 2025-02-12 22:54:22 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
zrguo
18acb4a2b1 fix linting error 2025-02-11 22:16:35 +08:00
zrguo
a272c7b3f7 Merge pull request #741 from Brenon28/fix-update-doc-status-postgresql
fix(postgres): update document status with partial update instead of …
2025-02-11 22:14:52 +08:00
zrguo
f902f552da Update README.md 2025-02-11 22:06:40 +08:00
yangdx
afb5272816 Fix type and class name in doc status storage class assignment
• Corrected PGDocStatusStorage class name
• Fixed db assignment to class not instance
• Fixed incorrect Oracle reference
2025-02-11 17:07:53 +08:00
zrguo
80a3ce2240 fix bugs 2025-02-11 16:24:22 +08:00
yangdx
8a56a5ea6c fix: Add content column to doc status and fix SQL parameter indexing
• Add content column to doc status table
• Fix SQL param index in get_by_status query
• Update insert SQL to include content field
2025-02-11 16:11:15 +08:00
yangdx
aaddc08336 Add storage info to splash screen 2025-02-11 14:57:37 +08:00
zrguo
43ed7386d1 fix linting error 2025-02-11 14:21:19 +08:00
zrguo
f44c83594e add lightrag_api_openai_compatible_demo_simplified.py 2025-02-11 13:40:05 +08:00
zrguo
5ffbb548ad Fix linting error 2025-02-11 13:32:24 +08:00
zrguo
2d2ed19095 Fix cache bugs 2025-02-11 13:28:18 +08:00
yangdx
14fd89c168 Remove storage class method check 2025-02-11 12:05:37 +08:00
zrguo
24e0f0390e Update __version__ 2025-02-11 11:59:28 +08:00
zrguo
0c3b754108 Fix bugs 2025-02-11 11:42:46 +08:00
yangdx
0e660d4000 Fix doc_status error 2025-02-11 10:17:51 +08:00
zrguo
87e6bc5c42 Merge pull request #735 from YanSte/documentatino
Updated documentation
2025-02-11 08:57:39 +08:00
yangdx
cddde8053d Add configuration examples for Oracle, TiDB, PostgreSQL and storage backends 2025-02-11 06:31:59 +08:00
yangdx
f20a164467 Translate Chinese comments to English 2025-02-11 05:22:40 +08:00
yangdx
17abd214a2 Fix linting 2025-02-11 05:18:09 +08:00
yangdx
1f7990646e update storage environment requirements for TiDB and Oracle
• Changed TiDB URI to user/password
• Added Oracle config dir requirement
• Fixed Oracle DSN naming
• Fixed extra comma in Oracle Graph config
• Made env vars more explicit
2025-02-11 04:42:10 +08:00
yangdx
c5c606f491 Inject TiDB同LightRAG storage when needed 2025-02-11 04:27:45 +08:00
yangdx
5408e7ea02 Add table existence check for Oracle and PostgreSQL DB initialization
• Add Oracle table check on startup
• Add PostgreSQL table check on startup
• Use event loop for async DB operations
• Ensure tables exist before DB operations
2025-02-11 04:19:12 +08:00
yangdx
7ec769456c Inject Postgres to LightRag storage class when needed 2025-02-11 03:55:15 +08:00
yangdx
a4cf7e66d3 Inject oracle db to LightRag storage class when needed 2025-02-11 03:54:54 +08:00
yangdx
8cfca5a141 Fix linting 2025-02-11 03:29:40 +08:00
Yannick Stephan
23283180c7 fixed type 2025-02-10 19:59:19 +01:00
Yannick Stephan
41f76ec459 updated readme 2025-02-10 19:57:55 +01:00
Yannick Stephan
4c2f13f79e improved docs 2025-02-10 19:57:55 +01:00
Yannick Stephan
e1f4f9560d updated documentation 2025-02-10 19:57:55 +01:00
yangdx
56c1792767 feat optimize storage configuration and environment variables
* add storage type compatibility validation table
* add enviroment variables check for storage
* modify storage init to get setting from confing.ini and env
2025-02-11 00:55:52 +08:00
Brenon
4723e9b535 fix(postgres): update document status with partial update instead of full upsert 2025-02-10 15:05:44 +03:00
zrguo
d0779209d9 Update LOGO 2025-02-10 14:01:52 +08:00
zrguo
ad8349aff5 Merge pull request #738 from ArnoChenFx/qdrant-backend
add qdrant backend, enable MongoGraphStorage based on config
2025-02-10 13:55:15 +08:00
zrguo
f1a0284294 Merge pull request #739 from YanSte/fixes
Improve Parallelism & Fix Bugs After Testing
2025-02-10 13:52:19 +08:00
Yannick Stephan
bfd280450a cleaned code 2025-02-09 21:48:19 +01:00
Yannick Stephan
a47e09c69e improving ainsert_custom_chunks paralelism 2025-02-09 21:42:04 +01:00
Yannick Stephan
07f31606d2 cleaned code 2025-02-09 21:34:38 +01:00