Commit Graph

1728 Commits

Author SHA1 Message Date
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
Enrique Catalá
4d0a316717 exclude .env file with potentionally sensitive information like LLM API KEYS 2025-02-12 21:32:19 +01:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
d25386ff1b refactor: simplify storage configuration handling while maintaining the same functionality 2025-02-13 04:04:51 +08:00
yangdx
11c7af7fd8 refactor: use vdb instance's cosine threshold instead of global constant
• Remove global COSINE_THRESHOLD
• Use instance-level threshold config
• Update logging statements
• Reference vdb threshold directly
2025-02-13 03:34:31 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
3308ecfa69 Refactor logging for vector similarity search with configurable threshold 2025-02-13 02:14:32 +08:00
yangdx
9a77d91023 Add LLM response cache to registered RagServer components 2025-02-13 01:30:21 +08:00
yangdx
7a89916bab Add method to retrieve in-progress documents in DocStatusStorage
• Add get_processing_docs() abstract method
• Override get_processing_docs() in PG storage
• Method retrieves docs with PROCESSING status
• Keep consistent with existing status methods
2025-02-13 01:27:27 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00
yangdx
7c7cac1cfd fix: remove unnecessary param binding, use direct workspace string interpolation 2025-02-13 00:39:40 +08:00
yangdx
274cd73a8f refactor: improve storage initialization with named instances to aid logging
• Add storage names to instance list
• Use tuples to store name with instance
• Update type hints for storage instances
• Improve logging with actual storage names
• Clean up loop variable naming
2025-02-12 22:55:47 +08:00
yangdx
3372af7c3d refactor: remove injected db field from PGDocStatusStorage, it must be injected after object is created 2025-02-12 22:54:22 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
zrguo
be7a001ad8 Merge pull request #754 from TITC/main
Fix incorrect usage of insert_file API
2025-02-12 19:34:32 +08:00
TITC
75c164de69 Fix incorrect usage of insert_file API 2025-02-12 14:04:02 +08:00
zrguo
6f2e1d25b3 Merge pull request #751 from ArnoChenFx/add-MongoDocStatusStorage
add MongoDocStatusStorage
2025-02-12 13:39:56 +08:00
zrguo
1b67b4569c Merge pull request #750 from gurjot-05/main
Integrate gemini client into Lightrag
2025-02-12 13:39:06 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
ArnoChen
9daab4340c add MongoDocStatusStorage
remove unnecessary logging

format
2025-02-12 04:13:48 +08:00
Gurjot Singh
d82b9c46e0 fixed linting errors 2025-02-11 23:49:56 +05:30
Gurjot Singh
e7b6c55bee Integrate gemini client into Lightrag 2025-02-11 23:43:42 +05:30
ArnoChen
4d7ced6927 remove unnecessary logging 2025-02-11 23:12:58 +08:00
ArnoChen
23a6d8b17c fix button 2025-02-11 23:02:30 +08:00
ArnoChen
1af72b4ce9 Merge remote-tracking branch 'origin/main' into graph-viewer-webui 2025-02-11 22:52:01 +08:00
ArnoChen
3cacc088fe enhance graph viewer with settings, status and api key 2025-02-11 22:51:31 +08:00
zrguo
18acb4a2b1 fix linting error 2025-02-11 22:16:35 +08:00
zrguo
a272c7b3f7 Merge pull request #741 from Brenon28/fix-update-doc-status-postgresql
fix(postgres): update document status with partial update instead of …
2025-02-11 22:14:52 +08:00
zrguo
f902f552da Update README.md 2025-02-11 22:06:40 +08:00
ArnoChen
bd7d4c0b17 Merge branch 'main' into graph-viewer-webui 2025-02-11 17:34:25 +08:00
yangdx
afb5272816 Fix type and class name in doc status storage class assignment
• Corrected PGDocStatusStorage class name
• Fixed db assignment to class not instance
• Fixed incorrect Oracle reference
2025-02-11 17:07:53 +08:00
zrguo
80a3ce2240 fix bugs 2025-02-11 16:24:22 +08:00
yangdx
8a56a5ea6c fix: Add content column to doc status and fix SQL parameter indexing
• Add content column to doc status table
• Fix SQL param index in get_by_status query
• Update insert SQL to include content field
2025-02-11 16:11:15 +08:00
yangdx
aaddc08336 Add storage info to splash screen 2025-02-11 14:57:37 +08:00
zrguo
43ed7386d1 fix linting error 2025-02-11 14:21:19 +08:00
zrguo
f44c83594e add lightrag_api_openai_compatible_demo_simplified.py 2025-02-11 13:40:05 +08:00
zrguo
5ffbb548ad Fix linting error 2025-02-11 13:32:24 +08:00
zrguo
2d2ed19095 Fix cache bugs 2025-02-11 13:28:18 +08:00
yangdx
14fd89c168 Remove storage class method check 2025-02-11 12:05:37 +08:00
zrguo
24e0f0390e Update __version__ 2025-02-11 11:59:28 +08:00
zrguo
0c3b754108 Fix bugs 2025-02-11 11:42:46 +08:00
yangdx
0e660d4000 Fix doc_status error 2025-02-11 10:17:51 +08:00
zrguo
87e6bc5c42 Merge pull request #735 from YanSte/documentatino
Updated documentation
2025-02-11 08:57:39 +08:00
ArnoChen
d418ceee82 add label filter 2025-02-11 06:48:04 +08:00
yangdx
cddde8053d Add configuration examples for Oracle, TiDB, PostgreSQL and storage backends 2025-02-11 06:31:59 +08:00
yangdx
f20a164467 Translate Chinese comments to English 2025-02-11 05:22:40 +08:00
yangdx
17abd214a2 Fix linting 2025-02-11 05:18:09 +08:00
yangdx
1f7990646e update storage environment requirements for TiDB and Oracle
• Changed TiDB URI to user/password
• Added Oracle config dir requirement
• Fixed Oracle DSN naming
• Fixed extra comma in Oracle Graph config
• Made env vars more explicit
2025-02-11 04:42:10 +08:00
yangdx
c5c606f491 Inject TiDB同LightRAG storage when needed 2025-02-11 04:27:45 +08:00