Commit Graph

252 Commits

Author SHA1 Message Date
Yannick Stephan
9a5fbaaa5f removed unused methods 2025-02-16 14:50:04 +01:00
Yannick Stephan
a0844bca28 cleaned import 2025-02-16 14:45:45 +01:00
Yannick Stephan
3fef8201c6 added final, required methods and cleaned import 2025-02-16 14:38:09 +01:00
ArnoChen
893b645506 unify doc status retrieval with get_docs_by_status 2025-02-16 21:28:58 +08:00
Yannick Stephan
931c31fa8c cleaned code 2025-02-16 13:55:30 +01:00
Yannick Stephan
882190a515 updated clean of what implemented on DocStatusStorage 2025-02-16 13:53:59 +01:00
zrguo
2a0c7c0322 Merge pull request #785 from danielaskdd/improve-CORS-handling
improve CORS and streaming response headers
2025-02-16 20:31:33 +08:00
Yannick Stephan
71a18d1de9 updated clean of what implemented on BaseKVStorage 2025-02-16 13:31:12 +01:00
Yannick Stephan
3eba41aab6 updated clean of what implemented on BaseVectorStorage 2025-02-16 13:24:42 +01:00
zrguo
ef0e81315f fix linting 2025-02-16 19:53:28 +08:00
zrguo
517ceb16fa Merge pull request #794 from St1veLiu/main
Update json_kv_impl.py
2025-02-16 19:51:43 +08:00
Yannick Stephan
1051ff402d fixed lint 2025-02-16 12:45:27 +01:00
zrguo
f868c1da78 Merge branch 'main' into code-cleaning 2025-02-16 19:41:05 +08:00
St1ve
edaba428ac Update json_kv_impl.py
There is no delete function in chunks_vdb and text_chunks in lines 1300-1302 of the lightrag.py file:
    if chunk_ids:
                await self.chunks_vdb.delete(chunk_ids)
                await self.text_chunks.delete(chunk_ids)
2025-02-16 19:33:59 +08:00
zrguo
5189a9438c Merge pull request #780 from spo0nman/fix-bug-778
Enhance Neo4j graph storage with error handling and label validation
2025-02-16 19:30:32 +08:00
zrguo
292b65320a Merge pull request #781 from ArnoChenFx/enhance-mongodb-backends
Add MongoDB VectorDB Support and Optimize Existing MongoDB Implementations
2025-02-16 19:26:35 +08:00
zrguo
9d21523541 Merge pull request #772 from hhxdestiny/chroma_support_local
chroma_impl supports local persistent client: PersistentClient
2025-02-16 19:21:53 +08:00
Yannick Stephan
805da7b95b cleaned code 2025-02-15 00:02:24 +01:00
ArnoChen
a600beb619 implement MongoDB support for VectorDB storage. optimize existing MongoDB implementations 2025-02-15 00:38:41 +08:00
Pankaj Kaushal
cd81312659 Enhance Neo4j graph storage with error handling and label validation
- Add label existence check and validation methods in Neo4j implementation
- Improve error handling in get_node, get_edge, and upsert methods
- Add default values and logging for missing edge properties
- Ensure consistent label processing across graph storage methods
2025-02-14 16:07:41 +01:00
yangdx
2c56141bfd Standardize variable names with other vector database implementations (without functional modifications) 2025-02-14 12:34:26 +08:00
destiny
a5cd2b1958 Fix embedding type conversion issue in the query function of chroma_impl; chroma_impl supports local persistent client: PersistentClient 2025-02-14 11:00:54 +08:00
zrguo
1841c8d536 Merge branch 'main' into fix-backends 2025-02-14 09:39:11 +08:00
ArnoChen
cac1c993a9 remove redundant cosine similarity filter in Qdrant query
fix
2025-02-14 03:16:01 +08:00
ArnoChen
307184985b fix configuration errors of milvus 2025-02-14 03:00:56 +08:00
ArnoChen
9a91b68e62 fix configuration errors of mongodb, neo4j, and qdrant backends. 2025-02-14 02:48:15 +08:00
ultrageopro
8773ad983f fix: incorrect usage of os.environ.get in PASSWORD 2025-02-13 18:09:24 +03:00
ultrageopro
a50cdbc177 fix: incorrect usage of os.environ.get method in neo4j 2025-02-13 18:07:24 +03:00
ultrageopro
438caa776d fix: neo4j MAX_CONNECTION_POOL_SIZE impl 2025-02-13 15:26:45 +03:00
zrguo
dea6f4f288 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 20:03:38 +08:00
ArnoChen
42d90f2b16 rename jsondocstatus to json_doc_status for consistency 2025-02-13 18:38:12 +08:00
ArnoChen
6896d4ab21 add pre-built graph viewer files
format

a

a
2025-02-13 18:05:50 +08:00
ArnoChen
c674905a98 use KnowledgeGraph typed dict for graph API response 2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c fix typo 2025-02-13 17:32:05 +08:00
yangdx
7017f114e1 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 11:25:52 +08:00
yangdx
76164a1b17 Use namespace for graph_name before falling back to env or default value
- Update graph_name initialization
- Add namespace override support
- Maintain backward compatibility
- Prioritize namespace over env variable
2025-02-13 04:52:54 +08:00
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
3308ecfa69 Refactor logging for vector similarity search with configurable threshold 2025-02-13 02:14:32 +08:00
yangdx
7a89916bab Add method to retrieve in-progress documents in DocStatusStorage
• Add get_processing_docs() abstract method
• Override get_processing_docs() in PG storage
• Method retrieves docs with PROCESSING status
• Keep consistent with existing status methods
2025-02-13 01:27:27 +08:00
yangdx
7c7cac1cfd fix: remove unnecessary param binding, use direct workspace string interpolation 2025-02-13 00:39:40 +08:00
yangdx
3372af7c3d refactor: remove injected db field from PGDocStatusStorage, it must be injected after object is created 2025-02-12 22:54:22 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
ArnoChen
9daab4340c add MongoDocStatusStorage
remove unnecessary logging

format
2025-02-12 04:13:48 +08:00
ArnoChen
4d7ced6927 remove unnecessary logging 2025-02-11 23:12:58 +08:00
ArnoChen
1af72b4ce9 Merge remote-tracking branch 'origin/main' into graph-viewer-webui 2025-02-11 22:52:01 +08:00
zrguo
18acb4a2b1 fix linting error 2025-02-11 22:16:35 +08:00