Commit Graph

235 Commits

Author SHA1 Message Date
Yannick Stephan
805da7b95b cleaned code 2025-02-15 00:02:24 +01:00
ArnoChen
a600beb619 implement MongoDB support for VectorDB storage. optimize existing MongoDB implementations 2025-02-15 00:38:41 +08:00
Pankaj Kaushal
cd81312659 Enhance Neo4j graph storage with error handling and label validation
- Add label existence check and validation methods in Neo4j implementation
- Improve error handling in get_node, get_edge, and upsert methods
- Add default values and logging for missing edge properties
- Ensure consistent label processing across graph storage methods
2025-02-14 16:07:41 +01:00
yangdx
2c56141bfd Standardize variable names with other vector database implementations (without functional modifications) 2025-02-14 12:34:26 +08:00
destiny
a5cd2b1958 Fix embedding type conversion issue in the query function of chroma_impl; chroma_impl supports local persistent client: PersistentClient 2025-02-14 11:00:54 +08:00
zrguo
1841c8d536 Merge branch 'main' into fix-backends 2025-02-14 09:39:11 +08:00
ArnoChen
cac1c993a9 remove redundant cosine similarity filter in Qdrant query
fix
2025-02-14 03:16:01 +08:00
ArnoChen
307184985b fix configuration errors of milvus 2025-02-14 03:00:56 +08:00
ArnoChen
9a91b68e62 fix configuration errors of mongodb, neo4j, and qdrant backends. 2025-02-14 02:48:15 +08:00
ultrageopro
8773ad983f fix: incorrect usage of os.environ.get in PASSWORD 2025-02-13 18:09:24 +03:00
ultrageopro
a50cdbc177 fix: incorrect usage of os.environ.get method in neo4j 2025-02-13 18:07:24 +03:00
ultrageopro
438caa776d fix: neo4j MAX_CONNECTION_POOL_SIZE impl 2025-02-13 15:26:45 +03:00
zrguo
dea6f4f288 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 20:03:38 +08:00
ArnoChen
42d90f2b16 rename jsondocstatus to json_doc_status for consistency 2025-02-13 18:38:12 +08:00
ArnoChen
6896d4ab21 add pre-built graph viewer files
format

a

a
2025-02-13 18:05:50 +08:00
ArnoChen
c674905a98 use KnowledgeGraph typed dict for graph API response 2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c fix typo 2025-02-13 17:32:05 +08:00
yangdx
7017f114e1 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 11:25:52 +08:00
yangdx
76164a1b17 Use namespace for graph_name before falling back to env or default value
- Update graph_name initialization
- Add namespace override support
- Maintain backward compatibility
- Prioritize namespace over env variable
2025-02-13 04:52:54 +08:00
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
3308ecfa69 Refactor logging for vector similarity search with configurable threshold 2025-02-13 02:14:32 +08:00
yangdx
7a89916bab Add method to retrieve in-progress documents in DocStatusStorage
• Add get_processing_docs() abstract method
• Override get_processing_docs() in PG storage
• Method retrieves docs with PROCESSING status
• Keep consistent with existing status methods
2025-02-13 01:27:27 +08:00
yangdx
7c7cac1cfd fix: remove unnecessary param binding, use direct workspace string interpolation 2025-02-13 00:39:40 +08:00
yangdx
3372af7c3d refactor: remove injected db field from PGDocStatusStorage, it must be injected after object is created 2025-02-12 22:54:22 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
ArnoChen
9daab4340c add MongoDocStatusStorage
remove unnecessary logging

format
2025-02-12 04:13:48 +08:00
ArnoChen
4d7ced6927 remove unnecessary logging 2025-02-11 23:12:58 +08:00
ArnoChen
1af72b4ce9 Merge remote-tracking branch 'origin/main' into graph-viewer-webui 2025-02-11 22:52:01 +08:00
zrguo
18acb4a2b1 fix linting error 2025-02-11 22:16:35 +08:00
zrguo
a272c7b3f7 Merge pull request #741 from Brenon28/fix-update-doc-status-postgresql
fix(postgres): update document status with partial update instead of …
2025-02-11 22:14:52 +08:00
ArnoChen
bd7d4c0b17 Merge branch 'main' into graph-viewer-webui 2025-02-11 17:34:25 +08:00
yangdx
8a56a5ea6c fix: Add content column to doc status and fix SQL parameter indexing
• Add content column to doc status table
• Fix SQL param index in get_by_status query
• Update insert SQL to include content field
2025-02-11 16:11:15 +08:00
zrguo
5ffbb548ad Fix linting error 2025-02-11 13:32:24 +08:00
zrguo
2d2ed19095 Fix cache bugs 2025-02-11 13:28:18 +08:00
yangdx
c5c606f491 Inject TiDB同LightRAG storage when needed 2025-02-11 04:27:45 +08:00
yangdx
a4cf7e66d3 Inject oracle db to LightRag storage class when needed 2025-02-11 03:54:54 +08:00
yangdx
8cfca5a141 Fix linting 2025-02-11 03:29:40 +08:00
yangdx
56c1792767 feat optimize storage configuration and environment variables
* add storage type compatibility validation table
* add enviroment variables check for storage
* modify storage init to get setting from confing.ini and env
2025-02-11 00:55:52 +08:00
Brenon
4723e9b535 fix(postgres): update document status with partial update instead of full upsert 2025-02-10 15:05:44 +03:00
ArnoChen
07f19b939c Merge branch 'main' into graph-viewer-webui 2025-02-10 13:56:25 +08:00
zrguo
ad8349aff5 Merge pull request #738 from ArnoChenFx/qdrant-backend
add qdrant backend, enable MongoGraphStorage based on config
2025-02-10 13:55:15 +08:00
Yannick Stephan
9f6621454e fixed ids 2025-02-09 21:24:13 +01:00
Yannick Stephan
068924b59f updated type 2025-02-09 21:12:39 +01:00
Yannick Stephan
62115b836f cleaned set 2025-02-09 20:03:15 +01:00
Yannick Stephan
6480ddee5d cleaned code 2025-02-09 19:51:05 +01:00
Yannick Stephan
7d63898015 fixed bugs 2025-02-09 19:21:49 +01:00