Commit Graph

528 Commits

Author SHA1 Message Date
zrguo
aa66ddea41 Merge pull request #1120 from Howe829/fix/chunk_ids
fix: correct chunk_ids as array type and remove incorrect filepath type conversion
2025-03-20 21:48:17 +08:00
jofoks
7e53d94526 Implemented simple PSQL doc-status get_by_ids method 2025-03-19 15:24:25 -07:00
HowardChan
0c39ff00a8 fix: resolve SQL type mismatch and conflict handling in LIGHTRAG_VDB_ENTITY insert query 2025-03-19 13:01:07 +08:00
HowardChan
1530798fb6 fix: ensure chunk_ids are correctly handled as VARCHAR array 2025-03-19 12:59:44 +08:00
yangdx
20de4ded30 Add default file_path for missing document paths
- Set file_path to "no-file-path" if missing
- Ensure consistent document data structure
2025-03-18 20:06:18 +08:00
Daniel.y
79b32026ec Merge branch 'HKUDS:main' into main 2025-03-18 18:07:46 +08:00
zrguo
a3de421b14 Merge pull request #1108 from HKUDS/webui-node-expansion
Added camera rotation to graph panel and merge login feature
2025-03-18 17:50:38 +08:00
yangdx
b46f2ff871 Merge branch 'fix--psql-return-type' 2025-03-18 17:15:29 +08:00
jofoks
54e4a31aa6 Fixed get_by_id type error in PSQL impl 2025-03-17 17:32:54 -07:00
yangdx
c641a6290c Ensure unique edge IDs for NetworkX 2025-03-18 00:00:56 +08:00
zrguo
dfd19b8d27 fix postgres support 2025-03-17 23:59:47 +08:00
zrguo
e7395a2c8d Merge branch 'main' into main 2025-03-17 17:23:41 +08:00
zrguo
3df20ae787 fix lint 2025-03-17 15:59:54 +08:00
zrguo
5956f22612 Merge branch 'main' into fix--postgres-impl 2025-03-17 15:42:09 +08:00
zrguo
901760ab98 Merge branch 'main' into postgres-improve-entities-relation-save-process 2025-03-17 15:39:40 +08:00
pengjunfeng11
4e58c7d7da Update postgres_impl.py
There is aBUG. When lighttrag uses the postgres@15 version, there will be an error.The BUG detail as follow:
PostgreSQL database, error:subquery in FROM must have an alias
HINT:  For example, FROM (SELECT ...) [AS] foo.
It roughly means that there is an error in SQL template, and you need to use the alias alias to declare the content of the subquery.
2025-03-17 10:47:17 +08:00
Daniel.y
0277c94a61 Merge pull request #1091 from JoramMillenaar/quickfix--small-db-fields
Updated PSQL's chunk_id field to be a TEXT field
2025-03-16 22:48:54 +08:00
Daniel.y
9d971e5889 Merge pull request #1062 from ericshao/fix-postgres
Fix PGDocStatusStorage content extraction for DocProcessingStatus
2025-03-16 15:47:32 +08:00
jofoks
912e70feb1 Updated chunk_id field to be a TEXT field 2025-03-14 11:03:28 -07:00
jofoks
af88561713 Merge branch 'main' into fix--postgres-impl 2025-03-13 16:16:25 -07:00
jofoks
edc95126de Fixed some query parsing issues 2025-03-13 11:30:52 -07:00
Mykola Chaban
ceae2eb92d fixed issue with convert the age query to the dictionary;
refactored solution of storing chunk ids;
2025-03-13 13:45:09 +02:00
yangdx
5b70d34822 Fix get single node subgrap problem
- Replaced MATCH with OPTIONAL MATCH
- Add memory-bank directory for Cline to .gitignore
2025-03-13 02:14:02 +08:00
yangdx
3cd574f6a8 Merge branch 'main' into fix-neo4j-duplicate-nodes 2025-03-12 12:35:36 +08:00
yangdx
8f633c89fd Remove duplicate retry decorator in Neo4JStorage class. 2025-03-12 09:12:06 +08:00
Eric Shao
01f60d5a4d 修复 PGDocStatusStorage 中的内容提取错误 2025-03-12 07:47:21 +08:00
ArindamRoy23
49dd5f936e Merge branch 'HKUDS:main' into main 2025-03-11 20:53:00 +05:30
Roy
8aa9d0e6ca Add optional ids filter to vector database query methods
- Updated query method signatures across multiple vector database implementations
- Added optional `ids` parameter to filter search results
- Consistent implementation across ChromaDB, Faiss, Milvus, MongoDB, NanoVectorDB, Oracle, Qdrant, and TiDB vector storage classes
2025-03-11 15:22:17 +00:00
yangdx
cbacb615f3 Use COALESCE to handle null degree counts in Neo4J queries.
- Ensures degree count defaults to 0
- Prevents null-related errors in queries
2025-03-11 18:33:26 +08:00
yangdx
bedad9a6d9 Merge branch 'main' into fix-neo4j-duplicate-nodes 2025-03-11 18:05:58 +08:00
zrguo
c26cb3a9ea fix merge bugs 2025-03-11 16:05:04 +08:00
yangdx
30310c2845 Fix relation info in kownledge graph UI 2025-03-11 15:36:38 +08:00
zrguo
91f96f2a8b Merge pull request #1032 from ArindamRoy23/main
Filter by ID during Query for Postgres VDB
2025-03-11 15:26:59 +08:00
yangdx
7fddabb441 Fix linting 2025-03-11 10:28:25 +08:00
yangdx
aefd596990 Refactor Neo4JStorage to use entity_id for node identification, use entity_type for node label 2025-03-11 09:59:42 +08:00
Roy
92ae895713 Refactor requirements and code formatting
- Simplified requirements.txt by removing specific version constraints
- Added comment about extra library installation using pipmaster
- Improved code formatting in base.py, operate.py, and postgres_impl.py
- Cleaned up SQL templates and query method signatures with consistent formatting
2025-03-10 15:39:18 +00:00
yangdx
5d64f3b0a0 Improved auto-scan task initialization and status tracking.
- Added autoscan status tracking in pipeline
- Ensured auto-scan runs only once per startup
2025-03-10 17:14:14 +08:00
yangdx
57a41eedb8 Fix linting 2025-03-10 15:41:46 +08:00
yangdx
46610682ce Fix data persistence issue in single-process mode
In single-process mode, data updates and persistence were not working properly because the update flags were not being correctly handled between different objects.
2025-03-10 15:41:00 +08:00
yangdx
adca27fae9 Merge branch 'main' into neo4j-add-min-degree 2025-03-10 02:13:49 +08:00
yangdx
4065a7df92 Fix linting 2025-03-10 02:07:19 +08:00
yangdx
14e1b31d1c Improved logging clarity in storage operations 2025-03-10 02:05:55 +08:00
yangdx
6b0acce644 Avoid redundant llm cache updates 2025-03-10 01:45:58 +08:00
yangdx
d2708b966d Added update flag to avoid persistence if no data is changed for KV storage 2025-03-10 01:17:25 +08:00
yangdx
4977c718f1 Improve KV storage initialize logic 2025-03-10 00:12:35 +08:00
yangdx
c938989920 Fix llm cache save problem in json_kv storage 2025-03-09 23:33:03 +08:00
yangdx
e47883d872 Add atomic data initialization lock to prevent race conditions 2025-03-09 17:33:15 +08:00
yangdx
c854aabde0 Add process ID to log messages for better multi-process debugging clarity
- Add PID to KV and Neo4j storage  logs
- Add PID to query context logs
- Improve KV data count logging for llm cache
2025-03-09 15:25:10 +08:00
yangdx
90527875fd Fix async issues in namespace init 2025-03-09 15:22:06 +08:00
Roy
04fdc617bb main_merge 2025-03-08 20:34:29 +00:00