Commit Graph

2330 Commits

Author SHA1 Message Date
yangdx
14e1b31d1c Improved logging clarity in storage operations 2025-03-10 02:05:55 +08:00
yangdx
6b0acce644 Avoid redundant llm cache updates 2025-03-10 01:45:58 +08:00
yangdx
d2708b966d Added update flag to avoid persistence if no data is changed for KV storage 2025-03-10 01:17:25 +08:00
yangdx
4977c718f1 Improve KV storage initialize logic 2025-03-10 00:12:35 +08:00
yangdx
c938989920 Fix llm cache save problem in json_kv storage 2025-03-09 23:33:03 +08:00
yangdx
bc42afe7b6 Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv. 2025-03-09 22:15:26 +08:00
yangdx
e47883d872 Add atomic data initialization lock to prevent race conditions 2025-03-09 17:33:15 +08:00
yangdx
020a6b5ae0 Refactor LLM cache config to use argparse and add status display 2025-03-09 16:45:57 +08:00
yangdx
c854aabde0 Add process ID to log messages for better multi-process debugging clarity
- Add PID to KV and Neo4j storage  logs
- Add PID to query context logs
- Improve KV data count logging for llm cache
2025-03-09 15:25:10 +08:00
yangdx
90527875fd Fix async issues in namespace init 2025-03-09 15:22:06 +08:00
yangdx
6a969e8de4 Disable logging for graph database lock acquisition and release 2025-03-09 01:14:24 +08:00
yangdx
c5d0962872 Fix linting 2025-03-09 01:00:42 +08:00
yangdx
3cf4268e7a Change logging level from INFO to DEBUG for cache hit/miss messages 2025-03-09 00:59:40 +08:00
yangdx
18c0770409 fix: duplicate nodes for same entity(label) problem in Neo4j
- Add entity_id field as key in Neo4j nodes
- Use  entity_id for nodes retrival and upsert
2025-03-09 00:24:55 +08:00
yangdx
73452e63fa Add async lock for atomic graph database operations
• Introduced graph_db_lock mechanism
• Ensured atomic node/edge merge and insert operation
2025-03-08 22:48:12 +08:00
yangdx
95c06f1bde Add graph DB lock to shared storage system
• Introduced new graph_db_lock
• Added detailed lock debugging output
2025-03-08 22:36:41 +08:00
yangdx
fb4a4c736e Add duplicate edge upsert checking and logging 2025-03-08 11:36:24 +08:00
yangdx
22a93fb717 Limit neighbor nodes fetch to 1000 in Neo4JStorage. 2025-03-08 11:29:08 +08:00
yangdx
887f6ed81a Fix return empty list when no edges is found 2025-03-08 11:20:22 +08:00
yangdx
af26d65698 Convert _ensure_label method from async to sync 2025-03-08 10:23:27 +08:00
yangdx
78f8d7a1ce Convert node and edge IDs to f-strings for consistency.
- Use f-strings for node IDs
- Use f-strings for edge IDs
- Ensure consistent ID formatting
2025-03-08 10:20:10 +08:00
yangdx
84222b8b76 Refactor Neo4JStorage methods for robustness and clarity.
- Add error handling and resource cleanup
- Improve method documentation
- Optimize result consumption
2025-03-08 10:19:20 +08:00
yangdx
fcb04e47e5 Refactor Neo4J APOC fall back retrival implementaion 2025-03-08 04:28:54 +08:00
yangdx
c07b592e1b Add missing await consume 2025-03-08 02:39:51 +08:00
yangdx
af803f4e7a Refactor Neo4J graph query with min_degree an inclusive match support 2025-03-08 01:20:36 +08:00
yangdx
0ee2e7fd48 Suppress Neo4j warning logs by setting logger level. 2025-03-07 16:56:48 +08:00
yangdx
6e3b23069c - Remove useless _label_exists method 2025-03-07 16:43:18 +08:00
yangdx
17ccab8db2 Updated README with LLM cache configuration details 2025-03-07 15:22:20 +08:00
yangdx
c2f861fba9 Settign LLM cache option for entity extraction from env 2025-03-07 15:03:33 +08:00
zrguo
3286a0d57f Merge pull request #1003 from danielaskdd/add-graph-search-mode
Feat: Added minimum degree filter for graph queries
2025-03-07 12:37:44 +08:00
zrguo
ea898aeda0 Merge pull request #1000 from lcjqyml/feat_login-jwt
feat(api): Add user authentication functionality
2025-03-07 12:24:46 +08:00
yangdx
7e088ca528 Refactor code and update environment type definitions.
- Consolidate type definitions in vite-env.d.ts
- Update TypeScript include paths
2025-03-07 08:17:25 +08:00
yangdx
5942d148f0 Set default max_depth to 3 for knowledge graph retrieval 2025-03-07 07:34:29 +08:00
yangdx
6d5c04d561 Reduce max_depth and update edge type in NetworkXStorage.
- Decreased max_depth from 5 to 3
- Changed edge type from "RELATED" to "DIRECTED"
2025-03-06 20:54:02 +08:00
yangdx
5b29e760f0 Add dynamic parameter handling for storage 2025-03-06 14:29:48 +08:00
Milin
1e82fb445e Merge branch 'HKUDS:main' into feat_login-jwt 2025-03-06 14:25:33 +08:00
Milin
c015296081 refactor(api): Fix issues reported by pre-commit
- Modified code layout and formatting in multiple files, improving code readability.
  - Updated import statements, removing unused libraries.
  - Simplified the writing of some functions and exception handling.
2025-03-06 14:23:52 +08:00
yangdx
252d1f57e0 Merge branch 'main' into add-graph-search-mode 2025-03-06 10:23:38 +08:00
zrguo
cac0f3ddc6 Merge pull request #1009 from HKUDS/dev
Added entity merging functionality
2025-03-06 00:58:45 +08:00
zrguo
ec0450f712 Add merge entities 2025-03-06 00:53:23 +08:00
Milin
59e3b2eec1 refactor(api): Code optimization based on review comments.
- Removed authentication dependency for the health check endpoint in lightrag_server.py
- Removed the authentication dependency for the entire router in ollama_api.py
- Updated the parameter list and example usage in README.md, removing authentication-related parts
- Removed neo4j and tqdm dependencies from requirements.txt
- Deleted command-line argument parsing code related to authentication from utils_api.py
2025-03-05 20:38:05 +08:00
Milin
11502fc756 Merge branch 'HKUDS:main' into feat_login-jwt 2025-03-05 20:21:21 +08:00
yangdx
81b78bda76 Refactor Vite configuration and add environment type definitions
- Removed local Vite config file
- Updated dev scripts to use default config
- Added env.d.ts for type definitions
- Enhanced Vite config with dynamic proxy
- Simplified build and dev script commands
2025-03-05 18:25:51 +08:00
zrguo
20f2e57260 Merge pull request #1006 from HKUDS/dev
[Bug]Fix the issue where editing entity names does not properly update the corresponding relationship in the vdb.
2025-03-05 17:00:43 +08:00
zrguo
917dc39334 fix linting 2025-03-05 17:00:01 +08:00
zrguo
649164c3e6 Update lightrag.py 2025-03-05 16:55:09 +08:00
zrguo
55973ed05b Merge pull request #1005 from HKUDS/revert#994
Revert "[EVO] Add language configuration to environment and argument …
2025-03-05 16:31:18 +08:00
zrguo
06fc65d9a0 Revert "[EVO] Add language configuration to environment and argument parsing"
This reverts commit a688b8822a.
2025-03-05 16:26:28 +08:00
zrguo
5e7ef39998 Update operate.py 2025-03-05 15:12:01 +08:00
yangdx
0ca7c0e230 Fix linting 2025-03-05 15:07:11 +08:00