zrguo
2b230d403d
Merge pull request #1011 from ParisNeo/main
...
Added docling option to load files
2025-03-10 22:14:47 +08:00
ArindamRoy23
3fa6d8757a
Merge branch 'HKUDS:main' into main
2025-03-10 19:42:18 +05:30
zrguo
ad13009cff
fix edit_entity
2025-03-10 19:07:19 +08:00
yangdx
bbff3ed0ab
Fix linting
2025-03-10 17:30:40 +08:00
Roy
7807379bee
Remove unused ids parameter from _build_query_context function
2025-03-10 09:18:22 +00:00
yangdx
5d64f3b0a0
Improved auto-scan task initialization and status tracking.
...
- Added autoscan status tracking in pipeline
- Ensured auto-scan runs only once per startup
2025-03-10 17:14:14 +08:00
yangdx
3cca18c59c
Refactor pipeline status updates and entity extraction.
...
- Let all parrallel jobs using one pipe_status objects
- Improved thread safety with pipeline_status_lock
- Only pipeline jobs can add message to pipe_status
- Marked insert_custom_chunks as deprecated
2025-03-10 16:48:59 +08:00
yangdx
57a41eedb8
Fix linting
2025-03-10 15:41:46 +08:00
yangdx
46610682ce
Fix data persistence issue in single-process mode
...
In single-process mode, data updates and persistence were not working properly because the update flags were not being correctly handled between different objects.
2025-03-10 15:41:00 +08:00
yangdx
adca27fae9
Merge branch 'main' into neo4j-add-min-degree
2025-03-10 02:13:49 +08:00
yangdx
4065a7df92
Fix linting
2025-03-10 02:07:19 +08:00
yangdx
14e1b31d1c
Improved logging clarity in storage operations
2025-03-10 02:05:55 +08:00
yangdx
6b0acce644
Avoid redundant llm cache updates
2025-03-10 01:45:58 +08:00
yangdx
d2708b966d
Added update flag to avoid persistence if no data is changed for KV storage
2025-03-10 01:17:25 +08:00
yangdx
4977c718f1
Improve KV storage initialize logic
2025-03-10 00:12:35 +08:00
yangdx
c938989920
Fix llm cache save problem in json_kv storage
2025-03-09 23:33:03 +08:00
yangdx
bc42afe7b6
Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv.
2025-03-09 22:15:26 +08:00
Saifeddine ALOUI
04862033d6
Made the defa&ult mode non docling
2025-03-09 13:14:39 +01:00
yangdx
e47883d872
Add atomic data initialization lock to prevent race conditions
2025-03-09 17:33:15 +08:00
yangdx
020a6b5ae0
Refactor LLM cache config to use argparse and add status display
2025-03-09 16:45:57 +08:00
yangdx
c854aabde0
Add process ID to log messages for better multi-process debugging clarity
...
- Add PID to KV and Neo4j storage logs
- Add PID to query context logs
- Improve KV data count logging for llm cache
2025-03-09 15:25:10 +08:00
yangdx
90527875fd
Fix async issues in namespace init
2025-03-09 15:22:06 +08:00
Saifeddine ALOUI
53cfb72db4
linted
2025-03-08 23:07:51 +01:00
Saifeddine ALOUI
4f42b6d933
Merge branch 'HKUDS:main' into main
2025-03-08 23:06:53 +01:00
Roy
4ce28b31bd
minor readme fix
2025-03-08 21:31:41 +00:00
Roy
a1708a2638
Add optional ids filter to QueryParam for RAG document filtering
2025-03-08 21:13:29 +00:00
Roy
d6a426d3e6
Included all requirements in the package
2025-03-08 21:09:45 +00:00
Roy
16536c870c
Commit unncessary files update
2025-03-08 21:06:19 +00:00
Roy
04fdc617bb
main_merge
2025-03-08 20:34:29 +00:00
ArindamRoy23
0695697ad0
Merge pull request #1 from ArindamRoy23/document_query_filter
...
Document query filter
2025-03-09 01:58:04 +05:30
Roy
e31c0c8f6c
Update vector query methods to support ID filtering in PostgreSQL
...
- Modified `mix_kg_vector_query` in operate.py to pass optional IDs to vector search
- Updated PostgreSQL SQL template to filter results using document IDs instead of chunk_id
- Improved query flexibility by allowing precise document selection during vector search
2025-03-08 20:25:20 +00:00
zrguo
32a7d40650
Update lightrag_openai_neo4j_milvus_redis_demo.py
2025-03-09 02:11:31 +08:00
zrguo
fe34c50b43
Merge pull request #1030 from HKUDS/dev
...
Fixed and improved Iteration extraction
2025-03-09 01:29:49 +08:00
zrguo
c936aaf5c8
fix linting
2025-03-09 01:29:21 +08:00
zrguo
595d8bf372
Update prompt.py
2025-03-09 01:25:15 +08:00
zrguo
548f9a8234
Update prompts
2025-03-09 01:21:39 +08:00
yangdx
6a969e8de4
Disable logging for graph database lock acquisition and release
2025-03-09 01:14:24 +08:00
yangdx
c5d0962872
Fix linting
2025-03-09 01:00:42 +08:00
yangdx
3cf4268e7a
Change logging level from INFO to DEBUG for cache hit/miss messages
2025-03-09 00:59:40 +08:00
zrguo
da59cc89d8
fix linting
2025-03-09 00:51:14 +08:00
zrguo
376b63b704
Merge pull request #1027 from dixyes/fix-qdrant-payload-id
...
Fix qdrant payload id
2025-03-09 00:28:17 +08:00
zrguo
3ae261dcd3
Merge pull request #1025 from danielaskdd/add-env-llm-cache-for-extract
...
Add LLM cache control env for API Server
2025-03-09 00:26:55 +08:00
yangdx
18c0770409
fix: duplicate nodes for same entity(label) problem in Neo4j
...
- Add entity_id field as key in Neo4j nodes
- Use entity_id for nodes retrival and upsert
2025-03-09 00:24:55 +08:00
zrguo
c67e6aceca
Merge branch 'main' into main
2025-03-09 00:23:06 +08:00
zrguo
38ebb16d63
Merge pull request #1021 from da-luggas/main
...
Fixed entites_section_list comma error
2025-03-09 00:19:41 +08:00
zrguo
906619fa93
Merge pull request #1024 from ShanGor/main
...
fix the postgres get all labels and get knowledge graph
2025-03-09 00:17:11 +08:00
Roy
528fb11364
Refactor vector query methods to support optional ID filtering
...
- Updated BaseVectorStorage query method signature to accept optional IDs
- Modified operate.py to pass query parameter IDs to vector storage queries
- Updated PostgreSQL vector storage SQL templates to filter results by document IDs
- Removed unused parameters and simplified query logic across multiple files
2025-03-08 15:43:17 +00:00
yangdx
73452e63fa
Add async lock for atomic graph database operations
...
• Introduced graph_db_lock mechanism
• Ensured atomic node/edge merge and insert operation
2025-03-08 22:48:12 +08:00
yangdx
95c06f1bde
Add graph DB lock to shared storage system
...
• Introduced new graph_db_lock
• Added detailed lock debugging output
2025-03-08 22:36:41 +08:00
baoheping
ed1e44f925
Merge branch 'main' into multi-language
2025-03-08 19:04:32 +08:00
