Commit Graph

2403 Commits

Author SHA1 Message Date
Roy
a1708a2638 Add optional ids filter to QueryParam for RAG document filtering 2025-03-08 21:13:29 +00:00
Roy
d6a426d3e6 Included all requirements in the package 2025-03-08 21:09:45 +00:00
Roy
16536c870c Commit unncessary files update 2025-03-08 21:06:19 +00:00
Roy
04fdc617bb main_merge 2025-03-08 20:34:29 +00:00
ArindamRoy23
0695697ad0 Merge pull request #1 from ArindamRoy23/document_query_filter
Document query filter
2025-03-09 01:58:04 +05:30
Roy
e31c0c8f6c Update vector query methods to support ID filtering in PostgreSQL
- Modified `mix_kg_vector_query` in operate.py to pass optional IDs to vector search
- Updated PostgreSQL SQL template to filter results using document IDs instead of chunk_id
- Improved query flexibility by allowing precise document selection during vector search
2025-03-08 20:25:20 +00:00
zrguo
32a7d40650 Update lightrag_openai_neo4j_milvus_redis_demo.py 2025-03-09 02:11:31 +08:00
zrguo
fe34c50b43 Merge pull request #1030 from HKUDS/dev
Fixed and improved Iteration extraction
2025-03-09 01:29:49 +08:00
zrguo
c936aaf5c8 fix linting 2025-03-09 01:29:21 +08:00
zrguo
595d8bf372 Update prompt.py 2025-03-09 01:25:15 +08:00
zrguo
548f9a8234 Update prompts 2025-03-09 01:21:39 +08:00
yangdx
6a969e8de4 Disable logging for graph database lock acquisition and release 2025-03-09 01:14:24 +08:00
yangdx
c5d0962872 Fix linting 2025-03-09 01:00:42 +08:00
yangdx
3cf4268e7a Change logging level from INFO to DEBUG for cache hit/miss messages 2025-03-09 00:59:40 +08:00
zrguo
da59cc89d8 fix linting 2025-03-09 00:51:14 +08:00
zrguo
376b63b704 Merge pull request #1027 from dixyes/fix-qdrant-payload-id
Fix qdrant payload id
2025-03-09 00:28:17 +08:00
zrguo
3ae261dcd3 Merge pull request #1025 from danielaskdd/add-env-llm-cache-for-extract
Add LLM cache control env for API Server
2025-03-09 00:26:55 +08:00
yangdx
18c0770409 fix: duplicate nodes for same entity(label) problem in Neo4j
- Add entity_id field as key in Neo4j nodes
- Use  entity_id for nodes retrival and upsert
2025-03-09 00:24:55 +08:00
zrguo
c67e6aceca Merge branch 'main' into main 2025-03-09 00:23:06 +08:00
zrguo
38ebb16d63 Merge pull request #1021 from da-luggas/main
Fixed entites_section_list comma error
2025-03-09 00:19:41 +08:00
zrguo
906619fa93 Merge pull request #1024 from ShanGor/main
fix the postgres get all labels and get knowledge graph
2025-03-09 00:17:11 +08:00
Roy
528fb11364 Refactor vector query methods to support optional ID filtering
- Updated BaseVectorStorage query method signature to accept optional IDs
- Modified operate.py to pass query parameter IDs to vector storage queries
- Updated PostgreSQL vector storage SQL templates to filter results by document IDs
- Removed unused parameters and simplified query logic across multiple files
2025-03-08 15:43:17 +00:00
yangdx
73452e63fa Add async lock for atomic graph database operations
• Introduced graph_db_lock mechanism
• Ensured atomic node/edge merge and insert operation
2025-03-08 22:48:12 +08:00
yangdx
95c06f1bde Add graph DB lock to shared storage system
• Introduced new graph_db_lock
• Added detailed lock debugging output
2025-03-08 22:36:41 +08:00
dixyes
458eafd714 Fix qdrant payload id
Qdrant now is using PointStruct.payload["id"], not PointStruct.id UUID.
This will fix id overwrite
2025-03-08 16:40:40 +08:00
Samuel Chan
b7f67eda21 fix the postgres get all labels and get knowledge graph 2025-03-08 11:45:59 +08:00
yangdx
fb4a4c736e Add duplicate edge upsert checking and logging 2025-03-08 11:36:24 +08:00
yangdx
22a93fb717 Limit neighbor nodes fetch to 1000 in Neo4JStorage. 2025-03-08 11:29:08 +08:00
yangdx
887f6ed81a Fix return empty list when no edges is found 2025-03-08 11:20:22 +08:00
yangdx
af26d65698 Convert _ensure_label method from async to sync 2025-03-08 10:23:27 +08:00
yangdx
78f8d7a1ce Convert node and edge IDs to f-strings for consistency.
- Use f-strings for node IDs
- Use f-strings for edge IDs
- Ensure consistent ID formatting
2025-03-08 10:20:10 +08:00
yangdx
84222b8b76 Refactor Neo4JStorage methods for robustness and clarity.
- Add error handling and resource cleanup
- Improve method documentation
- Optimize result consumption
2025-03-08 10:19:20 +08:00
yangdx
fcb04e47e5 Refactor Neo4J APOC fall back retrival implementaion 2025-03-08 04:28:54 +08:00
Yannick Stephan
27ab894d00 Merge pull request #1018 from HKUDS/dev
Fix edit entity and relation bugs
2025-03-07 21:26:43 +01:00
Roy
bbe139cfeb Enhance PostgreSQL vector storage with chunk_id support
- Updated SQL templates for entity and relationship upsert to include chunk_id
- Modified PGVectorStorage methods to add chunk_id when inserting or updating records
- Expanded database schema to track chunk-level metadata
2025-03-07 20:18:01 +00:00
Roy
0ec61d6407 Update project dependencies and example test files
- Updated requirements.txt with latest package versions
- Added support for filtering query results by IDs in base and operate modules
- Modified PostgreSQL vector storage to include document and chunk ID fields
2025-03-07 18:45:28 +00:00
yangdx
c07b592e1b Add missing await consume 2025-03-08 02:39:51 +08:00
yangdx
af803f4e7a Refactor Neo4J graph query with min_degree an inclusive match support 2025-03-08 01:20:36 +08:00
Lukas Selch
bad3781f51 Fixed entites_section_list comma error 2025-03-07 12:04:10 +01:00
yangdx
0ee2e7fd48 Suppress Neo4j warning logs by setting logger level. 2025-03-07 16:56:48 +08:00
yangdx
6e3b23069c - Remove useless _label_exists method 2025-03-07 16:43:18 +08:00
yangdx
17ccab8db2 Updated README with LLM cache configuration details 2025-03-07 15:22:20 +08:00
yangdx
c2f861fba9 Settign LLM cache option for entity extraction from env 2025-03-07 15:03:33 +08:00
zrguo
e822f35c89 Fix edit entity and relation bugs 2025-03-07 14:39:06 +08:00
zrguo
c76f43c8e8 Merge pull request #1015 from HKUDS/main
Update dev
2025-03-07 12:49:30 +08:00
zrguo
3286a0d57f Merge pull request #1003 from danielaskdd/add-graph-search-mode
Feat: Added minimum degree filter for graph queries
2025-03-07 12:37:44 +08:00
zrguo
ea898aeda0 Merge pull request #1000 from lcjqyml/feat_login-jwt
feat(api): Add user authentication functionality
2025-03-07 12:24:46 +08:00
yangdx
7e088ca528 Refactor code and update environment type definitions.
- Consolidate type definitions in vite-env.d.ts
- Update TypeScript include paths
2025-03-07 08:17:25 +08:00
yangdx
5942d148f0 Set default max_depth to 3 for knowledge graph retrieval 2025-03-07 07:34:29 +08:00
yangdx
6d5c04d561 Reduce max_depth and update edge type in NetworkXStorage.
- Decreased max_depth from 5 to 3
- Changed edge type from "RELATED" to "DIRECTED"
2025-03-06 20:54:02 +08:00