Commit Graph

1359 Commits

Author SHA1 Message Date
yangdx
873b52d2e4 Add debug logging for cache response retrieval 2025-02-02 03:15:43 +08:00
yangdx
fdc9017ded Set embedding_func in all llm_response_cache 2025-02-02 03:14:07 +08:00
yangdx
bed5a97ae2 Fix prompt respond cache fail when is_embedding_cache_enabled is true 2025-02-02 03:09:06 +08:00
yangdx
5d14ab03eb Fix linting 2025-02-02 01:56:32 +08:00
yangdx
b45ae1567c Refactor LLM cache handling and entity extraction
- Removed custom LLM function in entity extraction
- Simplified cache handling logic
- Added `force_llm_cache` parameter
- Updated cache handling conditions
2025-02-02 01:28:46 +08:00
yangdx
6c7d7c25d3 Refactor cache handling logic for better readability, keep function unchanged. 2025-02-02 00:10:21 +08:00
yangdx
c9481c81b9 Add cache type "extract" for entity extraction 2025-02-01 23:05:02 +08:00
yangdx
2d387fa6de Save keywords to cache only when it's no empty 2025-02-01 22:54:23 +08:00
yangdx
3c3cdba499 Fix typo error 2025-02-01 22:27:49 +08:00
yangdx
b87703aea6 Add embedding_func to llm_response_cache 2025-02-01 22:19:16 +08:00
yangdx
3bc7c4d8f1 Save cache_type to llm_response_cache 2025-02-01 22:18:59 +08:00
yangdx
c3942077a9 Use direct embedding_func from hashing_kv (do not by pass maxiumu async control) 2025-02-01 22:12:45 +08:00
yangdx
c98a675b6c remove unused parm 2025-02-01 22:07:12 +08:00
yangdx
95edf8a51e Fix linting 2025-02-01 15:22:40 +08:00
yangdx
a0710e9d65 Merge branch 'main' into fix-extract-entity-concurrent-problem 2025-02-01 14:45:42 +08:00
yangdx
b109f57ddd Refactor async call limiting to use asyncio.Semaphore for better performance.
- Replace custom counter with asyncio.Semaphore
- The existing implementation cannot follow the FIFO order
2025-02-01 10:36:25 +08:00
yangdx
635d4fd9e4 Add lock to protect file write operations in NanoVectorDBStorage
- Introduce asyncio.Lock for save operations
- Ensure thread-safe file writes
2025-02-01 10:36:25 +08:00
yangdx
6a326e2783 Revert "Refactor embedding functions and add async query limit"
This reverts commit 21481dba8f.
2025-02-01 10:36:25 +08:00
yangdx
2ba36f87e3 Add support for list input in quantize_embedding function
- Convert list to numpy array if needed
- Maintain existing functionality
2025-02-01 10:36:25 +08:00
yangdx
1192727be7 remove semaphore logic from EmbeddingFunc(cause num of instances is already control by limit_async_func_call) 2025-02-01 10:36:25 +08:00
yangdx
60b66b95e3 Fix typo in prompt 2025-02-01 10:36:25 +08:00
yangdx
0692635ebd Improve prompts to avoid make-up respond from LLM like qwen-plus when very long context is provided. 2025-02-01 10:36:25 +08:00
yangdx
b22a8b216c Fix linting 2025-02-01 10:36:25 +08:00
yangdx
2a010c985e Add logging for chunk truncation in mix_kg_vector_query 2025-02-01 10:36:25 +08:00
zrguo
e59cb7493c fixed linting 2025-01-31 23:35:42 +08:00
zrguo
58a9ae2f83 Merge pull request #686 from gurjot-05/main
Implement Faiss Vector Storage Support for LightRAG
2025-01-31 23:34:53 +08:00
zrguo
a3f2a3f1de Merge pull request #682 from ParisNeo/main
Few upgrades in the webui
2025-01-31 23:33:28 +08:00
zrguo
470b39930c Merge pull request #681 from danielaskdd/Improve-prompt-prevent-make-up-answer
Improve prompts to avoid LLM make up answer
2025-01-31 23:32:54 +08:00
Saifeddine ALOUI
78b858c03b Finished testing api key 2025-01-31 16:19:46 +01:00
Saifeddine ALOUI
d2a550fd31 Update api.js 2025-01-31 16:08:23 +01:00
Saifeddine ALOUI
d1210851aa Update api.js 2025-01-31 16:07:27 +01:00
Saifeddine ALOUI
e9591548b4 Update api.js 2025-01-31 16:03:31 +01:00
Gurjot Singh
2894e8faf2 Fix linting errors 2025-01-31 19:05:47 +05:30
Gurjot Singh
8a624e198a Add faiss integration for storage 2025-01-31 19:00:36 +05:30
yangdx
2d4991dfbd Fix typo in prompt 2025-01-31 20:40:37 +08:00
Saifeddine ALOUI
2444975bf1 Update api.js 2025-01-31 13:22:19 +01:00
Saifeddine ALOUI
6889606a48 Update lightrag_server.py 2025-01-31 11:19:12 +01:00
yangdx
b0d87b2e29 Fix linting 2025-01-31 15:33:50 +08:00
yangdx
389f4ee872 Shorten log message for cosine similarity threshold. 2025-01-31 15:33:41 +08:00
yangdx
21481dba8f Refactor embedding functions and add async query limit
- Separate insert/query embedding funcs
- Add query-specific async limit
- Update storage classes to use new funcs
- Protect vector DB save with lock
- Improve config handling for thresholds
2025-01-31 15:00:56 +08:00
Saifeddine ALOUI
381f7deec6 linting 2025-01-30 23:29:21 +01:00
Saifeddine ALOUI
219cbab1e3 Added progress when scanning files and fixed some bugs in the API 2025-01-30 23:27:43 +01:00
yangdx
54b68074a1 Merge branch 'main' into fix-extract-entity-concurrent-problem 2025-01-31 01:19:44 +08:00
yangdx
fb63e5ed39 Improve prompts to avoid make-up respond from LLM like qwen-plus when very long context is provided. 2025-01-30 22:38:32 +08:00
yangdx
601f10b132 Fix linting 2025-01-30 22:26:28 +08:00
yangdx
82460088da Merge commit '59617da83e224e3af1c97fb21dd661b088effc2d' into Improve-prompt-prevent-make-up-answer 2025-01-30 22:24:13 +08:00
yangdx
81655829bc Add logging for chunk truncation in mix_kg_vector_query 2025-01-30 22:21:52 +08:00
zrguo
59617da83e Merge pull request #675 from danielaskdd/Fix-get_conversation_turns
Fix get conversation turns
2025-01-30 20:36:59 +08:00
zrguo
9ef1438ff6 Merge pull request #674 from danielaskdd/topk-cosine-threshold-env-config
Add top_k and cosine_better_than_threshold support for API server
2025-01-30 20:36:44 +08:00
yangdx
e31482e49b Merge commit '5d3060dfa56b5e9f149f170a76db874ce8ca6ffb' into Improve-prompt-prevent-make-up-answer 2025-01-30 13:42:04 +08:00