Commit Graph

1373 Commits

Author SHA1 Message Date
Saifeddine ALOUI
6889606a48 Update lightrag_server.py 2025-01-31 11:19:12 +01:00
yangdx
b0d87b2e29 Fix linting 2025-01-31 15:33:50 +08:00
yangdx
389f4ee872 Shorten log message for cosine similarity threshold. 2025-01-31 15:33:41 +08:00
yangdx
21481dba8f Refactor embedding functions and add async query limit
- Separate insert/query embedding funcs
- Add query-specific async limit
- Update storage classes to use new funcs
- Protect vector DB save with lock
- Improve config handling for thresholds
2025-01-31 15:00:56 +08:00
Saifeddine ALOUI
381f7deec6 linting 2025-01-30 23:29:21 +01:00
Saifeddine ALOUI
219cbab1e3 Added progress when scanning files and fixed some bugs in the API 2025-01-30 23:27:43 +01:00
yangdx
54b68074a1 Merge branch 'main' into fix-extract-entity-concurrent-problem 2025-01-31 01:19:44 +08:00
yangdx
fb63e5ed39 Improve prompts to avoid make-up respond from LLM like qwen-plus when very long context is provided. 2025-01-30 22:38:32 +08:00
yangdx
601f10b132 Fix linting 2025-01-30 22:26:28 +08:00
yangdx
82460088da Merge commit '59617da83e224e3af1c97fb21dd661b088effc2d' into Improve-prompt-prevent-make-up-answer 2025-01-30 22:24:13 +08:00
yangdx
81655829bc Add logging for chunk truncation in mix_kg_vector_query 2025-01-30 22:21:52 +08:00
zrguo
59617da83e Merge pull request #675 from danielaskdd/Fix-get_conversation_turns
Fix get conversation turns
2025-01-30 20:36:59 +08:00
zrguo
9ef1438ff6 Merge pull request #674 from danielaskdd/topk-cosine-threshold-env-config
Add top_k and cosine_better_than_threshold support for API server
2025-01-30 20:36:44 +08:00
yangdx
e31482e49b Merge commit '5d3060dfa56b5e9f149f170a76db874ce8ca6ffb' into Improve-prompt-prevent-make-up-answer 2025-01-30 13:42:04 +08:00
yangdx
5d3060dfa5 Refactor configuration and conversation history handling of unit test code
- Add DEFAULT_CONFIG constant
- Introduce EXAMPLE_CONVERSATION
- Remove redundant DEFAULT_CONFIG
- Simplify chat request creation
- Update tests to use shared history
2025-01-30 13:12:19 +08:00
yangdx
3150c2812f Fix loop step from 1 to 2 in get_conversation_turns, ensure user-assistant pairing 2025-01-30 13:08:27 +08:00
yangdx
cc50ade14e Fix concurrent problem on extract_entities function.
- Abandon the approach of temporarily replacing the global llm_model_func configuration
- Introduce custom_llm function with new_config for handle_cache while extracting entities
- Update handle_cache to accept custom_llm
2025-01-30 02:45:33 +08:00
yangdx
06647438b2 Refactor threshold handling to use environment variables and global config settings for oracle, postgres and tidb 2025-01-29 23:47:57 +08:00
yangdx
46c9c7d95b Update sample env file and documentation
- Change COSINE_THRESHOLD to 0.4
- Adjust TOP_K to 50
- Enhance API README details
2025-01-29 23:45:20 +08:00
yangdx
e29682eef8 Allow configuration of LLM parameters through environment variables 2025-01-29 23:39:47 +08:00
yangdx
20d6355a4a Fix cosine threshold parameter setting error for chroma 2025-01-29 22:41:18 +08:00
yangdx
90c765c724 Fix linting 2025-01-29 22:14:18 +08:00
yangdx
5c7b2d7c9f Merge from main 2025-01-29 22:13:01 +08:00
yangdx
c8b890547a Add logging for query parameters in NanoVectorDBStorage.query 2025-01-29 21:36:31 +08:00
yangdx
7ff8c7b9d8 Add timeout parameter to OpenAI alike LLM model configuration 2025-01-29 21:35:46 +08:00
yangdx
7aedc08caf Add RAG configuration options and enhance parameter configurability
- Add top-k and cosine-threshold parms for api server
- Update .env and cli parms handling with new parameters
- Improve splash screen display
- Update bash and storage classes to read new parameters from .env file.
2025-01-29 21:34:34 +08:00
yangdx
d0052456d4 Fix cosine threshold parameter setting error 2025-01-29 21:09:11 +08:00
zrguo
0c42d66954 Merge pull request #671 from ranfysvalle02/main
+ MongoDB KnowledgeGraph Support
2025-01-29 21:05:28 +08:00
yangdx
4302c65a04 Avoid unnecessary LLM response generation 2025-01-29 21:01:35 +08:00
yangdx
c423f37f62 Lower log level for keyword outputs 2025-01-29 21:00:42 +08:00
ranfysvalle02
4c349c208d +MDB KG 2025-01-29 07:31:34 -05:00
zrguo
f5a87ba5cb Merge pull request #666 from ParisNeo/main
Added the possibility to change the name of the model on ollama service
2025-01-29 10:09:15 +08:00
Saifeddine ALOUI
b5d09725f5 linting 2025-01-28 18:20:45 +01:00
Saifeddine ALOUI
4ab1deaf25 Fixed --simulated-model-name argument 2025-01-28 15:32:41 +01:00
Saifeddine ALOUI
d493830b10 Update lightrag_server.py 2025-01-28 15:30:36 +01:00
Saifeddine ALOUI
9fdea743e4 Update lightrag_server.py 2025-01-28 15:03:26 +01:00
zrguo
80451af839 fix linting errors 2025-01-27 23:21:34 +08:00
zrguo
9a7a6f9aac Merge pull request #660 from ParisNeo/main
LightRAG Enhancements PR
2025-01-27 23:17:03 +08:00
zrguo
7dd6bd4ceb Merge branch 'main' into main 2025-01-27 23:16:06 +08:00
zrguo
ba40a8de8b Merge pull request #659 from danielaskdd/cvs_robustness
Enhance robustness of CVS processing ,Fix potential CSV parsing issues
2025-01-27 23:12:43 +08:00
Saifeddine ALOUI
e4b2a5956e Upgraded ui 2025-01-27 12:49:12 +01:00
Saifeddine ALOUI
a4156fed19 Fixed ui 2025-01-27 12:44:22 +01:00
Saifeddine ALOUI
340ba40770 Added rescan button 2025-01-27 12:25:59 +01:00
Saifeddine ALOUI
0721ee303c Fixed files list 2025-01-27 12:02:22 +01:00
Saifeddine ALOUI
7957c7c753 split the html and javascript code 2025-01-27 10:23:50 +01:00
Saifeddine ALOUI
16d1ae77ee fixed csv_string_to_list when data contains null 2025-01-27 10:15:30 +01:00
Saifeddine ALOUI
315f0bf5f9 Added escaping to list_of_list_to_csv 2025-01-27 10:13:06 +01:00
Saifeddine ALOUI
5d97d7e42c removed storage.py 2025-01-27 10:01:59 +01:00
Saifeddine ALOUI
56e9c9f4d5 Moved the storages to kg folder 2025-01-27 09:59:26 +01:00
Saifeddine ALOUI
52037205eb Update tidb_impl.py 2025-01-27 09:40:50 +01:00