Commit Graph

1753 Commits

Author SHA1 Message Date
MdNazishArmanShorthillsAI
44ef234002 Improved variable assignment to use your own azure open ai embedding model 2025-02-17 12:43:51 +05:30
zrguo
fce24f7611 Merge pull request #797 from danielaskdd/add-env-settings
Add the token size truncation for local query and token size setting by env
2025-02-17 15:00:07 +08:00
zrguo
0d19ca8945 Merge pull request #800 from ArnoChenFx/misc
Fix: Correct component paths, add 'api' tab, and handle invalid num_turns
2025-02-17 13:32:03 +08:00
ArnoChen
7c68bf7ab7 move ThemeProvider and ThemeToggle components 2025-02-17 12:35:35 +08:00
yangdx
b7cce9312f Fix linting 2025-02-17 12:34:54 +08:00
ArnoChen
6da53a302a add api tab in webui and handle invalid num_turns 2025-02-17 12:32:04 +08:00
yangdx
ae37454c42 Replace verbose_debug with logger.debug for token logging.
- Removed unused verbose_debug import
- Updated debug logging in kg_query
- Updated debug logging in mix_kg_vector_query
- Updated debug logging in kg_query_with_keywords
2025-02-17 12:28:49 +08:00
yangdx
d3ff8c3537 Set OpenAI logger level to INFO if VERBOSE_DEBUG is off 2025-02-17 12:20:47 +08:00
yangdx
9963fb7ff4 Make VERBOSE_DEBUG configurable via environment variable
- Adds environment variable support
- Defaults to "false" if not set
- Case-insensitive check for "true"
- Simplifies debugging configuration
- Maintains backward compatibility
2025-02-17 11:37:38 +08:00
zrguo
9e448b7da4 Merge pull request #792 from ArnoChenFx/light-webui
new LightRAG WebUI
2025-02-17 10:50:35 +08:00
yangdx
4fd1f214c1 Add verbose debug output option to API configuration
- Introduced `--verbose` flag
- Defaults to `False`
2025-02-17 03:57:58 +08:00
ArnoChen
6efee1c2fe fix docstring for documents endpoint 2025-02-17 02:23:24 +08:00
ArnoChen
dfd7f702dc new build
fix api alert
2025-02-17 02:08:55 +08:00
ArnoChen
c5f380986d implement API key alert 2025-02-17 01:59:36 +08:00
yangdx
806eadf5dc Add verbose debug option to control detailed debug output level
• Added VERBOSE env var & CLI flag
• Implemented verbose_debug() function
• Added verbose option to splash screen
• Reduced default debug output length
• Modified LLM debug logging behavior
2025-02-17 01:38:18 +08:00
ArnoChen
f5ee1f2cdb release new webui 2025-02-17 01:14:33 +08:00
ArnoChen
cf7c45b5dd format 2025-02-17 01:05:48 +08:00
ArnoChen
c2a7079392 finish document manager 2025-02-17 01:05:31 +08:00
ArnoChen
be4cdedfa1 add API tab to display backend documentation 2025-02-17 01:04:14 +08:00
ArnoChen
ca85b82a47 implement endpoint to retrieve document statuses 2025-02-17 01:03:24 +08:00
yangdx
9ec920661d Improve token estimation accuracy by using tiktoken instead of regex-based approach
• Replace regex token estimation method
• Use tiktoken for more precise counting
• Support all types of text input
• Simplify code implementation
2025-02-16 22:53:58 +08:00
yangdx
b450430109 Change log level from info to debug for token count logging 2025-02-16 22:42:53 +08:00
yangdx
8f6e9fcf50 Merge branch 'main' into add-env-settings 2025-02-16 22:34:39 +08:00
yangdx
cfb49fc013 Delete inline comment about config.ini 2025-02-16 22:31:12 +08:00
ArnoChen
801a980c03 Merge branch 'main' into light-webui 2025-02-16 22:09:18 +08:00
zrguo
200319f293 Merge pull request #791 from ArnoChenFx/refactor-server
Refactor File Indexing for Background Asynchronous Processing
2025-02-16 22:07:30 +08:00
ArnoChen
e5b89c5400 fix retrieval testing and query settings 2025-02-16 21:58:30 +08:00
ArnoChen
fc3ca2777f add query settings 2025-02-16 21:43:14 +08:00
ArnoChen
893b645506 unify doc status retrieval with get_docs_by_status 2025-02-16 21:28:58 +08:00
yangdx
41cbecdbe6 Add token size limit truncation for node data retrieval
• Add truncate_list_by_token_size function
• Limit max tokens for local context
• Add logging for truncation info
• Apply truncation to node_datas list
2025-02-16 21:26:29 +08:00
ArnoChen
b580e47324 format 2025-02-16 21:20:43 +08:00
ArnoChen
1a6c6f30a1 Merge remote-tracking branch 'origin/main' into refactor-server
# Conflicts:
#	lightrag/api/lightrag_server.py
2025-02-16 21:19:30 +08:00
ArnoChen
bbe24ab7ce enhance query and indexing with pipeline 2025-02-16 21:11:05 +08:00
zrguo
2a0c7c0322 Merge pull request #785 from danielaskdd/improve-CORS-handling
improve CORS and streaming response headers
2025-02-16 20:31:33 +08:00
yangdx
7f13b779e1 Fix linting 2025-02-16 20:15:14 +08:00
yangdx
4e354451b7 Fix load_dotenv() missing problem for base.py 2025-02-16 20:05:45 +08:00
zrguo
ef0e81315f fix linting 2025-02-16 19:53:28 +08:00
zrguo
517ceb16fa Merge pull request #794 from St1veLiu/main
Update json_kv_impl.py
2025-02-16 19:51:43 +08:00
zrguo
31f14cf505 Merge pull request #793 from VeiledTee/patch-1
Update HuggingFace example in README.md
2025-02-16 19:49:05 +08:00
yangdx
36ff0bfa85 Improve logging message clarity by including max tokens info for truncation 2025-02-16 19:47:20 +08:00
zrguo
07178f6c2c Merge pull request #782 from YanSte/code-cleaning
Code Cleanup & Maintenance Improvements
2025-02-16 19:46:42 +08:00
Yannick Stephan
1051ff402d fixed lint 2025-02-16 12:45:27 +01:00
zrguo
f868c1da78 Merge branch 'main' into code-cleaning 2025-02-16 19:41:05 +08:00
zrguo
9ba3279424 Merge pull request #784 from YanSte/improve-docker
Improve .gitignore and .dockerignore
2025-02-16 19:37:41 +08:00
St1ve
edaba428ac Update json_kv_impl.py
There is no delete function in chunks_vdb and text_chunks in lines 1300-1302 of the lightrag.py file:
    if chunk_ids:
                await self.chunks_vdb.delete(chunk_ids)
                await self.text_chunks.delete(chunk_ids)
2025-02-16 19:33:59 +08:00
zrguo
5189a9438c Merge pull request #780 from spo0nman/fix-bug-778
Enhance Neo4j graph storage with error handling and label validation
2025-02-16 19:30:32 +08:00
yangdx
601df31edf feat: move query-related settings to env file for better configuration
• Add env vars for token and chunk settings
• Add token count logging for prompts
• Add token count logging for context
• Move hardcoded values to env variables
• Improve logging clarity and consistency
2025-02-16 19:26:57 +08:00
zrguo
292b65320a Merge pull request #781 from ArnoChenFx/enhance-mongodb-backends
Add MongoDB VectorDB Support and Optimize Existing MongoDB Implementations
2025-02-16 19:26:35 +08:00
zrguo
9d21523541 Merge pull request #772 from hhxdestiny/chroma_support_local
chroma_impl supports local persistent client: PersistentClient
2025-02-16 19:21:53 +08:00
Yannick Stephan
3319db0dba cleaned code 2025-02-15 22:37:32 +01:00