Commit Graph

1720 Commits

Author SHA1 Message Date
yangdx
b450430109 Change log level from info to debug for token count logging 2025-02-16 22:42:53 +08:00
yangdx
8f6e9fcf50 Merge branch 'main' into add-env-settings 2025-02-16 22:34:39 +08:00
yangdx
cfb49fc013 Delete inline comment about config.ini 2025-02-16 22:31:12 +08:00
yangdx
41cbecdbe6 Add token size limit truncation for node data retrieval
• Add truncate_list_by_token_size function
• Limit max tokens for local context
• Add logging for truncation info
• Apply truncation to node_datas list
2025-02-16 21:26:29 +08:00
zrguo
2a0c7c0322 Merge pull request #785 from danielaskdd/improve-CORS-handling
improve CORS and streaming response headers
2025-02-16 20:31:33 +08:00
yangdx
7f13b779e1 Fix linting 2025-02-16 20:15:14 +08:00
yangdx
4e354451b7 Fix load_dotenv() missing problem for base.py 2025-02-16 20:05:45 +08:00
zrguo
ef0e81315f fix linting 2025-02-16 19:53:28 +08:00
zrguo
517ceb16fa Merge pull request #794 from St1veLiu/main
Update json_kv_impl.py
2025-02-16 19:51:43 +08:00
zrguo
31f14cf505 Merge pull request #793 from VeiledTee/patch-1
Update HuggingFace example in README.md
2025-02-16 19:49:05 +08:00
yangdx
36ff0bfa85 Improve logging message clarity by including max tokens info for truncation 2025-02-16 19:47:20 +08:00
zrguo
07178f6c2c Merge pull request #782 from YanSte/code-cleaning
Code Cleanup & Maintenance Improvements
2025-02-16 19:46:42 +08:00
Yannick Stephan
1051ff402d fixed lint 2025-02-16 12:45:27 +01:00
zrguo
f868c1da78 Merge branch 'main' into code-cleaning 2025-02-16 19:41:05 +08:00
zrguo
9ba3279424 Merge pull request #784 from YanSte/improve-docker
Improve .gitignore and .dockerignore
2025-02-16 19:37:41 +08:00
St1ve
edaba428ac Update json_kv_impl.py
There is no delete function in chunks_vdb and text_chunks in lines 1300-1302 of the lightrag.py file:
    if chunk_ids:
                await self.chunks_vdb.delete(chunk_ids)
                await self.text_chunks.delete(chunk_ids)
2025-02-16 19:33:59 +08:00
zrguo
5189a9438c Merge pull request #780 from spo0nman/fix-bug-778
Enhance Neo4j graph storage with error handling and label validation
2025-02-16 19:30:32 +08:00
yangdx
601df31edf feat: move query-related settings to env file for better configuration
• Add env vars for token and chunk settings
• Add token count logging for prompts
• Add token count logging for context
• Move hardcoded values to env variables
• Improve logging clarity and consistency
2025-02-16 19:26:57 +08:00
zrguo
292b65320a Merge pull request #781 from ArnoChenFx/enhance-mongodb-backends
Add MongoDB VectorDB Support and Optimize Existing MongoDB Implementations
2025-02-16 19:26:35 +08:00
zrguo
9d21523541 Merge pull request #772 from hhxdestiny/chroma_support_local
chroma_impl supports local persistent client: PersistentClient
2025-02-16 19:21:53 +08:00
Yannick Stephan
3319db0dba cleaned code 2025-02-15 22:37:32 +01:00
Yannick Stephan
eaf1d553d2 improved typing 2025-02-15 22:37:12 +01:00
Yannick Stephan
8d0d8b8279 remove unsused method 2025-02-15 22:24:49 +01:00
Yannick Stephan
49ce229af7 fix wrong type 2025-02-15 22:23:16 +01:00
Ethan Heavey
875d18d80f Update HuggingFace example in README.md
Replaced "hf_embedding" with "hf_embed" in HuggingFace example to match implementation
2025-02-15 12:51:24 -04:00
yangdx
8fdbcb0d3f fix: reorganize server info display and add CORS origins info
• Add CORS origins display
• Move API key status higher in display
• Fix tree symbols for better readability
• Regroup related server info
• Remove redundant line breaks
2025-02-15 11:46:47 +08:00
yangdx
2985d88f97 refactor: improve CORS and streaming response headers
- Add configurable CORS origins
- Remove duplicate CORS headers
- Add X-Accel-Buffering header
- Update env example file
- Clean up header configurations
2025-02-15 11:39:10 +08:00
yangdx
0db0419c6d Fix linting 2025-02-15 11:08:54 +08:00
yangdx
ad88ba03bf docs: reorganize Ollama emulation API documentation for better readability 2025-02-15 11:07:38 +08:00
Yannick Stephan
50919442e9 Improve git and docker ignore 2025-02-15 00:58:24 +01:00
Yannick Stephan
621540a54e cleaned code 2025-02-15 00:23:14 +01:00
Yannick Stephan
805da7b95b cleaned code 2025-02-15 00:02:24 +01:00
Yannick Stephan
7e526d3436 cleaned code 2025-02-14 23:52:05 +01:00
Yannick Stephan
e6520ad6a2 added typing 2025-02-14 23:49:39 +01:00
Yannick Stephan
cf6e327bf4 added type and cleaned code 2025-02-14 23:42:52 +01:00
Yannick Stephan
dfa8681924 code clean 2025-02-14 23:33:59 +01:00
Yannick Stephan
66f555677a cleaning the message and project no needed 2025-02-14 23:31:27 +01:00
Yannick Stephan
28c8443ff2 cleaning the mess 2025-02-14 22:50:49 +01:00
ArnoChen
a600beb619 implement MongoDB support for VectorDB storage. optimize existing MongoDB implementations 2025-02-15 00:38:41 +08:00
ArnoChen
70fc4cbfb0 handle missing edge types in graph data 2025-02-15 00:34:38 +08:00
Pankaj Kaushal
cd81312659 Enhance Neo4j graph storage with error handling and label validation
- Add label existence check and validation methods in Neo4j implementation
- Improve error handling in get_node, get_edge, and upsert methods
- Add default values and logging for missing edge properties
- Ensure consistent label processing across graph storage methods
2025-02-14 16:07:41 +01:00
yangdx
f6058b79b6 Update .env.example with absolute path placeholders 2025-02-14 13:26:19 +08:00
yangdx
258c7596e6 fix: Improve file path handling and logging for document scanning
• Convert relative paths to absolute paths
• Add logging for file scanning progress
• Log total number of new files found
• Enhance file scanning feedback
• Improve path resolution safety
2025-02-14 12:50:43 +08:00
yangdx
2c56141bfd Standardize variable names with other vector database implementations (without functional modifications) 2025-02-14 12:34:26 +08:00
destiny
a5cd2b1958 Fix embedding type conversion issue in the query function of chroma_impl; chroma_impl supports local persistent client: PersistentClient 2025-02-14 11:00:54 +08:00
zrguo
4d58ff8bb4 Merge pull request #771 from enriquecatala/fix-litellm-litellm-proxy-support
Enable LiteLLM proxy with embedding_binding_host
2025-02-14 09:43:55 +08:00
zrguo
6a5e92aeed Merge pull request #769 from YanSte/fix-delete
Fixe the delete
2025-02-14 09:42:43 +08:00
zrguo
a5a6b42f79 Merge pull request #766 from danielaskdd/background-scan-at-startup
Move document scanning trigger by command line to background task
2025-02-14 09:41:20 +08:00
zrguo
2f2e4f4664 Merge pull request #768 from ArnoChenFx/fix-backends
Fix various runtime errors
2025-02-14 09:39:27 +08:00
zrguo
1841c8d536 Merge branch 'main' into fix-backends 2025-02-14 09:39:11 +08:00