Commit Graph

2271 Commits

Author SHA1 Message Date
Saifeddine ALOUI
7b3e394730 Update run_with_gunicorn.py 2025-03-03 12:23:47 +01:00
Saifeddine ALOUI
52bedc9118 Update run_with_gunicorn.py 2025-03-03 12:22:37 +01:00
Saifeddine ALOUI
bda931e1d2 Update run_with_gunicorn.py 2025-03-03 12:21:50 +01:00
Saifeddine ALOUI
e87feb76bc Update run_with_gunicorn.py 2025-03-03 12:21:15 +01:00
zrguo
a27cf5a09e fix delete_by_doc_id 2025-03-03 19:17:34 +08:00
Saifeddine ALOUI
ff3f29d240 Update run_with_gunicorn.py 2025-03-03 12:13:01 +01:00
Saifeddine ALOUI
7a866cbe21 Update run_with_gunicorn.py 2025-03-03 11:48:43 +01:00
zrguo
ef2a5ad191 fix linting 2025-03-03 18:40:03 +08:00
zrguo
1611400854 fix demo 2025-03-03 18:33:42 +08:00
MdNazishArmanShorthillsAI
0ea274a30d Improved cashing check 2025-03-03 13:53:45 +05:30
zrguo
887388c317 fix linting 2025-03-03 14:54:28 +08:00
zrguo
0320aa4ccc Merge pull request #971 from Volve-Technologies/abyl/adding_full_doc_id
adding full_doc_id to insert
2025-03-03 14:44:50 +08:00
yangdx
c21d5744f9 Remove duplicated run_with_gunicorn.py 2025-03-03 02:05:54 +08:00
yangdx
b07181ca39 Remove duplicated run_with_gunicorn.py from project root 2025-03-03 01:59:20 +08:00
yangdx
e854313438 Merge branch 'main' into validate-content-before-enqueue 2025-03-03 01:34:55 +08:00
yangdx
11fdb60fe5 Remove Chinese comments 2025-03-03 01:30:41 +08:00
yangdx
a9a1fae787 Merge branch 'main' into max-graph-node 2025-03-03 01:20:05 +08:00
Yannick Stephan
2d6d0be128 Merge pull request #969 from danielaskdd/add-multi-worker-support
Add multi workers support for API Server
2025-03-02 17:47:00 +01:00
yangdx
aa5888042e Improved file handling and validation for document processing
• Enhanced UTF-8 validation for text files
• Added content validation checks
• Better handling of binary data
• Added logging for ignored document IDs
• Improved document ID filtering
2025-03-02 23:57:57 +08:00
yangdx
12fbc5b851 Updated env.example with better documentation and clarity
- Renamed file from .env.example to env.example
2025-03-02 19:12:11 +08:00
yangdx
644ed15d75 Merge branch 'add-multi-worker-support' into max-graph-node 2025-03-02 18:37:56 +08:00
yangdx
fca6969b0b Update Gunicorn startup instructions in API documentation 2025-03-02 18:33:18 +08:00
yangdx
7a8bd15203 Merge branch 'add-multi-worker-support' into max-graph-node 2025-03-02 18:24:22 +08:00
yangdx
fb5f11f594 Add Gunicorn support for production deployment of LightRAG server
- Move gunicorn startup an config files to api package
- Create new CLI entry point for Gunicorn mode
2025-03-02 18:17:51 +08:00
yangdx
465737efed Fix linting 2025-03-02 17:32:25 +08:00
yangdx
68bf02abb6 refactor: improve graph querying with label substring matching and security fixes 2025-03-02 16:20:37 +08:00
yangdx
0f1eb42c8d Add node limit and prioritization for knowledge graph retrieval
• Add MAX_GRAPH_NODES limit from env var
• Prioritize nodes by label match & connection
2025-03-02 15:39:14 +08:00
zrguo
265fc2c87f fix linting 2025-03-02 14:24:54 +08:00
zrguo
5198240cf9 remove " and upper() 2025-03-02 14:23:06 +08:00
yangdx
87d0ee0127 Merge branch 'add-multi-worker-support' into max-graph-node 2025-03-02 12:53:05 +08:00
yangdx
1ca6837219 Add max nodes limit for graph retrieval of networkX
• Set MAX_GRAPH_NODES env var (default 1000)
• Change edge type to "RELATED"
2025-03-02 12:52:25 +08:00
yangdx
396b8c3347 Add psutil to required dependencies for runtime monitoring 2025-03-02 12:44:58 +08:00
yangdx
7124845e55 Optimize document processing pipeline with better status tracking & batch handling
• Add upfront doc processing check
• Optimize pipeline status updates
2025-03-02 11:09:32 +08:00
yangdx
1a5eb20003 Fix history_messages clearing in LightRAG pipeline status initialization 2025-03-02 04:43:41 +08:00
yangdx
c0b22a8ae2 Merge branch 'main' into add-multi-worker-support 2025-03-02 02:54:57 +08:00
yangdx
e20aeada92 docs: add gunicorn deployment guide and update server 2025-03-02 02:43:11 +08:00
yangdx
8fb3670ac7 Add additional log-related patterns to gitignore 2025-03-02 02:26:21 +08:00
yangdx
7cd25fe5ab Improve shared storage cleanup and clarify initialization in multi-worker setup 2025-03-02 01:00:27 +08:00
yangdx
8d6960f280 Fix linting 2025-03-02 00:13:11 +08:00
yangdx
f76cf98dbd Add automatic dependency checking and installation for server startup
• Added check_and_install_dependencies()
• Install missing dependencies automatically
2025-03-02 00:04:59 +08:00
yangdx
e8d0d065f3 fix: Improve async handling and FAISS storage reliability
- Add async context manager support
- Fix embedding data type conversion
- Improve error handling in FAISS ops
- Add multiprocess storage sync
2025-03-01 23:35:09 +08:00
yangdx
9aef112d51 Fix incorrect comment about update flag behavior in FAISS implementation 2025-03-01 22:27:12 +08:00
Abyl Ikhsanov
bf0ddc6450 making optional for ainsert 2025-03-01 13:34:49 +01:00
Abyl Ikhsanov
baa505eeb0 adding full_doc_id to insert 2025-03-01 13:26:02 +01:00
zrguo
9aa438cf79 fix linting 2025-03-01 18:35:12 +08:00
zrguo
a8f4385c05 Add clear_cache 2025-03-01 18:30:58 +08:00
zrguo
a923ee89b0 Update __init__.py 2025-03-01 17:47:53 +08:00
zrguo
4219454fab fix format 2025-03-01 17:45:06 +08:00
yangdx
e3a40c2fdb Fix linting 2025-03-01 16:23:34 +08:00
yangdx
3507e894d9 Merge branch 'main' into add-multi-worker-support 2025-03-01 15:55:37 +08:00