gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,926 Commits 2 Branches 0 Tags
637d37eec49510da8dc4037909cc62697ec07cc1
Commit Graph

642 Commits

Author SHA1 Message Date
yangdx
d52b6bead1 Refactor graph search and add local Vite config. 
- Simplify graph search parameters in API
- Add inclusive search and min degree options
- Update Vite config for local development
- Enhance graph query endpoint in web UI
- Add new Vite config file for local setup
 2025-03-05 10:39:27 +08:00
Yannick Stephan
a39e1554d1 Merge pull request #994 from Brocowlee/language_support 
[EVO] Add language configuration to environment and argument parsing
 2025-03-04 22:33:03 +01:00
Saifeddine ALOUI
f1ad55244a linting 2025-03-04 14:44:12 +01:00
Brocowlee
a688b8822a [EVO] Add language configuration to environment and argument parsing 2025-03-04 10:09:47 +00:00
yangdx
002948d342 Added search mode and min degree filtering for NetworkX 
- Implemented exact and inclusive search modes
- Added min degree filtering for nodes
- Updated API to parse label for search options
 2025-03-04 16:08:05 +08:00
Saifeddine ALOUI
694daf158a Merge branch 'HKUDS:main' into main 2025-03-04 08:27:53 +01:00
zrguo
9d56b1c8a4 Merge pull request #976 from danielaskdd/validate-content-before-enqueue 
Improved file handling and validation for document processing
 2025-03-04 13:26:54 +08:00
zrguo
6094c62540 Merge pull request #987 from danielaskdd/fix-webui-install 
fix: api server installation missing MANIFEST.in file
 2025-03-04 13:26:19 +08:00
zrguo
42d10308f4 Merge pull request #986 from danielaskdd/docx-pptx-packagename 
Fix package name checks for docx and pptx modules.
 2025-03-04 13:24:51 +08:00
yangdx
d7f7c07251 Fix linting 2025-03-04 12:19:40 +08:00
yangdx
b12c05ec0a fix: api server installation missing MANIFEST.in file 
- Added MANIFEST.in to include webui files
- Removed /webui/ endpoint from lightrag_server.py
 2025-03-04 12:09:00 +08:00
yangdx
61839f311a Fix package name checks for docx and pptx modules. 
- Added type ignore for package checks
- Corrected docx pptx package name for new version
 2025-03-04 10:00:07 +08:00
yangdx
d69042f161 Merge branch 'main' into standalone-logger-setup 2025-03-04 09:54:14 +08:00
yangdx
56d6a68139 Merge branch 'main' into validate-content-before-enqueue 2025-03-04 09:53:47 +08:00
yangdx
b26a574f40 Deprecate log_level and log_file_path in LightRAG. 
- Remove log_level from API initialization
- Add warnings for deprecated logging params
 2025-03-04 01:07:34 +08:00
yangdx
462c27c167 Refactor logging setup and simplify Gunicorn configuration 
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
 2025-03-03 23:18:41 +08:00
Saifeddine ALOUI
5680e9ef11 Update lightrag_server.py 2025-03-03 12:24:49 +01:00
Saifeddine ALOUI
7b3e394730 Update run_with_gunicorn.py 2025-03-03 12:23:47 +01:00
Saifeddine ALOUI
52bedc9118 Update run_with_gunicorn.py 2025-03-03 12:22:37 +01:00
Saifeddine ALOUI
bda931e1d2 Update run_with_gunicorn.py 2025-03-03 12:21:50 +01:00
Saifeddine ALOUI
e87feb76bc Update run_with_gunicorn.py 2025-03-03 12:21:15 +01:00
Saifeddine ALOUI
ff3f29d240 Update run_with_gunicorn.py 2025-03-03 12:13:01 +01:00
Saifeddine ALOUI
7a866cbe21 Update run_with_gunicorn.py 2025-03-03 11:48:43 +01:00
yangdx
aa5888042e Improved file handling and validation for document processing 
• Enhanced UTF-8 validation for text files
• Added content validation checks
• Better handling of binary data
• Added logging for ignored document IDs
• Improved document ID filtering
 2025-03-02 23:57:57 +08:00
yangdx
644ed15d75 Merge branch 'add-multi-worker-support' into max-graph-node 2025-03-02 18:37:56 +08:00
yangdx
fca6969b0b Update Gunicorn startup instructions in API documentation 2025-03-02 18:33:18 +08:00
yangdx
7a8bd15203 Merge branch 'add-multi-worker-support' into max-graph-node 2025-03-02 18:24:22 +08:00
yangdx
fb5f11f594 Add Gunicorn support for production deployment of LightRAG server 
- Move gunicorn startup an config files to api package
- Create new CLI entry point for Gunicorn mode
 2025-03-02 18:17:51 +08:00
yangdx
465737efed Fix linting 2025-03-02 17:32:25 +08:00
yangdx
1ca6837219 Add max nodes limit for graph retrieval of networkX 
• Set MAX_GRAPH_NODES env var (default 1000)
• Change edge type to "RELATED"
 2025-03-02 12:52:25 +08:00
yangdx
e20aeada92 docs: add gunicorn deployment guide and update server 2025-03-02 02:43:11 +08:00
yangdx
8d6960f280 Fix linting 2025-03-02 00:13:11 +08:00
yangdx
f76cf98dbd Add automatic dependency checking and installation for server startup 
• Added check_and_install_dependencies()
• Install missing dependencies automatically
 2025-03-02 00:04:59 +08:00
yangdx
e8d0d065f3 fix: Improve async handling and FAISS storage reliability 
- Add async context manager support
- Fix embedding data type conversion
- Improve error handling in FAISS ops
- Add multiprocess storage sync
 2025-03-01 23:35:09 +08:00
yangdx
3507e894d9 Merge branch 'main' into add-multi-worker-support 2025-03-01 15:55:37 +08:00
yangdx
40e9e26edb feat: add update flags status to API health endpoint 2025-03-01 14:58:26 +08:00
yangdx
c07a5039b7 Refactor shared storage locks to separate pipeline, storage and internal locks for deadlock preventing 2025-03-01 10:48:55 +08:00
yangdx
d704512139 Refactor shared storage module to improve async handling and naming consistency 
• Add async support for get_namespace_data
• Rename get_update_flags to get_update_flag
• Rename set_update_flag to set_all_update_flags
• Update docstrings for clarity
• Fix typos in log messages
 2025-03-01 05:01:26 +08:00
yangdx
fd76e00c6a Refactor storage initialization to separate object creation from data loading 
• Split __post_init__ and initialize()
• Move data loading to initialize()
• Add FastAPI lifespan integration
 2025-03-01 03:48:19 +08:00
yangdx
b3328542c7 refactor: migrate synchronous locks to async locks for improved concurrency 
• Add UnifiedLock wrapper class
• Convert with blocks to async with
 2025-03-01 02:22:35 +08:00
yangdx
aac1bdd9e6 feat: add configurable log rotation settings via environment variables 
• Add LOG_DIR env var for log file location
• Add LOG_MAX_BYTES for max log file size
• Add LOG_BACKUP_COUNT for backup count
 2025-02-28 23:21:14 +08:00
yangdx
c973498c34 Fix linting 2025-02-28 21:35:04 +08:00
yangdx
c37b1e8aa7 Align Gunicorn configuration with Uvicorn 
- centralize config in gunicorn_config.py
- fix log level handling in Gunicorn
 2025-02-28 20:41:11 +08:00
yangdx
f588cdc5df Optimize logging config & worker handling for different server modes 
• Separate logging config for uvicorn/gunicorn
• Force workers=1 in uvicorn mode
• Add warning for worker count in uvicorn
 2025-02-28 16:50:54 +08:00
yangdx
81f6f6e343 Fix lightrag logger initailization problem, fix gunicorn acccess log missing 2025-02-28 16:07:33 +08:00
yangdx
157ec862ae Enhance logging system with file rotation and unified configuration 
• Unify logging across Gunicorn and Uvicorn
• Add rotating file handlers
 2025-02-28 14:57:25 +08:00
yangdx
8cd45161f2 feat: add history_messages to track pipeline processing progress 
• Add shared history_messages list
• Track pipeline progress with messages
 2025-02-28 13:53:40 +08:00
yangdx
b090a22be7 Add concurrency check for auto scan task to prevent duplicate scans 
• Add pipeline status check before scan
• Add storage lock protection
• Add latest_message to status tracking
• Add helpful log message at startup
 2025-02-28 12:22:20 +08:00
yangdx
04bd5413c9 Add API endpoint to retrieve document indexing pipeline status 
• GET /pipeline_status endpoint added
• Returns current pipeline processing state
 2025-02-28 12:21:50 +08:00
yangdx
b4bcd76599 Remove useless scan progress tracking functionality and related code 2025-02-28 10:53:36 +08:00