Commit Graph

1718 Commits

Author SHA1 Message Date
Enrique Catalá
f9d69b889e ruff reformat 2025-02-14 00:16:59 +01:00
Enrique Catalá
0ece8e102d lint fix 2025-02-14 00:09:32 +01:00
Enrique Catalá
991fa33986 Enable LiteLLM proxy with embedding_binding_host 2025-02-13 22:45:03 +01:00
Yannick Stephan
cf0b9ce6be fixed the delete 2025-02-13 20:52:33 +01:00
ArnoChen
cac1c993a9 remove redundant cosine similarity filter in Qdrant query
fix
2025-02-14 03:16:01 +08:00
ArnoChen
307184985b fix configuration errors of milvus 2025-02-14 03:00:56 +08:00
ArnoChen
0f12b400e4 disabled check_storage_env_vars
because the configurations of many backends can be read from the configuration file instead of environment variables.
2025-02-14 02:50:11 +08:00
ArnoChen
637e7efa83 add the missing MongoDocStatusStorage 2025-02-14 02:49:00 +08:00
ArnoChen
9a91b68e62 fix configuration errors of mongodb, neo4j, and qdrant backends. 2025-02-14 02:48:15 +08:00
yangdx
35d6e2d322 Fix linting 2025-02-14 02:32:33 +08:00
yangdx
6f999aa5e5 Refactor file conversion to use async execution
- Wrap sync conversion in async function
- Use asyncio.to_thread for non-blocking IO
- Maintain same functionality as before
- Clean up temporary files properly
- Improve responsiveness of file processing
2025-02-14 02:31:58 +08:00
yangdx
cd3815e825 Fix linting 2025-02-14 01:14:12 +08:00
yangdx
08364e99fb Move document scanning trigger by command line to background task
- Added background task management
- Prevented concurrent scanning
- Tracked scanning progress
- Improved startup performance
- Enhanced error handling
2025-02-14 01:12:39 +08:00
zrguo
5730987349 Merge pull request #759 from enriquecatala/fix-env-security
Exclude .env from Docker Image & Mount as Volume in docker-compose.yml
2025-02-14 00:50:51 +08:00
ultrageopro
8773ad983f fix: incorrect usage of os.environ.get in PASSWORD 2025-02-13 18:09:24 +03:00
ultrageopro
a50cdbc177 fix: incorrect usage of os.environ.get method in neo4j 2025-02-13 18:07:24 +03:00
yangdx
47268c2ab1 Fix linting 2025-02-13 21:01:34 +08:00
yangdx
e1d9dba20d Fix typos in documentation tree structure and storage implementation names
• Correct menu tree structure in splash screen
• Fix MilvusVectorDBStorage typo
• Update storage env requirements
2025-02-13 20:40:29 +08:00
ultrageopro
1a0d7d6ece fix: linting 2025-02-13 15:29:18 +03:00
ultrageopro
438caa776d fix: neo4j MAX_CONNECTION_POOL_SIZE impl 2025-02-13 15:26:45 +03:00
zrguo
8282a0ee00 Merge pull request #744 from danielaskdd/select-datastore-in-api-server
Add datastore selection feature for API Server
2025-02-13 20:04:16 +08:00
zrguo
dea6f4f288 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 20:03:38 +08:00
zrguo
3661850ab2 Merge pull request #737 from ArnoChenFx/graph-viewer-webui
graph viewer webui
2025-02-13 19:55:32 +08:00
yangdx
fab33cfc91 chore: bump api version from 1.0.4 to 1.0.5 2025-02-13 19:33:15 +08:00
ArnoChen
42d90f2b16 rename jsondocstatus to json_doc_status for consistency 2025-02-13 18:38:12 +08:00
Enrique Catalá
cacb429ad9 fix linting 2025-02-13 11:35:38 +01:00
ArnoChen
6896d4ab21 add pre-built graph viewer files
format

a

a
2025-02-13 18:05:50 +08:00
ArnoChen
464042f2c0 display webui and graph viewer links in splash screen 2025-02-13 18:03:09 +08:00
ArnoChen
bc83c4c7ed update readme
configure output directory
2025-02-13 17:54:10 +08:00
ArnoChen
c674905a98 use KnowledgeGraph typed dict for graph API response 2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c fix typo 2025-02-13 17:32:05 +08:00
ArnoChen
adb234d5cf remove webui_depricated 2025-02-13 17:30:03 +08:00
ArnoChen
85e6989abc move lightrag_webui folder to top directory 2025-02-13 17:29:51 +08:00
yangdx
906a9f6641 docs: improve organization and clarity of API documentation 2025-02-13 15:22:18 +08:00
yangdx
5ad3555f4c docs: add MongoDB storage support and improve storage client comment 2025-02-13 14:31:12 +08:00
yangdx
cdd52809b0 Fix linting 2025-02-13 14:07:36 +08:00
yangdx
e5adb2e0f3 Improve cache logging and add more detailed log messages
• Add cache type to log data structure
• Make debug logs more detailed
• Add high-level info logs for cache hits
• Add null check for best_response
• Improve log message readability
2025-02-13 13:53:52 +08:00
yangdx
7017f114e1 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 11:25:52 +08:00
yangdx
28b17b327b Fix: top_k param handling error, unify top_k and cosine default value. 2025-02-13 06:05:21 +08:00
yangdx
76164a1b17 Use namespace for graph_name before falling back to env or default value
- Update graph_name initialization
- Add namespace override support
- Maintain backward compatibility
- Prioritize namespace over env variable
2025-02-13 04:52:54 +08:00
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
Enrique Catalá
4d0a316717 exclude .env file with potentionally sensitive information like LLM API KEYS 2025-02-12 21:32:19 +01:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
d25386ff1b refactor: simplify storage configuration handling while maintaining the same functionality 2025-02-13 04:04:51 +08:00
yangdx
11c7af7fd8 refactor: use vdb instance's cosine threshold instead of global constant
• Remove global COSINE_THRESHOLD
• Use instance-level threshold config
• Update logging statements
• Reference vdb threshold directly
2025-02-13 03:34:31 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
3308ecfa69 Refactor logging for vector similarity search with configurable threshold 2025-02-13 02:14:32 +08:00
yangdx
9a77d91023 Add LLM response cache to registered RagServer components 2025-02-13 01:30:21 +08:00
yangdx
7a89916bab Add method to retrieve in-progress documents in DocStatusStorage
• Add get_processing_docs() abstract method
• Override get_processing_docs() in PG storage
• Method retrieves docs with PROCESSING status
• Keep consistent with existing status methods
2025-02-13 01:27:27 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00