Commit Graph

1987 Commits

Author SHA1 Message Date
yangdx
81f887ebab feat: Remove immediate persistence in delete operation
- Enhance delete implementation in JsonKVStorage by removing immediate persistence in delete operation
- Update documentation for drop method to clarify persistence behavior
- Add abstract delete method to BaseKVStorage
2025-03-31 14:14:32 +08:00
yangdx
bbc770d1ed feat(api): enhance document clearing error handling and status reporting
- Change pipeline busy status from "error" to "busy"
- Improve error handling documentation
2025-03-31 13:01:52 +08:00
Eric Shao
b79dac9d63 feat(DocumentManager): Add document status filter feature, support filtering documents by status 2025-03-31 12:43:21 +08:00
yangdx
fe270a9ebe Remove some graph storage support: MongoDB, TiDB and Oracle 2025-03-31 12:18:53 +08:00
yangdx
795b69b275 Add drop support for TiDB 2025-03-31 12:11:21 +08:00
Milin
4dbd5e3899 Merge branch 'main' into optimize-config-management
# Conflicts:
#	env.example
#	lightrag/api/utils_api.py
2025-03-31 11:29:29 +08:00
Milin
088fc19318 feat(config): Refactor configuration management
- Optimize JWT Auth module to load configuration via `global_args`.
- Decouple configuration-related code from `utils_api.py`, and add a new `config.py` file for unified configuration management.
- Adjust configuration import in `lightrag_server.py`, `auth.py`, and `document_routes.py` to be introduced through `global_args`.
2025-03-31 11:19:47 +08:00
yangdx
9959ea90a8 Add drop support for Oracle 2025-03-31 03:19:06 +08:00
yangdx
6a51f38cae Remove namespace_prefix from PostgreSQL, maintain consistency with other storage implementation 2025-03-31 02:59:44 +08:00
yangdx
5b7cd50005 Add delete support for MongoKVStorage 2025-03-31 02:14:16 +08:00
yangdx
078cee390c Add drop support for all storage type implementation for Mongo DB 2025-03-31 02:10:58 +08:00
yangdx
b411ce2fed Add drop support for RedisKVStorage 2025-03-31 01:40:14 +08:00
yangdx
77bc9594cf Remove delete_entity and delete_entity_relation from RediskKVStorage 2025-03-31 01:34:41 +08:00
yangdx
0a82356d08 Add drop support for Gremlin Graph 2025-03-31 01:16:56 +08:00
yangdx
ee2719896f Add drop support for AGE storage 2025-03-31 01:09:30 +08:00
yangdx
637d37eec4 Update drop implementation for all storage type of PostgreSQL 2025-03-31 01:03:41 +08:00
yangdx
8b125488e9 Bump api version to 1.2.9 2025-03-30 16:31:57 +08:00
yangdx
949a3904a9 feat(api): Enhance document clearing functionality
- Use storage drop methods to properly clean up all data
- Add file deletion from input directory
- Add pipeline status checking and locking mechanism
- Improve error handling with detailed logging and pipeline message tracking
2025-03-30 16:30:41 +08:00
yangdx
53ab5e015c remove check_storage_env_vars from lightrag.py 2025-03-30 15:25:04 +08:00
yangdx
1df4b777d7 Add drop funtions to storage implementations 2025-03-30 15:17:57 +08:00
yangdx
1a25a78e8a feat: remove check_storage_env_vars and add TODOs
- Remove unused check_storage_env_vars method
- Add TODO to check if has_edge works on reverse relation
- Add TODO about entities_vdb.client_storage local storage limitation
2025-03-30 10:25:49 +08:00
choizhang
164faf94e2 feat(TokenTracker): Add context manager support to simplify token tracking 2025-03-30 00:59:23 +08:00
yangdx
a3ff0534d6 Remove the comments at the end of the environment variable lines in .env file 2025-03-29 13:52:29 +08:00
yangdx
b79fb87dc7 Fix liinting 2025-03-29 13:22:16 +08:00
yangdx
8e57a925f1 Remove the comments at the end of the environment variable lines in .env file 2025-03-29 13:20:22 +08:00
yangdx
c94f30be2d Shorten log message to fit in pipelinestatus UI 2025-03-29 13:18:22 +08:00
yangdx
7c5442b392 Update doc 2025-03-29 04:05:31 +08:00
yangdx
65574459f9 standardize .env loading behavior across modules 2025-03-29 03:48:38 +08:00
yangdx
539fcd5ebb Update env file warning message to be more specific 2025-03-29 03:42:51 +08:00
yangdx
c590d5878c refactor: standardize .env loading behavior across modules
- Use .env from current folder for each lightrag instance
- Allow different .env files for different instances
- Make OS env vars take precedence over .env file
2025-03-29 03:37:23 +08:00
yangdx
0f051a35bd Update webui assets 2025-03-29 01:56:11 +08:00
yangdx
c057bf891d Update webui assets 2025-03-29 01:53:14 +08:00
yangdx
fb4143683b Bump core version to 1.3.1 2025-03-29 01:16:46 +08:00
yangdx
130f6b6ced Update webui assets 2025-03-29 00:21:18 +08:00
yangdx
80335d57a5 Fix linting 2025-03-28 21:43:47 +08:00
yangdx
feacae1ce4 Show more info in verbose_debug 2025-03-28 21:39:04 +08:00
yangdx
491c78dac1 Improve OpenAI LLM logging with more detailed debug information 2025-03-28 21:33:59 +08:00
yangdx
fbe9d399db Bump api version to 1.2.8 2025-03-28 16:51:01 +08:00
yangdx
baa68eafcb Update webui assets 2025-03-28 16:50:05 +08:00
yangdx
adb4ca9294 Fix linting 2025-03-28 16:49:35 +08:00
yangdx
35d4503677 Feat: add duplicate file check 2025-03-28 16:48:46 +08:00
zrguo
7d7df69f4b Merge pull request #1207 from choizhang/track-tokens
feat:  Add TokenTracker to track token usage for LLM calls
2025-03-28 16:39:55 +11:00
zrguo
87fbffde14 fix citation 2025-03-28 13:30:24 +08:00
yangdx
783020aab5 Update webui assets 2025-03-28 12:04:11 +08:00
yangdx
cce91bdd5a Add core version to server startup splash screen 2025-03-28 08:20:55 +08:00
Shane Walker
d45dc14069 feat(openai): add client configuration support to OpenAI integration
Add support for custom client configurations in the OpenAI integration,
allowing for more flexible configuration of the AsyncOpenAI client.
This includes:

- Create a reusable helper function `create_openai_async_client`
- Add proper documentation for client configuration options
- Ensure consistent parameter precedence across the codebase
- Update the embedding function to support client configurations
- Add example script demonstrating custom client configuration usage

The changes maintain backward compatibility while providing a cleaner
and more maintainable approach to configuring OpenAI clients.
2025-03-27 15:39:39 -07:00
choizhang
8488229a29 feat: Add TokenTracker to track token usage for LLM calls 2025-03-28 01:25:15 +08:00
yangdx
6a85a97f93 Update i18n translation 2025-03-27 17:23:20 +08:00
yangdx
94f2d3c42d Update webui assets 2025-03-27 16:55:23 +08:00
yangdx
7e812d4929 Merge branch 'main' into sort-file 2025-03-27 13:40:22 +08:00