Commit Graph

2015 Commits

Author SHA1 Message Date
yangdx
a848884a7b Remove unnesessary CLI arguments, reduce CLI arguments complexity
• Move storage config from CLI
• Move LLM and embedding binding config from CLI
• Remove chunk config from CLI
2025-02-21 19:34:17 +08:00
yangdx
9ba12a4f31 refactor: remove redundant top_k checks in query routes
The top_k parameter already has a default value set in the QueryParam class (base.py), making these checks unnecessary. This change simplifies the code while maintaining the same functionality.

Changes:

Remove top_k check in query_text function
Remove top_k check in query_text_stream function
2025-02-21 18:53:43 +08:00
yangdx
e8efcc335d Add access log filtering to reduce noise from high-frequency API endpoints 2025-02-21 17:53:01 +08:00
yangdx
c95656ca87 feat: improve debug message handling with better truncation and formatting 2025-02-21 16:28:08 +08:00
yangdx
2d8a262ac3 Improve entity extraction logging with cleaner summary and verbose debug output
• Add count-based summary log message
• Move detailed data to verbose debug logs
2025-02-21 16:26:56 +08:00
yangdx
8164c57b7e Fix linting 2025-02-21 14:59:50 +08:00
yangdx
5fa6982d36 Merge branch 'refactor-api-server' into clear-text-before-insert 2025-02-21 14:57:11 +08:00
yangdx
cff229a806 fix: respect user-specified log level in set_logger
Previously, the set_logger function would always set the log level to DEBUG, overriding any user-specified log level.
2025-02-21 14:46:27 +08:00
yangdx
f5bd3f2b16 Fix linting 2025-02-21 13:23:55 +08:00
yangdx
bee4622052 fix: handle null bytes (0x00) in text processing
- Fix PostgreSQL encoding error by properly handling null bytes (0x00) in text processing.
- The clean_text function now removes null bytes from all input text during the indexing phase.
2025-02-21 13:18:26 +08:00
yangdx
1749678384 Fix linting 2025-02-21 12:16:04 +08:00
yangdx
043dbad683 Merge remote-tracking branch 'origin/main' into refactor-api-server 2025-02-21 11:24:16 +08:00
Yannick Stephan
b1463185eb Merge pull request #904 from HKUDS/revert-885-remove-unsused
Revert "Cleanup of code"
2025-02-20 15:10:32 +01:00
Yannick Stephan
678e0f9aea Revert "Cleanup of code" 2025-02-20 15:09:43 +01:00
Yannick Stephan
c431cd584a Merge pull request #902 from YanSte/version
Updated version to 1.1.11
2025-02-20 14:33:10 +01:00
Yannick Stephan
3647bc9b11 updated version to 1.1.11 2025-02-20 14:32:24 +01:00
Yannick Stephan
d71bc10e26 Merge pull request #901 from HKUDS/revert-886-clean-2
Revert "removed get_knowledge_graph"
2025-02-20 14:31:00 +01:00
Yannick Stephan
439685e69c Revert "removed get_knowledge_graph" 2025-02-20 14:29:36 +01:00
Yannick Stephan
0d4c580859 Merge pull request #900 from YanSte/cleanup-3
Database Cleanup
2025-02-20 14:22:31 +01:00
Yannick Stephan
c4562f71b9 cleanup extraction 2025-02-20 14:17:26 +01:00
Yannick Stephan
214e3e8ad5 fixed last update 2025-02-20 14:12:19 +01:00
Yannick Stephan
679096bcec Merge pull request #899 from YanSte/cleanup-2
Database Cleanup
2025-02-20 14:06:40 +01:00
Yannick Stephan
3e820cc68e fixed default factory 2025-02-20 14:04:59 +01:00
Yannick Stephan
8413537ad2 cleanup 2025-02-20 13:44:17 +01:00
Yannick Stephan
4923f5c1d7 cleanup kg 2025-02-20 13:39:46 +01:00
Yannick Stephan
1c3a4944d3 Merge pull request #898 from YanSte/update
Database Cleanup
2025-02-20 13:35:37 +01:00
Yannick Stephan
38dc2466da cleanup 2025-02-20 13:34:59 +01:00
Yannick Stephan
60717fd6be cleanup storage state 2025-02-20 13:30:30 +01:00
Yannick Stephan
59bb75d4a1 added log path 2025-02-20 13:27:55 +01:00
Yannick Stephan
c7bc2c63cf cleanup storages 2025-02-20 13:21:41 +01:00
Yannick Stephan
32e489865c cleanup code 2025-02-20 13:18:17 +01:00
Yannick Stephan
72b978d6d5 cleanup 2025-02-20 13:13:38 +01:00
Yannick Stephan
32d0f1acb0 added docs and fields 2025-02-20 13:09:33 +01:00
Yannick Stephan
4b478d1c0f added fields 2025-02-20 13:06:34 +01:00
Yannick Stephan
f5a93c7bb5 added fields 2025-02-20 13:06:16 +01:00
Yannick Stephan
2370a4336b added field 2025-02-20 13:05:59 +01:00
Yannick Stephan
37addb7c01 added final 2025-02-20 13:05:35 +01:00
Yannick Stephan
bae21a6fad added max paralle insert 2025-02-20 12:57:25 +01:00
Yannick Stephan
de56aeb7c5 removed lock 2025-02-20 12:54:52 +01:00
Yannick Stephan
9f2c659d9c remove unused log 2025-02-20 12:54:14 +01:00
Yannick Stephan
cbc5d9da43 Merge pull request #864 from spo0nman/pkaushal/862
Add LlamaIndex LLM implementation module
2025-02-20 11:19:52 +01:00
Pankaj Kaushal
6f09bfc970 Update LlamaIndex README: improve documentation and example paths
- Updated file paths for LlamaIndex examples
- Simplified README structure
- Corrected import statements to reflect new directory layout
- Removed outdated wrapper directory references
2025-02-20 10:33:15 +01:00
Pankaj Kaushal
9934241a1e Update README.md: Refactor LlamaIndex section and example code
- Simplified LlamaIndex documentation in README
- Removed wrapper directory references
- Updated example code to reflect new directory structure
- Cleaned up custom knowledge graph example
- Adjusted file paths and import statements
2025-02-20 10:31:19 +01:00
Pankaj Kaushal
173a806b9a Moved back to llm dir as per
https://github.com/HKUDS/LightRAG/pull/864#issuecomment-2669705946

- Created two new example scripts demonstrating LightRAG integration with LlamaIndex:
  - `lightrag_llamaindex_direct_demo.py`: Direct OpenAI integration
  - `lightrag_llamaindex_litellm_demo.py`: LiteLLM proxy integration
- Both examples showcase different search modes (naive, local, global, hybrid)
- Includes configuration for working directory, models, and API settings
- Demonstrates text insertion and querying using LightRAG with LlamaIndex
- removed wrapper directory and references to it
2025-02-20 10:23:01 +01:00
Pankaj Kaushal
277070e03b Linting and formatting 2025-02-20 10:23:01 +01:00
Pankaj Kaushal
04604841c9 Add logger import 2025-02-20 10:23:01 +01:00
Pankaj Kaushal
203fdf2565 Remove LlamaIndex implementation from llm directory as per @MdNazishArmanShorthillsAI
- Deleted `lightrag/llm/llama_index_impl.py`
- Reorganization of the LlamaIndex wrapper location
2025-02-20 10:23:01 +01:00
Pankaj Kaushal
8a06be9395 Add LlamaIndex Wrapper and Example Implementations
- Updated README.md with new Wrappers section detailing LlamaIndex integration
- Added LlamaIndex wrapper implementation in `lightrag/wrapper/llama_index_impl.py`
- Created two example scripts demonstrating LlamaIndex usage:
  - Direct OpenAI integration
  - LiteLLM proxy integration
- Added wrapper documentation in `lightrag/wrapper/Readme.md`
- Included comprehensive usage examples and configuration details
2025-02-20 10:23:01 +01:00
Pankaj Kaushal
3b25e32e8d Removed verbose module-level documentation 2025-02-20 10:23:01 +01:00
Pankaj Kaushal
0b94117848 Add LlamaIndex LLM implementation module
- Implemented LlamaIndex interface for language model interactions
- Added async chat completion support
- Included embedding generation functionality
- Implemented retry mechanisms for API calls
- Added configuration and message formatting utilities
- Supports OpenAI-style message handling and external settings
2025-02-20 10:23:01 +01:00