Commit Graph

2006 Commits

Author SHA1 Message Date
yangdx
bee4622052 fix: handle null bytes (0x00) in text processing
- Fix PostgreSQL encoding error by properly handling null bytes (0x00) in text processing.
- The clean_text function now removes null bytes from all input text during the indexing phase.
2025-02-21 13:18:26 +08:00
yangdx
1749678384 Fix linting 2025-02-21 12:16:04 +08:00
yangdx
043dbad683 Merge remote-tracking branch 'origin/main' into refactor-api-server 2025-02-21 11:24:16 +08:00
Yannick Stephan
b1463185eb Merge pull request #904 from HKUDS/revert-885-remove-unsused
Revert "Cleanup of code"
2025-02-20 15:10:32 +01:00
Yannick Stephan
678e0f9aea Revert "Cleanup of code" 2025-02-20 15:09:43 +01:00
Yannick Stephan
c431cd584a Merge pull request #902 from YanSte/version
Updated version to 1.1.11
2025-02-20 14:33:10 +01:00
Yannick Stephan
3647bc9b11 updated version to 1.1.11 2025-02-20 14:32:24 +01:00
Yannick Stephan
d71bc10e26 Merge pull request #901 from HKUDS/revert-886-clean-2
Revert "removed get_knowledge_graph"
2025-02-20 14:31:00 +01:00
Yannick Stephan
439685e69c Revert "removed get_knowledge_graph" 2025-02-20 14:29:36 +01:00
Yannick Stephan
0d4c580859 Merge pull request #900 from YanSte/cleanup-3
Database Cleanup
2025-02-20 14:22:31 +01:00
Yannick Stephan
c4562f71b9 cleanup extraction 2025-02-20 14:17:26 +01:00
Yannick Stephan
214e3e8ad5 fixed last update 2025-02-20 14:12:19 +01:00
Yannick Stephan
679096bcec Merge pull request #899 from YanSte/cleanup-2
Database Cleanup
2025-02-20 14:06:40 +01:00
Yannick Stephan
3e820cc68e fixed default factory 2025-02-20 14:04:59 +01:00
Yannick Stephan
8413537ad2 cleanup 2025-02-20 13:44:17 +01:00
Yannick Stephan
4923f5c1d7 cleanup kg 2025-02-20 13:39:46 +01:00
Yannick Stephan
1c3a4944d3 Merge pull request #898 from YanSte/update
Database Cleanup
2025-02-20 13:35:37 +01:00
Yannick Stephan
38dc2466da cleanup 2025-02-20 13:34:59 +01:00
Yannick Stephan
60717fd6be cleanup storage state 2025-02-20 13:30:30 +01:00
Yannick Stephan
59bb75d4a1 added log path 2025-02-20 13:27:55 +01:00
Yannick Stephan
c7bc2c63cf cleanup storages 2025-02-20 13:21:41 +01:00
Yannick Stephan
32e489865c cleanup code 2025-02-20 13:18:17 +01:00
Yannick Stephan
72b978d6d5 cleanup 2025-02-20 13:13:38 +01:00
Yannick Stephan
32d0f1acb0 added docs and fields 2025-02-20 13:09:33 +01:00
Yannick Stephan
4b478d1c0f added fields 2025-02-20 13:06:34 +01:00
Yannick Stephan
f5a93c7bb5 added fields 2025-02-20 13:06:16 +01:00
Yannick Stephan
2370a4336b added field 2025-02-20 13:05:59 +01:00
Yannick Stephan
37addb7c01 added final 2025-02-20 13:05:35 +01:00
Yannick Stephan
bae21a6fad added max paralle insert 2025-02-20 12:57:25 +01:00
Yannick Stephan
de56aeb7c5 removed lock 2025-02-20 12:54:52 +01:00
Yannick Stephan
9f2c659d9c remove unused log 2025-02-20 12:54:14 +01:00
Yannick Stephan
cbc5d9da43 Merge pull request #864 from spo0nman/pkaushal/862
Add LlamaIndex LLM implementation module
2025-02-20 11:19:52 +01:00
Pankaj Kaushal
6f09bfc970 Update LlamaIndex README: improve documentation and example paths
- Updated file paths for LlamaIndex examples
- Simplified README structure
- Corrected import statements to reflect new directory layout
- Removed outdated wrapper directory references
2025-02-20 10:33:15 +01:00
Pankaj Kaushal
9934241a1e Update README.md: Refactor LlamaIndex section and example code
- Simplified LlamaIndex documentation in README
- Removed wrapper directory references
- Updated example code to reflect new directory structure
- Cleaned up custom knowledge graph example
- Adjusted file paths and import statements
2025-02-20 10:31:19 +01:00
Pankaj Kaushal
173a806b9a Moved back to llm dir as per
https://github.com/HKUDS/LightRAG/pull/864#issuecomment-2669705946

- Created two new example scripts demonstrating LightRAG integration with LlamaIndex:
  - `lightrag_llamaindex_direct_demo.py`: Direct OpenAI integration
  - `lightrag_llamaindex_litellm_demo.py`: LiteLLM proxy integration
- Both examples showcase different search modes (naive, local, global, hybrid)
- Includes configuration for working directory, models, and API settings
- Demonstrates text insertion and querying using LightRAG with LlamaIndex
- removed wrapper directory and references to it
2025-02-20 10:23:01 +01:00
Pankaj Kaushal
277070e03b Linting and formatting 2025-02-20 10:23:01 +01:00
Pankaj Kaushal
04604841c9 Add logger import 2025-02-20 10:23:01 +01:00
Pankaj Kaushal
203fdf2565 Remove LlamaIndex implementation from llm directory as per @MdNazishArmanShorthillsAI
- Deleted `lightrag/llm/llama_index_impl.py`
- Reorganization of the LlamaIndex wrapper location
2025-02-20 10:23:01 +01:00
Pankaj Kaushal
8a06be9395 Add LlamaIndex Wrapper and Example Implementations
- Updated README.md with new Wrappers section detailing LlamaIndex integration
- Added LlamaIndex wrapper implementation in `lightrag/wrapper/llama_index_impl.py`
- Created two example scripts demonstrating LlamaIndex usage:
  - Direct OpenAI integration
  - LiteLLM proxy integration
- Added wrapper documentation in `lightrag/wrapper/Readme.md`
- Included comprehensive usage examples and configuration details
2025-02-20 10:23:01 +01:00
Pankaj Kaushal
3b25e32e8d Removed verbose module-level documentation 2025-02-20 10:23:01 +01:00
Pankaj Kaushal
0b94117848 Add LlamaIndex LLM implementation module
- Implemented LlamaIndex interface for language model interactions
- Added async chat completion support
- Included embedding generation functionality
- Implemented retry mechanisms for API calls
- Added configuration and message formatting utilities
- Supports OpenAI-style message handling and external settings
2025-02-20 10:23:01 +01:00
yangdx
f52b9929bb fix: add missing rag parameter in pipeline_enqueue_file call
• Add rag param to function call
• Fix argument mismatch error
• Ensure proper pipeline execution
2025-02-20 14:48:54 +08:00
zrguo
fbe7e9994d revert 2025-02-20 14:44:06 +08:00
zrguo
c8eaa45024 add Chinese template 2025-02-20 14:42:13 +08:00
yangdx
82a4cb3e79 Fix refactoring error on document handling
- Fix refactoring error on pipeline_index_file
- Delete unsed func: scan_directory
- Add type hints of rag for better maintainability
- Refine comments for better understanding
2025-02-20 14:30:41 +08:00
yangdx
62e1fe5df2 Change Ollama API router tag to lowercase 2025-02-20 14:23:33 +08:00
yangdx
57cdab2b2b Add tags to OllamaAPI router 2025-02-20 12:33:43 +08:00
yangdx
5d884f6d3e refactor: centralize configuration and utility functions
- Move parse_args and display_splash_screen functions from lightrag_server.py to utils_api.py
- Move OllamaServerInfos class and instance from ollama_api.py to utils_api.py
2025-02-20 12:12:20 +08:00
Yannick Stephan
26abae4733 Merge pull request #891 from YanSte/lock
added lock
2025-02-20 00:21:28 +01:00
Yannick Stephan
fa99d72269 added lock 2025-02-20 00:20:30 +01:00