Yannick Stephan
b020f5fe2b
Merge pull request #925 from danielaskdd/simplify-cli-arguments
...
Simplify cli arguments
2025-02-23 15:02:58 +01:00
yangdx
2ebab84b72
Fix typo
2025-02-23 19:54:12 +08:00
yangdx
9546be326a
Improve entity extraction logging and metrics
2025-02-23 19:47:43 +08:00
yangdx
bf13bfcab8
Merge branch 'clear-text-before-insert' into simplify-cli-arguments
2025-02-23 18:50:48 +08:00
yangdx
4202ce8d2f
Fix entity_type string formatting(Fix PostgreSQL indexing)
...
- Remove redundant quotes
- Use consistent double quotes
2025-02-23 18:47:10 +08:00
yangdx
4a9cfdcb10
Update storage configurations in .env.example
2025-02-23 17:56:10 +08:00
yangdx
6b446535b8
Merge branch 'main' into simplify-cli-arguments
2025-02-23 17:12:40 +08:00
yangdx
df1eebbbbd
Merge branch 'main' into clear-text-before-insert
2025-02-23 17:11:31 +08:00
yangdx
f5efe5977b
Merge branch 'clear-text-before-insert' into simplify-cli-arguments
2025-02-23 17:06:39 +08:00
yangdx
78e0ca7835
Change defautl timeout for LLM to 150s
2025-02-23 17:03:35 +08:00
yangdx
57884f2fb8
Refine LLM settings in env sample file
2025-02-23 16:52:41 +08:00
yangdx
df95f251dc
Move server ready message to lifespan
2025-02-23 16:42:31 +08:00
yangdx
dbeda8a9ff
Change scanning logs from INFO to DEBUG level
2025-02-23 16:12:08 +08:00
Yannick Stephan
0867e0bd67
Merge pull request #923 from enriquecatala/fix_apipeline_enqueue_documents
...
fix apipeline_enqueue_documents
2025-02-23 09:10:46 +01:00
yangdx
845e914f1b
fix: make ids parameter optional and optimize input text cleaning
...
- Add default None value for ids parameter
- Move text cleaning into else branch
- Only clean text when auto-generating ids
- Preserve original text with custom ids
- Improve code readability
2025-02-23 15:46:47 +08:00
yangdx
460bc3a6aa
update README.md and .env.example
2025-02-23 13:26:38 +08:00
yangdx
637d6756b8
Optimize RAG initialization for openai-ollama
2025-02-23 11:54:36 +08:00
Enrique Catalá
ac58a4b2d0
fix apipeline_enqueue_documents
2025-02-22 19:15:13 +01:00
yangdx
d84b90bcd4
Handle special case of CLI argument openai-ollama
2025-02-22 15:27:19 +08:00
yangdx
e935fed50e
Add automatic comment handling in .env files
2025-02-22 13:25:12 +08:00
yangdx
f9780830ad
Revert: get llm-binding and embedding-binding from cli
2025-02-22 10:46:54 +08:00
yangdx
351c8db849
Fix linting
2025-02-22 10:27:20 +08:00
yangdx
411782797b
Fix linting
2025-02-22 10:18:39 +08:00
yangdx
2fd997ca4f
Merge branch 'clear-text-before-insert' into simplify-cmdline-arguments
2025-02-22 10:07:46 +08:00
yangdx
2fff9ae1ab
Merge branch 'main' into clear-text-before-insert
2025-02-22 10:06:46 +08:00
yangdx
3c866eec16
Merge branch 'refactor-api-server' into clear-text-before-insert
2025-02-22 10:04:56 +08:00
zrguo
ff921b1274
Merge pull request #916 from ShanGor/main
...
Add support to namespace_prefix for postgres_impl
2025-02-21 22:53:06 +08:00
Samuel Chan
60ad8ccf12
Add support to namespace_prefix
2025-02-21 22:48:23 +08:00
zrguo
2e4d51e80d
Update __version__
2025-02-21 21:34:58 +08:00
zrguo
78bc096fac
Merge pull request #914 from ShanGor/main
...
Fix the demo issue of PG to cater with new LightRag changes
2025-02-21 21:34:16 +08:00
zrguo
566a9f9876
fix linting
2025-02-21 21:33:43 +08:00
zrguo
b1a9a55ec8
Merge pull request #880 from danielaskdd/refactor-api-server
...
Refactor api server by split it to smaller files
2025-02-21 21:30:12 +08:00
yangdx
dff07e50a4
Merge branch 'main' into refactor-api-server
2025-02-21 21:12:02 +08:00
yangdx
b144e0c3b0
Sync modifications from main branch
2025-02-21 21:07:37 +08:00
Samuel Chan
25342250d6
Fix the demo issue of PG to cater with new LightRag changes
2025-02-21 20:53:00 +08:00
yangdx
2fdbbc2062
Reorder and improve command line argument definitions for better organization
...
- Change verbose to store_true action
- Move verbose flag to logging section
- Move auto-scan flag to end of options
2025-02-21 20:01:43 +08:00
yangdx
a848884a7b
Remove unnesessary CLI arguments, reduce CLI arguments complexity
...
• Move storage config from CLI
• Move LLM and embedding binding config from CLI
• Remove chunk config from CLI
2025-02-21 19:34:17 +08:00
yangdx
9ba12a4f31
refactor: remove redundant top_k checks in query routes
...
The top_k parameter already has a default value set in the QueryParam class (base.py), making these checks unnecessary. This change simplifies the code while maintaining the same functionality.
Changes:
Remove top_k check in query_text function
Remove top_k check in query_text_stream function
2025-02-21 18:53:43 +08:00
zrguo
6ed81ed1c6
Merge pull request #906 from konrad-woj/fix-insert-custom-chunks
...
fix insert_custom_chunks skipping every new doc
2025-02-21 18:45:40 +08:00
zrguo
84f975f63f
Merge pull request #892 from PiochU19/main
...
add support of providing ids for documents insert
2025-02-21 18:42:52 +08:00
yangdx
e8efcc335d
Add access log filtering to reduce noise from high-frequency API endpoints
2025-02-21 17:53:01 +08:00
zrguo
746cd054ea
Merge pull request #905 from ArnoChenFx/remove-rust
...
Simplify dockerfile and docker-compose files
2025-02-21 17:12:03 +08:00
zrguo
0eac3fd9e0
Merge pull request #897 from ParisNeo/main
...
Added more file types support to the webui
2025-02-21 17:09:54 +08:00
yangdx
c95656ca87
feat: improve debug message handling with better truncation and formatting
2025-02-21 16:28:08 +08:00
yangdx
2d8a262ac3
Improve entity extraction logging with cleaner summary and verbose debug output
...
• Add count-based summary log message
• Move detailed data to verbose debug logs
2025-02-21 16:26:56 +08:00
yangdx
8164c57b7e
Fix linting
2025-02-21 14:59:50 +08:00
yangdx
5fa6982d36
Merge branch 'refactor-api-server' into clear-text-before-insert
2025-02-21 14:57:11 +08:00
yangdx
cff229a806
fix: respect user-specified log level in set_logger
...
Previously, the set_logger function would always set the log level to DEBUG, overriding any user-specified log level.
2025-02-21 14:46:27 +08:00
yangdx
f5bd3f2b16
Fix linting
2025-02-21 13:23:55 +08:00
yangdx
bee4622052
fix: handle null bytes (0x00) in text processing
...
- Fix PostgreSQL encoding error by properly handling null bytes (0x00) in text processing.
- The clean_text function now removes null bytes from all input text during the indexing phase.
2025-02-21 13:18:26 +08:00
