Commit Graph

2207 Commits

Author SHA1 Message Date
yangdx
637d6756b8 Optimize RAG initialization for openai-ollama 2025-02-23 11:54:36 +08:00
Enrique Catalá
ac58a4b2d0 fix apipeline_enqueue_documents 2025-02-22 19:15:13 +01:00
yangdx
d84b90bcd4 Handle special case of CLI argument openai-ollama 2025-02-22 15:27:19 +08:00
yangdx
e935fed50e Add automatic comment handling in .env files 2025-02-22 13:25:12 +08:00
yangdx
f9780830ad Revert: get llm-binding and embedding-binding from cli 2025-02-22 10:46:54 +08:00
yangdx
351c8db849 Fix linting 2025-02-22 10:27:20 +08:00
yangdx
411782797b Fix linting 2025-02-22 10:18:39 +08:00
yangdx
2fd997ca4f Merge branch 'clear-text-before-insert' into simplify-cmdline-arguments 2025-02-22 10:07:46 +08:00
yangdx
2fff9ae1ab Merge branch 'main' into clear-text-before-insert 2025-02-22 10:06:46 +08:00
yangdx
3c866eec16 Merge branch 'refactor-api-server' into clear-text-before-insert 2025-02-22 10:04:56 +08:00
zrguo
ff921b1274 Merge pull request #916 from ShanGor/main
Add support to namespace_prefix for postgres_impl
2025-02-21 22:53:06 +08:00
Samuel Chan
60ad8ccf12 Add support to namespace_prefix 2025-02-21 22:48:23 +08:00
zrguo
2e4d51e80d Update __version__ 2025-02-21 21:34:58 +08:00
zrguo
78bc096fac Merge pull request #914 from ShanGor/main
Fix the demo issue of PG to cater with new LightRag changes
2025-02-21 21:34:16 +08:00
zrguo
566a9f9876 fix linting 2025-02-21 21:33:43 +08:00
zrguo
b1a9a55ec8 Merge pull request #880 from danielaskdd/refactor-api-server
Refactor api server by split it to smaller files
2025-02-21 21:30:12 +08:00
yangdx
dff07e50a4 Merge branch 'main' into refactor-api-server 2025-02-21 21:12:02 +08:00
yangdx
b144e0c3b0 Sync modifications from main branch 2025-02-21 21:07:37 +08:00
Samuel Chan
25342250d6 Fix the demo issue of PG to cater with new LightRag changes 2025-02-21 20:53:00 +08:00
yangdx
2fdbbc2062 Reorder and improve command line argument definitions for better organization
- Change verbose to store_true action
- Move verbose flag to logging section
- Move auto-scan flag to end of options
2025-02-21 20:01:43 +08:00
yangdx
a848884a7b Remove unnesessary CLI arguments, reduce CLI arguments complexity
• Move storage config from CLI
• Move LLM and embedding binding config from CLI
• Remove chunk config from CLI
2025-02-21 19:34:17 +08:00
yangdx
9ba12a4f31 refactor: remove redundant top_k checks in query routes
The top_k parameter already has a default value set in the QueryParam class (base.py), making these checks unnecessary. This change simplifies the code while maintaining the same functionality.

Changes:

Remove top_k check in query_text function
Remove top_k check in query_text_stream function
2025-02-21 18:53:43 +08:00
zrguo
6ed81ed1c6 Merge pull request #906 from konrad-woj/fix-insert-custom-chunks
fix insert_custom_chunks skipping every new doc
2025-02-21 18:45:40 +08:00
zrguo
84f975f63f Merge pull request #892 from PiochU19/main
add support of providing ids for documents insert
2025-02-21 18:42:52 +08:00
yangdx
e8efcc335d Add access log filtering to reduce noise from high-frequency API endpoints 2025-02-21 17:53:01 +08:00
zrguo
746cd054ea Merge pull request #905 from ArnoChenFx/remove-rust
Simplify dockerfile and docker-compose files
2025-02-21 17:12:03 +08:00
zrguo
0eac3fd9e0 Merge pull request #897 from ParisNeo/main
Added more file types support to the webui
2025-02-21 17:09:54 +08:00
yangdx
c95656ca87 feat: improve debug message handling with better truncation and formatting 2025-02-21 16:28:08 +08:00
yangdx
2d8a262ac3 Improve entity extraction logging with cleaner summary and verbose debug output
• Add count-based summary log message
• Move detailed data to verbose debug logs
2025-02-21 16:26:56 +08:00
yangdx
8164c57b7e Fix linting 2025-02-21 14:59:50 +08:00
yangdx
5fa6982d36 Merge branch 'refactor-api-server' into clear-text-before-insert 2025-02-21 14:57:11 +08:00
yangdx
cff229a806 fix: respect user-specified log level in set_logger
Previously, the set_logger function would always set the log level to DEBUG, overriding any user-specified log level.
2025-02-21 14:46:27 +08:00
yangdx
f5bd3f2b16 Fix linting 2025-02-21 13:23:55 +08:00
yangdx
bee4622052 fix: handle null bytes (0x00) in text processing
- Fix PostgreSQL encoding error by properly handling null bytes (0x00) in text processing.
- The clean_text function now removes null bytes from all input text during the indexing phase.
2025-02-21 13:18:26 +08:00
yangdx
1749678384 Fix linting 2025-02-21 12:16:04 +08:00
yangdx
043dbad683 Merge remote-tracking branch 'origin/main' into refactor-api-server 2025-02-21 11:24:16 +08:00
Konrad Wojciechowski
50eb97762a fix insert_custom_chunks skipping every new doc with "This document is already in the storage." 2025-02-20 23:08:36 +01:00
Saifeddine ALOUI
ed9dc799b0 Merge branch 'HKUDS:main' into main 2025-02-20 18:15:55 +01:00
ArnoChen
9aba7d7d48 simplify dockerfile and docker-compose files 2025-02-20 22:18:42 +08:00
Yannick Stephan
fa2884841f Merge branch 'HKUDS:main' into main 2025-02-20 15:10:55 +01:00
Yannick Stephan
b1463185eb Merge pull request #904 from HKUDS/revert-885-remove-unsused
Revert "Cleanup of code"
2025-02-20 15:10:32 +01:00
Yannick Stephan
678e0f9aea Revert "Cleanup of code" 2025-02-20 15:09:43 +01:00
Yannick Stephan
db5159fc24 added missing type 2025-02-20 14:47:31 +01:00
Yannick Stephan
c431cd584a Merge pull request #902 from YanSte/version
Updated version to 1.1.11
2025-02-20 14:33:10 +01:00
Yannick Stephan
3647bc9b11 updated version to 1.1.11 2025-02-20 14:32:24 +01:00
Yannick Stephan
d71bc10e26 Merge pull request #901 from HKUDS/revert-886-clean-2
Revert "removed get_knowledge_graph"
2025-02-20 14:31:00 +01:00
Yannick Stephan
439685e69c Revert "removed get_knowledge_graph" 2025-02-20 14:29:36 +01:00
Yannick Stephan
0d4c580859 Merge pull request #900 from YanSte/cleanup-3
Database Cleanup
2025-02-20 14:22:31 +01:00
Yannick Stephan
c4562f71b9 cleanup extraction 2025-02-20 14:17:26 +01:00
Yannick Stephan
214e3e8ad5 fixed last update 2025-02-20 14:12:19 +01:00