yangdx
362321204f
Merge branch 'main' into add-multi-worker-support
2025-02-25 11:15:12 +08:00
yangdx
087d5770b0
feat(storage): Add shared memory support for file-based storage implementations
...
This commit adds multiprocessing shared memory support to file-based storage implementations:
- JsonDocStatusStorage
- JsonKVStorage
- NanoVectorDBStorage
- NetworkXStorage
Each storage module now uses module-level global variables with multiprocessing.Manager() to ensure data consistency across multiple uvicorn workers. All processes will see
updates immediately when data is modified through ainsert function.
2025-02-25 11:10:13 +08:00
yangdx
7262f61b0e
add redis configuration and update workers default value
2025-02-25 10:47:27 +08:00
yangdx
04fc5ce604
Remove unspported endpoint from splash mesages
2025-02-25 09:45:14 +08:00
yangdx
ddc366b672
Optimize display_splash_screen function
...
- Merge System Configuration into Server Configuration section
- Add Workers parameter display after Port parameter
2025-02-25 09:44:17 +08:00
yangdx
d74a23d2cc
Add multiple workers support for API Server
2025-02-25 09:37:00 +08:00
yangdx
2e13def95c
Remove unused global_top_k variable and related configurations.
2025-02-24 18:20:39 +08:00
zrguo
8e86e6523d
Merge pull request #931 from konrad-woj/fix-dim-error
...
fix AttributeError: 'NoneType' object has no attribute 'dim'
2025-02-24 17:52:45 +08:00
zrguo
c79ab5bb35
Merge pull request #928 from danielaskdd/impl-get-kg-grap
...
Implement Knowledge Graph API for NetworkX Storage
2025-02-24 17:29:47 +08:00
Konrad Wojciechowski
4f76b1c23e
fix AttributeError: 'NoneType' object has no attribute 'dim'
2025-02-24 10:28:15 +01:00
yangdx
9fd0ab185f
Removed unnecessary comment
2025-02-24 16:28:18 +08:00
yangdx
b8543b8701
Remove unnecessary comment in networkx_impl.py
2025-02-24 09:55:03 +08:00
yangdx
9dd18ccd89
Simplify log message
2025-02-24 03:52:43 +08:00
yangdx
03326ff2f7
Merge branch 'main' into impl-get-kg-grap
2025-02-24 03:36:17 +08:00
yangdx
facf7c11fe
Reduce knowledge graph max_depth from 100 to 3
2025-02-24 03:34:44 +08:00
yangdx
6cf555ebd5
Fix linting
2025-02-24 03:33:22 +08:00
yangdx
b4543561f6
Limit subgraph size to 500 nodes in NetworkXStorage
...
- Add max_graph_nodes check
- Reduce subgraph by degree
- Log graph size reduction
2025-02-24 03:32:33 +08:00
yangdx
b13c947360
Implement get_all_labels and get_knowledge_graph methods in NetworkXStorage
2025-02-24 02:37:42 +08:00
yangdx
f29628125b
Fix typo in parameter name from 'nodel_label' to 'node_label'
2025-02-24 02:36:36 +08:00
Yannick Stephan
b020f5fe2b
Merge pull request #925 from danielaskdd/simplify-cli-arguments
...
Simplify cli arguments
2025-02-23 15:02:58 +01:00
yangdx
2ebab84b72
Fix typo
2025-02-23 19:54:12 +08:00
yangdx
9546be326a
Improve entity extraction logging and metrics
2025-02-23 19:47:43 +08:00
yangdx
bf13bfcab8
Merge branch 'clear-text-before-insert' into simplify-cli-arguments
2025-02-23 18:50:48 +08:00
yangdx
4202ce8d2f
Fix entity_type string formatting(Fix PostgreSQL indexing)
...
- Remove redundant quotes
- Use consistent double quotes
2025-02-23 18:47:10 +08:00
yangdx
4a9cfdcb10
Update storage configurations in .env.example
2025-02-23 17:56:10 +08:00
yangdx
6b446535b8
Merge branch 'main' into simplify-cli-arguments
2025-02-23 17:12:40 +08:00
yangdx
df1eebbbbd
Merge branch 'main' into clear-text-before-insert
2025-02-23 17:11:31 +08:00
yangdx
f5efe5977b
Merge branch 'clear-text-before-insert' into simplify-cli-arguments
2025-02-23 17:06:39 +08:00
yangdx
78e0ca7835
Change defautl timeout for LLM to 150s
2025-02-23 17:03:35 +08:00
yangdx
57884f2fb8
Refine LLM settings in env sample file
2025-02-23 16:52:41 +08:00
yangdx
df95f251dc
Move server ready message to lifespan
2025-02-23 16:42:31 +08:00
yangdx
dbeda8a9ff
Change scanning logs from INFO to DEBUG level
2025-02-23 16:12:08 +08:00
Yannick Stephan
0867e0bd67
Merge pull request #923 from enriquecatala/fix_apipeline_enqueue_documents
...
fix apipeline_enqueue_documents
2025-02-23 09:10:46 +01:00
yangdx
845e914f1b
fix: make ids parameter optional and optimize input text cleaning
...
- Add default None value for ids parameter
- Move text cleaning into else branch
- Only clean text when auto-generating ids
- Preserve original text with custom ids
- Improve code readability
2025-02-23 15:46:47 +08:00
yangdx
460bc3a6aa
update README.md and .env.example
2025-02-23 13:26:38 +08:00
yangdx
637d6756b8
Optimize RAG initialization for openai-ollama
2025-02-23 11:54:36 +08:00
Enrique Catalá
ac58a4b2d0
fix apipeline_enqueue_documents
2025-02-22 19:15:13 +01:00
yangdx
d84b90bcd4
Handle special case of CLI argument openai-ollama
2025-02-22 15:27:19 +08:00
yangdx
e935fed50e
Add automatic comment handling in .env files
2025-02-22 13:25:12 +08:00
yangdx
f9780830ad
Revert: get llm-binding and embedding-binding from cli
2025-02-22 10:46:54 +08:00
yangdx
351c8db849
Fix linting
2025-02-22 10:27:20 +08:00
yangdx
411782797b
Fix linting
2025-02-22 10:18:39 +08:00
yangdx
2fd997ca4f
Merge branch 'clear-text-before-insert' into simplify-cmdline-arguments
2025-02-22 10:07:46 +08:00
yangdx
2fff9ae1ab
Merge branch 'main' into clear-text-before-insert
2025-02-22 10:06:46 +08:00
yangdx
3c866eec16
Merge branch 'refactor-api-server' into clear-text-before-insert
2025-02-22 10:04:56 +08:00
zrguo
ff921b1274
Merge pull request #916 from ShanGor/main
...
Add support to namespace_prefix for postgres_impl
2025-02-21 22:53:06 +08:00
Samuel Chan
60ad8ccf12
Add support to namespace_prefix
2025-02-21 22:48:23 +08:00
zrguo
2e4d51e80d
Update __version__
2025-02-21 21:34:58 +08:00
zrguo
78bc096fac
Merge pull request #914 from ShanGor/main
...
Fix the demo issue of PG to cater with new LightRag changes
2025-02-21 21:34:16 +08:00
zrguo
566a9f9876
fix linting
2025-02-21 21:33:43 +08:00
