gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

cleaned docs

Browse Source
This commit is contained in:
Yannick Stephan
2025-02-09 14:39:32 +01:00
parent abcdcd5a73
commit 58d776561d
1 changed files with 6 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
lightrag/lightrag.py
View File

@@ -467,16 +467,14 @@ class LightRAG:
await self._insert_done() await self._insert_done()
async def apipeline_enqueue_documents(self, string_or_strings: str | list[str]): async def apipeline_enqueue_documents(self, string_or_strings: str | list[str]):
"""Pipeline process documents """
Pipeline for Processing Documents
1. Remove duplicate contents from the list 1. Remove duplicate contents from the list
2. Generate document IDs and initial status 2. Generate document IDs and initial status
3. Filter out already stored documents 3. Filter out already processed documents
4. Store docs 4. Enqueue document in status
"""
Args:
string_or_strings: Single document string or list of document strings
"""
if isinstance(string_or_strings, str): if isinstance(string_or_strings, str):
string_or_strings = [string_or_strings] string_or_strings = [string_or_strings]