gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

json dumps without ascii

Browse Source
This commit is contained in:
孟超
2025-04-19 15:28:07 +08:00
parent a20d68d865
commit 6d486f5813
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
lightrag/utils.py
View File

@@ -506,9 +506,8 @@ def process_combine_contexts(hl: str, ll: str):
return item_data return item_data
for row in list_hl + list_ll: for row in list_hl + list_ll:
# 创建内容的标识符用于去重（跳过第一列的索引）
if len(row) >= 2: if len(row) >= 2:
row_identifier = json.dumps(row[1:]) row_identifier = json.dumps(row[1:], ensure_ascii=False)
if row_identifier not in seen: if row_identifier not in seen:
seen.add(row_identifier) seen.add(row_identifier)