gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
385 Commits 2 Branches 0 Tags
9fef519caf41c2d97395714a859fddf228c21f2b
Commit Graph

174 Commits

Author SHA1 Message Date
zrguo
0a8d88212a Merge pull request #423 from davidleon/feature/jina_embedding 
add jina embedding
 2024-12-09 10:18:50 +08:00
david
97d1894077 add jina embedding 2024-12-08 22:20:41 +08:00
Magic_yuan
779ed604d8 清理多余注释 2024-12-08 17:38:49 +08:00
Magic_yuan
39c2cb11f3 清理多余注释 2024-12-08 17:37:58 +08:00
Magic_yuan
ccf44dc334 feat(cache): 增加 LLM 相似性检查功能并优化缓存机制 
- 在 embedding 缓存配置中添加 use_llm_check 参数
- 实现 LLM 相似性检查逻辑，作为缓存命中的二次验证- 优化 naive 模式的缓存处理流程
- 调整缓存数据结构，移除不必要的 model 字段
 2024-12-08 17:35:52 +08:00
Magic_yuan
dc2a45004a 缓存计算函数迁移到工具类 2024-12-08 10:37:55 +08:00
magicyuan876
4da7dd1865 移除kwargs中的hashing_kv参数取为变量 2024-12-06 15:35:09 +08:00
magicyuan876
efdd4b8b8e 移除kwargs中的hashing_kv参数取为变量 2024-12-06 15:23:18 +08:00
magicyuan876
8d9fc01b4c 解决冲突 2024-12-06 15:09:50 +08:00
magicyuan876
8924d2b8fc Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	lightrag/llm.py
#	lightrag/operate.py
 2024-12-06 15:06:00 +08:00
magicyuan876
786aa92b48 fix(utils): 修复 JSON 日志编码问题 
- 在 json.dumps 中添加 ensure_ascii=False 参数，以支持非 ASCII 字符编码
-这个修改确保了包含中文等非 ASCII 字符的日志信息能够正确处理和显示
 2024-12-06 14:32:41 +08:00
magicyuan876
e619b09c8a 重构缓存处理逻辑 
- 提取通用缓存处理逻辑到新函数 handle_cache 和 save_to_cache
- 使用 CacheData 类统一缓存数据结构
- 优化嵌入式缓存和常规缓存的处理流程
- 添加模式参数以支持不同查询模式的缓存策略
- 重构 get_best_cached_response 函数，提高缓存查询效率
 2024-12-06 14:29:16 +08:00
zrguo
f2a208c343 Merge branch 'main' into main 2024-12-06 11:38:27 +08:00
Suroy
979f30d20b Update oracle_impl.py 
Fixed typing error in python3.9
 2024-12-06 11:06:20 +08:00
magicyuan876
5dfb74ef2d 修复 args_hash在使用常规缓存时候才计算导致embedding缓存时没有计算的bug 2024-12-06 10:40:48 +08:00
magicyuan876
6c29a37f20 修复 args_hash在使用常规缓存时候才计算导致embedding缓存时没有计算的bug 2024-12-06 10:28:35 +08:00
magicyuan876
6540d11096 修复 args_hash在使用常规缓存时候才计算导致embedding缓存时没有计算的bug 2024-12-06 10:21:53 +08:00
partoneplay
e82d13e182 Add support for Ollama streaming output and integrate Open-WebUI as the chat UI demo 2024-12-06 10:13:16 +08:00
magicyuan876
2ecdab2f18 整理了一下手误的注释 2024-12-06 09:11:22 +08:00
magicyuan876
d48c6e4588 feat(lightrag): 添加 查询时使用embedding缓存功能 
- 在 LightRAG 类中添加 embedding_cache_config配置项
- 实现基于 embedding 相似度的缓存查询和存储
- 添加量化和反量化函数，用于压缩 embedding 数据
- 新增示例演示 embedding 缓存的使用
 2024-12-06 08:17:20 +08:00
Larfii
645890aff6 Fix JSON parsing error 2024-12-05 20:40:35 +08:00
Larfii
1e4e2ea4f3 Fix JSON parsing error 2024-12-05 20:22:44 +08:00
Larfii
9af3676991 Fix JSON parsing error 2024-12-05 18:26:55 +08:00
Larfii
567fde643f Update version 2024-12-05 18:22:50 +08:00
zrguo
59812f2ede Merge pull request #399 from partoneplay/main 
Add MongoDB as KV storage
 2024-12-05 18:21:50 +08:00
Larfii
254330813a fix JSON parsing error 2024-12-05 18:13:12 +08:00
partoneplay
d8ba7c57f3 Add MongoDB as KV storage 2024-12-05 13:57:43 +08:00
zrguo
6d274019dd Merge pull request #393 from partoneplay/main 
Add Milvus as vector storage
 2024-12-05 12:05:30 +08:00
Larfii
a2072a055a fix: unexpected keyword argument error 2024-12-05 11:47:56 +08:00
partoneplay
052322b213 Add Milvus as vector storage 2024-12-05 08:48:41 +08:00
LarFii
44d441a951 update insert custom kg 2024-12-04 19:44:04 +08:00
LarFii
be72c825d2 fix entity extract 2024-12-04 16:01:19 +08:00
zrguo
3e69b326ec Merge pull request #383 from MRX760/main 
added nvidia text-embedding API and example of using nvidia API llm a…
 2024-12-04 11:21:46 +08:00
zrguo
7b413cb4b5 Merge pull request #384 from Ecocytus/main 
fix examples' prompt bug
 2024-12-04 11:17:07 +08:00
zrguo
6927b57520 Merge pull request #378 from doosenn/main 
fix neo4jstorage bug
 2024-12-04 11:11:19 +08:00
zrguo
96962cd243 Merge pull request #375 from partoneplay/main 
Ollama `embedding` deprecated in favor of `embed`
 2024-12-04 11:09:44 +08:00
magicyuan876
607d4f9555 修改日志文件路径 
- 因为LightRAG的几乎都是导入的utils中的全局logger对象，当多个rag实例的时候并无法完全把日志记录到对应的working_dir,并且应用中删除working_dir时会由于logger的句柄无法删除
- 此修改简化了日志文件的路径，不再依赖于 working_dir 属性，日志文件独立于working_dir
 2024-12-04 08:44:13 +08:00
Yizhi Zhang
3a6645b78d fix bug of example prompt 2024-12-03 22:25:50 +08:00
MRX760
5f13ce1ce9 added nvidia text-embedding API and example of using nvidia API llm and text-embedding 2024-12-03 17:15:10 +07:00
zuoluo
801619084f fix neo4jstorage bug 2024-12-03 16:04:58 +08:00
partoneplay
bc2b8c592e embedding deprecated in favor of embed 2024-12-03 08:42:36 +08:00
zrguo
174af3742a Merge pull request #368 from AdityaKalraShorthillsAI/main 
Added embedding_func argument in Neo4JStorage class's __init__ method in neo4j implementation
 2024-12-02 16:02:53 +08:00
zrguo
e8b5498699 Merge pull request #360 from ahmadhatahet/azure_openai_embedding 
Azure OpenAI Embedding
 2024-12-02 16:02:13 +08:00
zrguo
3e4def137b Merge pull request #354 from TashaSkyUp/patch-1 
fix for #209
 2024-12-02 15:53:08 +08:00
AdityaKalraShorthillsAI
7734b81911 Added embedding_func argument in Neo4JStorage class's __init__ method in neo4j implementation 2024-12-02 02:44:47 +05:30
b10902118
085032640c fix with ruff (unused import) 2024-12-01 16:09:24 +08:00
Ahmad Hatahet
f281414308 add api_version to azure_openai_complete_if_cache 2024-11-30 17:47:33 +01:00
Ahmad Hatahet
23cabbe7a3 update max_token_size according to openai doc 2024-11-30 17:16:07 +01:00
Ahmad Hatahet
7fea7d7b5e add api_version to args 2024-11-30 17:11:38 +01:00
Tasha Upchurch
eae310cd68 fix for #209 
function was returning a closed event loop.
 2024-11-29 13:27:08 -07:00