gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

refactor(prompt): 优化提示模板以提高相似度评估的准确性- 明确了相似度评分的评判标准，包括不同情况下的评分依据

Browse Source 
- 简化了评分流程，要求直接返回数字
- 期望通过这些改动提高评估的准确性和一致性
This commit is contained in:
Magic_yuan
2024-12-11 12:57:58 +08:00
parent 0a41cc8a9a
commit a09e1ba190
1 changed files with 10 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
lightrag/prompt.py
View File

@@ -268,14 +268,19 @@ PROMPTS[
Question 1: {original_prompt} Question 1: {original_prompt}
Question 2: {cached_prompt} Question 2: {cached_prompt}
Please evaluate: Please evaluate the following two points and provide a similarity score between 0 and 1 directly:
1. Whether these two questions are semantically similar 1. Whether these two questions are semantically similar
2. Whether the answer to Question 2 can be used to answer Question 1 2. Whether the answer to Question 2 can be used to answer Question 1
Similarity score criteria:
Please provide a similarity score between 0 and 1, where: 0: Completely unrelated or answer cannot be reused, including but not limited to:
0: Completely unrelated or answer cannot be reused - The questions have different topics
- The locations mentioned in the questions are different
- The times mentioned in the questions are different
- The specific individuals mentioned in the questions are different
- The specific events mentioned in the questions are different
- The background information in the questions is different
- The key conditions in the questions are different
1: Identical and answer can be directly reused 1: Identical and answer can be directly reused
0.5: Partially related and answer needs modification to be used 0.5: Partially related and answer needs modification to be used
Return only a number between 0-1, without any additional content. Return only a number between 0-1, without any additional content.
""" """