gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update README.md

Browse Source
This commit is contained in:
LarFii
2024-10-11 15:19:20 +08:00
parent 6713017df9
commit de9ff79a29
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -250,7 +250,7 @@ def insert_text(rag, file_path):
``` ```
### Step-2 Generate Queries ### Step-2 Generate Queries
We extract tokens from both the first half and the second half of each context in the dataset, then combine them to generate queries for dataset descriptions. We extract tokens from both the first half and the second half of each context in the dataset, then combine them as the dataset description to generate queries.
```python ```python
tokenizer = GPT2Tokenizer.from_pretrained('gpt2') tokenizer = GPT2Tokenizer.from_pretrained('gpt2')