gardel/lightrag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update README.md

Browse Source
This commit is contained in:
LarFii
2024-10-11 15:19:20 +08:00
parent c51b2b38b6
commit 9676a47244
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -250,7 +250,7 @@ def insert_text(rag, file_path):
```
### Step-2 Generate Queries
We extract tokens from both the first half and the second half of each context in the dataset, then combine them to generate queries for dataset descriptions.
We extract tokens from both the first half and the second half of each context in the dataset, then combine them as the dataset description to generate queries.
```python
tokenizer = GPT2Tokenizer.from_pretrained('gpt2')