Commit
·
ff752fe
1
Parent(s):
f2c0c68
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# mGPT-nsp
|
2 |
|
3 |
mGPT-nsp is fine-tuned for Next Sentence Prediction task on the [wikipedia dataset](https://huggingface.co/datasets/wikipedia) using [multilingual GPT](https://huggingface.co/THUMT/mGPT) model. It was introduced in this [paper](https://arxiv.org/abs/2307.07331) and first released on this page.
|
@@ -60,4 +77,4 @@ print(torch.argmax(outputs, dim=-1))
|
|
60 |
}
|
61 |
```
|
62 |
|
63 |
-
The work is done with Ludwig-Maximilians-Universität Statistics group, don't forget to check out [their huggingface page](https://huggingface.co/misoda) for other interesting works!
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
- de
|
5 |
+
- fr
|
6 |
+
- es
|
7 |
+
- tr
|
8 |
+
tags:
|
9 |
+
- nsp
|
10 |
+
- next-sentence-prediction
|
11 |
+
- gpt
|
12 |
+
datasets:
|
13 |
+
- wikipedia
|
14 |
+
metrics:
|
15 |
+
- accuracy
|
16 |
+
---
|
17 |
+
|
18 |
# mGPT-nsp
|
19 |
|
20 |
mGPT-nsp is fine-tuned for Next Sentence Prediction task on the [wikipedia dataset](https://huggingface.co/datasets/wikipedia) using [multilingual GPT](https://huggingface.co/THUMT/mGPT) model. It was introduced in this [paper](https://arxiv.org/abs/2307.07331) and first released on this page.
|
|
|
77 |
}
|
78 |
```
|
79 |
|
80 |
+
The work is done with Ludwig-Maximilians-Universität Statistics group, don't forget to check out [their huggingface page](https://huggingface.co/misoda) for other interesting works!
|