File size: 686 Bytes
5fa1a76 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
The original implementation did not include token type embeddings; this implementation adds support for these, with the option controlled by MegaConfig.add_token_type_embeddings
MegaConfig
[[autodoc]] MegaConfig
MegaModel
[[autodoc]] MegaModel
- forward
MegaForCausalLM
[[autodoc]] MegaForCausalLM
- forward
MegaForMaskedLM
[[autodoc]] MegaForMaskedLM
- forward
MegaForSequenceClassification
[[autodoc]] MegaForSequenceClassification
- forward
MegaForMultipleChoice
[[autodoc]] MegaForMultipleChoice
- forward
MegaForTokenClassification
[[autodoc]] MegaForTokenClassification
- forward
MegaForQuestionAnswering
[[autodoc]] MegaForQuestionAnswering
- forward |