| The original implementation did not include token type embeddings; this implementation adds support for these, with the option controlled by MegaConfig.add_token_type_embeddings | |
| MegaConfig | |
| [[autodoc]] MegaConfig | |
| MegaModel | |
| [[autodoc]] MegaModel | |
| - forward | |
| MegaForCausalLM | |
| [[autodoc]] MegaForCausalLM | |
| - forward | |
| MegaForMaskedLM | |
| [[autodoc]] MegaForMaskedLM | |
| - forward | |
| MegaForSequenceClassification | |
| [[autodoc]] MegaForSequenceClassification | |
| - forward | |
| MegaForMultipleChoice | |
| [[autodoc]] MegaForMultipleChoice | |
| - forward | |
| MegaForTokenClassification | |
| [[autodoc]] MegaForTokenClassification | |
| - forward | |
| MegaForQuestionAnswering | |
| [[autodoc]] MegaForQuestionAnswering | |
| - forward |