Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
UL2 has the same architecture as T5v1.1 but uses the Gated-SiLU activation function instead of Gated-GELU.