Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
In other words, the vocabulary size of ImageGPT is 512, + 1 for a special "start of sentence" (SOS)
token, used at the beginning of every sequence.