Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Use the [~tokenizers.Encoding.sequence_ids] method to
find which part of the offset corresponds to the question and which corresponds to the context.