File size: 350 Bytes
5fa1a76 |
1 2 3 4 |
input_ids = torch.tensor([input_ids[:8] + [258] + input_ids[14:21] + [257] + input_ids[28:]]) input_ids tensor([[ 87, 107, 104, 35, 103, 114, 106, 35, 258, 35, 100, 35, 101, 100, 111, 111, 257, 35, 115, 100, 117, 110, 49, 1]]) ByT5 produces only one char at a time so we need to produce many more output characters here -> set max_length=100. |