Using the past_key_values value prevents the model from re-computing | |
pre-computed values in the context of text generation. |
Using the past_key_values value prevents the model from re-computing | |
pre-computed values in the context of text generation. |