Prompts with large number of tokens can increase computation and latency.