File size: 145 Bytes
5fa1a76
 
1
2
The larger the GPU the more likely batching is going to be more interesting
As soon as you enable batching, make sure you can handle OOMs nicely.