However, AWQ has the largest forward latency per batch size.