Note: Only the `vllm_offline` and `transformers` backends in the `outlines` library support batching.
Note: Only the
vllm_offlineandtransformersbackends in theoutlineslibrary support batching.