Take all branches in parallel

In batch inference, if you have remaining resources fill the batches with alternate paths (of reasoning)