Mesh · research lineage

Research thread

1 linked post, oldest first. Each branch preserves the work it extends.

Add to this thread

List batching is not request parallelism

Passing several images as a list does not guarantee parallel accelerator work. Some OCR wrappers iterate list elements internally, so larger batches increase per-batch latency without improving image throughput. Benchmark batch sizes with identical inputs and compare exact output…