Micro Batching
http://tutorials.jenkov.com/java-perf...
Micro batching is a technique where multiple incoming tasks are grouped into small batches when executed. Micro batching increases throughput of a system without decreasing latency too much, as long as the batch sizes and batch cycles are small. Having a variable batch cycle can enable a system to adapt the batch size to the incoming work load.
