title: Standard protocol for multiplexing HTTP (for multiple requests)
body: <p>We have a web service that currently responds to around 3 million HTTP requests per second. Each back end server is capable of serving around 5 million requests. So the bottle-neck is the HTTP front ends.</p>
  
  <p>So the problem is reversed to that of a load balancer situation. We have solved the problem by letting many front end servers aggregate incoming requests for around 1 millisecond. Once a full millisecond is reached for a particular front end server, we send all the batched up requests (around 100) to the back end server using an existing single socket connection.</p>
  
  <p>This means that our back end servers gets requests containing a hundred original HTTP requests and answers with a response containing a hundred requests.</p>
  
  <p>Is there a standard protocol to multiplex/batch/aggregate HTTP requests? The multiplexing in HTTP2 seams to be focused on multiple responses to a single request.</p>