title: Trigger.Once with Azure Event Hubs
body: <p>I was reading about using Streaming with Trigger.Once instead of batch processing (<a href="https://databricks.com/blog/2017/05/22/running-streaming-jobs-day-10x-cost-savings.html" rel="nofollow noreferrer">https://databricks.com/blog/2017/05/22/running-streaming-jobs-day-10x-cost-savings.html</a>). I'm using Azure Event Hubs as a source, which has a 10.000 items limit per trigger and I have to process a few million events. This will result in processing only 10.000 items and the stream stops when you enable Trigger.Once. Has anyone any idea on how to do this with streaming and Trigger.Once like functionality and stop when the stream is empty or processed up until a set time?</p>