<p>There are some benchmarks for Stream Processing in general - but they are not always broadly applicable or accessible than the ones you can find for RDBMS.</p>
<p>I will try here to list some benchmarking works, that helped me:</p>
<ul>
<li><p>A recent benchmarking framework that is implemented for Storm &amp; Flink is the <a href="https://github.com/yahoo/streaming-benchmarks" rel="nofollow noreferrer">Yahoo Streaming Benchmark</a>. It has a fixed internal architecture using Kafka &amp; Redis and a predefined query/topology. Anyways, it is a good starting point.</p>
</li>
<li><p><a href="https://arxiv.org/abs/1802.08496" rel="nofollow noreferrer">Karimov et al</a> have a nice paper regarding benchmarking of these systems. It is worth a read since it really helps to understand possible metrics. Unfortunately, I can not find any implementation or further information on their workload (data and queries) that they use - so it is more helpful for understanding, I would say.</p>
</li>
<li><p><a href="https://www.researchgate.net/publication/339731660_Evaluation_of_Stream_Processing_Frameworks" rel="nofollow noreferrer">van Dongen et al</a> are doing a more in-depth analysis of several stream processing systems and offer their source code at github. Unfortunately, there is no implementation for Storm. But anyways, there are some interesting ideas &amp; contributions on how to build such a framework.</p>
</li>
</ul>
<p>As you see, Stream Processing has a high diversity in the way you can set-up and benchmark your systems...</p>
Apache Flink vs Apache storm benchmark
<p>Is there any real benchmarks between Apache Flink and apache storm in real time processing based on performance comparison ?</p>
<p>Also if I want to make this performance comparison and implement it by myself, is there any stream API (like twitter API) that offers high throughput than twitter and which is open source ?</p>
<p>Thank you !</p>