title: Only Two Applications ever running for Synapse Notebooks in For Each activity
body: <p>I am running a Synapse Notebook in a For Each activity in a Synapse Pipeline.  The notebook loads some data from the datalake into the database and some custom processing (which is why we're using a Notebook):</p>
  <p><a href="https://i.stack.imgur.com/5lVzjm.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/5lVzjm.png" alt="enter image description here" /></a></p>
  <p>No matter what configuration of Spark pools I use: small, medium, large, auto-scale, not auto-scale, dynamic allocators, number of nodes 3 or 5 or 10, dynamic or fixed, there are only ever <strong>two</strong> Spark applications running:</p>
  <p><a href="https://i.stack.imgur.com/CEdjWl.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/CEdjWl.png" alt="always two there are, no more, no less" /></a></p>
  <p>The For Each activity should run 10 executions of the notebook.  and is <strong>not</strong> capped at two, but set at the default.  So in theory I would expect this to execute all 10 notebook calls concurrently.  Is there any other Spark config which is causing this to cap at 2?</p>