title: getting argument exception in concurrent dictionary when sorting and displaying as it is being updated
body: <p>I am getting a hard to reproduce error in the following program in which a number of threads update a concurrent dictionary in parallel and the main thread displays the state of the dictionary in sorted order after fixed time intervals, until all updating threads complete.</p>
  
  <pre><code>public void Function(IEnumerable&lt;ICharacterReader&gt; characterReaders, IOutputter outputter)
  {
      ConcurrentDictionary&lt;string, int&gt; wordFrequencies = new ConcurrentDictionary&lt;string, int&gt;();
      Thread t = new Thread(() =&gt; UpdateWordFrequencies(characterReaders, wordFrequencies));
      bool completed = false;
      var q = from pair in wordFrequencies orderby pair.Value descending, pair.Key select new Tuple&lt;string, int&gt;(pair.Key, pair.Value);
      t.Start();
      Thread.Sleep(0);
  
      while (!completed)
      {
          completed = t.Join(1);
          outputter.WriteBatch(q);
      }            
  }
  </code></pre>
  
  <p>The function is given a list of character streams and an outputter. The function maintains a concurrent dictionary of word frequencies of words read from each of the character streams (in parallel). The words are read in by a new thread, and the main thread outputs the current state of the dictionary (in sorted order) every 1 miliseconds until all the input streams have been read (in practice the outputting will be something like every 10 seconds, but the error only seems to be appearing for very small values). The WriteBatch function just writes to the console:</p>
  
  <pre><code>public void WriteBatch(IEnumerable&lt;Tuple&lt;string, int&gt;&gt; batch)
  {
      foreach (var tuple in batch)
      {
          Console.WriteLine("{0} - {1}", tuple.Item1, tuple.Item2);
      }
      Console.WriteLine();
  }
  </code></pre>
  
  <p>Most executions are fine, but sometimes I get the following error at the foreach statement in the WriteBatch function:</p>
  
  <p>"Unhandled Exception: System.ArgumentException: The index is equal to or greater
  than the length of the array, or the number of elements in the dictionary is gre
  ater than the available space from index to the end of the destination array."  </p>
  
  <p>The error does seem to go away if the main thread sleeps for a short while after starting the updating threads and before starting the display loop. It also seems to go away if the orderby clause is removed and the dictionary is not sorted in the linq query. Any explanations?</p>
  
  <p>The <code>foreach (var tuple in batch)</code> statement in the WriteBatch function gives the error. The stack trace is as follows:</p>
  
  <p>Unhandled Exception: System.ArgumentException: The index is equal to or greater
  than the length of the array, or the number of elements in the dictionary is gre
  ater than the available space from index to the end of the destination array.
      at System.Collections.Concurrent.ConcurrentDictionary2.System.Collections.Ge
      neric.ICollection>.CopyTo(K
      eyValuePair2[] array, Int32 index)
         at System.Linq.Buffer1..ctor(IEnumerable1 source)
         at System.Linq.OrderedEnumerable1.d__0.MoveNext()
         at System.Linq.Enumerable.WhereSelectEnumerableIterator2.MoveNext()
         at MyProject.ConsoleOutputter.WriteBatch(IEnumerable1 batch) in         C:\MyProject\ConsoleOutputter.cs:line 10
         at MyProject.Function(IEnumerable1 characterReaders, IOutputter outputter) </p>