title: How to obtain metadata about the current executor(s), Apache-Spark?
body: <p>I would like to get as much information as possible from within the executor, while it is executing, but can't seem to find any information on how to accomplish that other than by using the Web UI. For example, it would be useful to know which file is being processed by which executor, and when. </p>
  
  <p>I need this flexibility for debugging, but cannot find any information about it.</p>
  
  <p>Thank you</p>