title: Reading/writing error messages from data factory pipelines
body: <p>Going to try asking this here.</p>
  <p>I'm trying to write an error message from an Azure Data Factory pipeline to a table in SQL server. It needs to capture the error message from a Databricks Python job. I can't find any official documentation and the method I have found from <a href="https://www.tech-findings.com/2019/06/ADF-Insert-Pipeline-details-in-Custom-Monitoring-Table.html" rel="nofollow noreferrer">this source</a>:</p>
  <p>@{activity('Proc source').error.message}</p>
  <p>..doesn't write anything to the table. Just a blank string with no explanation.</p>
  <p>Why data factory doesn't just have an area where you can view the details of errors instead of just saying &quot;Failed&quot; is beyond me. Or if it does, it's hidden away.</p>
  <p>Does anyone have any ideas?</p>