title: How to automate data ingestion with logstash pipelines?
body: <p>I'm using ELK in order to ingest, store and visualize data, no fancy things..</p>
  
  <p>Everything is working fine but each time I have new data to ingest I have to execute manually the command /opt/logstash/bin/logstash -f mypipeline.conf</p>
  
  <p>I was wondering how to automate this last step in order to ingest the data in elastisearch each time new data arrive in the inut folder defined in my pipeline conf file?</p>
  
  <p>I'm using the input plugin :</p>
  
  <pre><code>file {
  path =&gt; "/path/to/myfiles*.csv"
  start_position =&gt; beginning
  sincedb_path =&gt; "/dev/null"
  }
  </code></pre>
  
  <p>I guess I'm missing an important option that would allow to check if new files are present or not..</p>
  
  <p>"discover_interval" or "stat_interval" ? or the sincedb-path ??</p>
  
  <p>thx</p>