title: Use flume to stream data to S3
body: <p>I am trying flume for something very simple, where I would like to push content from my log files to S3. I was able to create a flume agent that would read the content from an apache access log file and use a logger sink. Now I am trying to find a solution where I can replace the logger sink with an "S3 sink". (I know this does not exist by default)</p>
  
  <p>I was looking for some pointers to direct me in the correct path. Below is my test properties file that I am using currently.</p>
  
  <pre><code>a1.sources=src1
  a1.sinks=sink1
  a1.channels=ch1
  
  #source configuration
  a1.sources.src1.type=exec
  a1.sources.src1.command=tail -f /var/log/apache2/access.log
  
  #sink configuration
  a1.sinks.sink1.type=logger
  
  #channel configuration
  a1.channels.ch1.type=memory
  a1.channels.ch1.capacity=1000
  a1.channels.ch1.transactionCapacity=100
  
  #links
  a1.sources.src1.channels=ch1
  a1.sinks.sink1.channel=ch1
  </code></pre>