title: How to load data incrementally using Sqoop with Avro as a data file?
body: <p>Getting below error:</p>
  
  <pre><code>--incremental lastmodified cannot be used in conjunction with --as-avrodatafile.
  </code></pre>
  
  <p>when running command:</p>
  
  <pre class="lang-sh prettyprint-override"><code>gcloud dataproc jobs submit hadoop \
      --project='aca-ingest-dev' \
      --cluster='sqoop-gcp-ingest-d3' \
      --region='us-east1' \
      --class=org.apache.sqoop.Sqoop \
      --jars='gs://aca_utilities_dev/ingestion_jars/sqoop-1.4.7-hadoop260.jar,gs://aca_utilities_dev/ingestion_jars/avro-tools-1.8.2.jar,gs://aca_utilities_dev/ingestion_jars/ojdbc7.jar' \
      -- \
      import \
      -Dmapreduce.job.user.classpath.first=true \
      --connect='jdbc:oracle:thin:@10.25.42.52:1521/uataca.aaamidatlantic.com' \
      --username='XX' --password-file='XX' \
      --query='select comm_ctr_i from tab1 where $CONDITIONS OFFSET 0 ROWS FETCH NEXT 1000 ROWS ONLY' \
      --target-dir='gs://aca-ingest-d3-dev/hist_arch_call/source/2019-08-16_6' \
      --num-mappers=1 \
      --incremental=lastmodified \
      --check-column='arch_date' \
      --last-value='2019-08-16T06:07:37.036611' \
      --as-avrodatafile
  </code></pre>