title: awk: program limit exceeded: maximum number of fields size=32767
body: <p>when i am running my shell script in ubuntu 14.04 i am getting an error like below </p>
  
  <pre><code>awk: program limit exceeded: maximum number of fields size=32767
      FILENAME="ensemble_features/Training_BOOKS_POS_Bigram_with_stemming_BOOLEAN_FVT.csv" FNR=1 NR=1
  cut: invalid byte, character or field list
  Try 'cut --help' for more information.
  -1
  cut: invalid byte, character or field list
  Try 'cut --help' for more information.
  6656
  user@user-Lenovo-IdeaPad-Z410:~/Thesis/BOOKS$ bash Training_POS_Uni_Bi.sh
  awk: program limit exceeded: maximum number of fields size=32767
      FILENAME="ensemble_features/Training_BOOKS_POS_Bigram_with_stemming_BOOLEAN_FVT.csv" FNR=1 NR=1
  cut: invalid byte, character or field list
  Try 'cut --help' for more information.
  -1
  cut: invalid byte, character or field list
  Try 'cut --help' for more information.
  6656
  </code></pre>
  
  <p>i am adding my script below</p>
  
  <pre><code>cd /home/user/Thesis/BOOKS/Features/Training/POSITIVE/
  fname="ensemble_features"
  mkdir $fname
  
  cp /home/user/Thesis/BOOKS/Features/Training/POSITIVE/Training_BOOKS_POS_unigram_FVT_with_stemming_BOOLEAN.csv ensemble_features/
  cp /home/user/Thesis/BOOKS/Features/Training/POSITIVE/Training_BOOKS_POS_Bigram_with_stemming_BOOLEAN_FVT.csv ensemble_features/
  
  
  mkdir "proces"
  cnt=0
  for file in $fname/*
  do
      #Number of columns
      num=`awk 'BEGIN {FS=",";c=0};{if (c==0 ){print NF; c=1}}END{}' $file`
      if [[ cnt -eq 0 ]];then
          cut -d, -f $num $file &gt;class.csv
          cnt=1;
      fi
      num=$((num-1))
      echo $num
      nfname=`basename $file`
  
      #Cut the columns
      cut -d',' -f1-$num $file &gt; proces/cutlast$nfname
  done
  #Paste multiple csv
  paste -d',' proces/* &gt; comb.csv
  paste -d, comb.csv class.csv &gt; Training_BOOKS_Unigram_Bigram_POS_Ensemble_Features_BOOLEAN.csv
  rm comb.csv
  rm class.csv
  rm -r proces
  rm -r ensemble_features
  </code></pre>
  
  <p>my input files contain 38453 columns and 6656 columns respectively.Anybody can help me to correct this error?</p>