title: How to filter records from a Parquet file using Python pyarrow
body: <p>I'm trying to filter specific records from a parquet file. I'm using python pyarrow.
  I managed to do it with pandas (see code below). The problem it that is takes a lot of memory for a large parquet file. I'm looking for other options - any ideas?</p>
  
  <p>Thanks.</p>
  
  <pre><code>df = pq.read_table(INPUT_FILE).to_pandas()
  df.query("id not in (%s)" % str(IDS_TO_FILTER)[1:-1], inplace=True)
  pq.write_table(pa.Table.from_pandas(df), OUTPUT_FILE)
  </code></pre>