title: Filter Pyspark Dataframe with udf on entire row
body: <p>Is there a way to select the entire row as a column to input into a Pyspark filter udf?</p>
  
  <p>I have a complex filtering function "my_filter" that I want to apply to the entire DataFrame:</p>
  
  <pre><code>my_filter_udf = udf(lambda r: my_filter(r), BooleanType())
  new_df = df.filter(my_filter_udf(col("*"))
  </code></pre>
  
  <p>But </p>
  
  <pre><code>col("*")
  </code></pre>
  
  <p>throws an error because that's not a valid operation. </p>
  
  <p>I know that I can convert the dataframe to an RDD and then use the RDD's filter method, but I do NOT want to convert it to an RDD and then back into a dataframe. My DataFrame has complex nested types, so the schema inference fails when I try to convert the RDD into a dataframe again.</p>