title: Need to filter the Spark dataframe with filter values from iterating over multiple columns
body: <p>I have the following dataset in Spark dataframe. I need to filter based on given conditions:</p>
  <ul>
  <li>equals to: <code>ID: (6, 7, 8, 9, 13, 15, 16, 18)</code></li>
  <li>NOT equals to: <code>STATE :(Illinois, Oklahoma)</code>, <code>CITY: (Orange, Boca_Raton)</code></li>
  </ul>
  <p>I need to iterate over these columns to get the filter values as key-value pair instead of hardcoding the values and filter the dataframe to get the result df.</p>
  <div class="s-table-container">
  <table class="s-table">
  <thead>
  <tr>
  <th>id</th>
  <th>NAME</th>
  <th>CITY</th>
  <th>STATE</th>
  </tr>
  </thead>
  <tbody>
  <tr>
  <td>1</td>
  <td>Roseann</td>
  <td>Richmond</td>
  <td>Virginia</td>
  </tr>
  <tr>
  <td>3</td>
  <td>Jameson</td>
  <td>Fort_Lauderdale</td>
  <td>Florida</td>
  </tr>
  <tr>
  <td>4</td>
  <td>Marline</td>
  <td>Washington</td>
  <td>District_of_Columbia</td>
  </tr>
  <tr>
  <td>5</td>
  <td>Ivory</td>
  <td>Macon</td>
  <td>Georgia</td>
  </tr>
  <tr>
  <td>6</td>
  <td>Toby</td>
  <td>San_Diego</td>
  <td>California</td>
  </tr>
  <tr>
  <td>7</td>
  <td>Isacco</td>
  <td>Honolulu</td>
  <td>Illinois</td>
  </tr>
  <tr>
  <td>8</td>
  <td>Sallee</td>
  <td>Orange</td>
  <td>California</td>
  </tr>
  <tr>
  <td>9</td>
  <td>Lannie</td>
  <td>Peoria</td>
  <td>Oklahoma</td>
  </tr>
  <tr>
  <td>10</td>
  <td>Bradley</td>
  <td>Tulsa</td>
  <td>Oklahoma</td>
  </tr>
  <tr>
  <td>11</td>
  <td>Teodora</td>
  <td>Pittsburgh</td>
  <td>Pennsylvania</td>
  </tr>
  <tr>
  <td>12</td>
  <td>Benedikta</td>
  <td>Tampa</td>
  <td>Florida</td>
  </tr>
  <tr>
  <td>13</td>
  <td>Zelma</td>
  <td>Newport_News</td>
  <td>California</td>
  </tr>
  <tr>
  <td>14</td>
  <td>Carilyn</td>
  <td>Flint</td>
  <td>Michigan</td>
  </tr>
  <tr>
  <td>15</td>
  <td>Joey</td>
  <td>Boca_Raton</td>
  <td>California</td>
  </tr>
  <tr>
  <td>16</td>
  <td>Pattie</td>
  <td>Boston</td>
  <td>Massachusetts</td>
  </tr>
  <tr>
  <td>17</td>
  <td>Dag</td>
  <td>Bismarck</td>
  <td>North_Dakota</td>
  </tr>
  <tr>
  <td>18</td>
  <td>Glynn</td>
  <td>Decatur</td>
  <td>Oklahoma</td>
  </tr>
  <tr>
  <td>19</td>
  <td>Hilton</td>
  <td>Phoenix</td>
  <td>Arizona</td>
  </tr>
  <tr>
  <td>20</td>
  <td>Barbette</td>
  <td>New_Orleans</td>
  <td>Louisiana</td>
  </tr>
  </tbody>
  </table>
  </div>