original_docstring: 
      loads all the song files in JSON format, process them, and load them into appropriate columns and tables (e.g. songs and artists tables)
      
docstring: loads all the song files in JSON format, process them, and load them into appropriate columns and tables
docstring_tokens: loads all the song files in JSON format process them and load them into appropriate columns and tables
code: def process_song_file(cur, filepath):
      """
      loads all the song files in JSON format, process them, and load them into appropriate columns and tables (e.g. songs and artists tables)
      """
      # open song file
      df = pd.read_json(filepath, lines=True)
      # insert song record
      song_data = list(zip(df['song_id'], df['title'], df['year'], df['duration'], df['artist_id']))
      song_df = pd.DataFrame(song_data, columns=['song_id', 'title', 'year', 'duration', 'artist_id'])
      for i, row in song_df.iterrows():
          cur.execute(song_table_insert, row)
      # insert artist record
      artist_data = list(zip(df['artist_id'], df['artist_name'], df['artist_location'], df['artist_latitude'], df['artist_longitude']))
      artist_df = pd.DataFrame(artist_data, columns=['artist_id', 'artist_name', 'artist_location', 'artist_latitude', 'artist_longitude'])
      for i, row in artist_df.iterrows():
          cur.execute(artist_table_insert, row)
code_tokens: def process_song_file ( cur , filepath ) : df = pd . read_json ( filepath , lines = True ) song_data = list ( zip ( df [ 'song_id' ] , df [ 'title' ] , df [ 'year' ] , df [ 'duration' ] , df [ 'artist_id' ] ) ) song_df = pd . DataFrame ( song_data , columns = [ 'song_id' , 'title' , 'year' , 'duration' , 'artist_id' ] ) for i , row in song_df . iterrows ( ) : cur . execute ( song_table_insert , row ) artist_data = list ( zip ( df [ 'artist_id' ] , df [ 'artist_name' ] , df [ 'artist_location' ] , df [ 'artist_latitude' ] , df [ 'artist_longitude' ] ) ) artist_df = pd . DataFrame ( artist_data , columns = [ 'artist_id' , 'artist_name' , 'artist_location' , 'artist_latitude' , 'artist_longitude' ] ) for i , row in artist_df . iterrows ( ) : cur . execute ( artist_table_insert , row )
short_docstring: loads all the song files in JSON format, process them, and load them into appropriate columns and tables (e.g.
short_docstring_tokens: loads all the song files in JSON format process them and load them into appropriate columns and tables ( e . g .
comment: """
      loads all the song files in JSON format, process them, and load them into appropriate columns and tables (e.g. songs and artists tables)
      """$SEP$# open song file$SEP$# insert song record$SEP$# insert artist record