original_docstring: 
      Function to add new documents to a previously existed index
      :param dirname: path of the index directory
      
docstring: Function to add new documents to a previously existed index
docstring_tokens: Function to add new documents to a previously existed index
code: def incremental_index(dirname):
      """
      Function to add new documents to a previously existed index
      :param dirname: path of the index directory
      """
      ix = open_dir(dirname)
      # The set of all paths in the index
      indexed_paths = set()
      with ix.searcher() as searcher:
          writer = ix.writer()
  
          # Loop over the stored fields in the index
          for fields in searcher.all_stored_fields():
              indexed_path = fields['path']
              indexed_paths.add(indexed_path)
  
          # Loop over the files in the filesystem
          for path in get_link_files():
              if path not in indexed_paths:
                  print 'File addng to index: ', path
                  add_doc(writer, path)
          print 'Committing :::'
          writer.commit()
code_tokens: def incremental_index ( dirname ) : ix = open_dir ( dirname ) indexed_paths = set ( ) with ix . searcher ( ) as searcher : writer = ix . writer ( ) for fields in searcher . all_stored_fields ( ) : indexed_path = fields [ 'path' ] indexed_paths . add ( indexed_path ) for path in get_link_files ( ) : if path not in indexed_paths : print 'File addng to index: ' , path add_doc ( writer , path ) print 'Committing :::' writer . commit ( )
short_docstring: Function to add new documents to a previously existed index
short_docstring_tokens: Function to add new documents to a previously existed index
comment: """
      Function to add new documents to a previously existed index
      :param dirname: path of the index directory
      """$SEP$# The set of all paths in the index$SEP$# Loop over the stored fields in the index$SEP$# Loop over the files in the filesystem