original_docstring: Scans a folder and reads the content of all files matching the format (file_format)
          Parameters
          ----------
          folderpath : str
              Relative or absolute folder path
          file_format : str, optional
              Supported file format. Current options are AVRO, JSON or CSV. (default is AVRO)
          only_stats : bool, optional
              Specifies if only file metadata is loaded (True), or if the full article content is loaded (False). On average,
              only_stats loads about 1/10 and is recommended for quick metadata-based analysis. (Default is False)
          merge_body : bool, optional
              Specifies if the body field should be merged with the snippet and this last column being dropped.
              (default is False)
          Returns
          -------
          pandas.DataFrame
              A single Pandas Dataframe with the content from all read files.
          
docstring: Scans a folder and reads the content of all files matching the format (file_format)
  Parameters
  
  folderpath : str
  Relative or absolute folder path
  file_format : str, optional
  Supported file format. Current options are AVRO, JSON or CSV. (default is AVRO)
  only_stats : bool, optional
  Specifies if only file metadata is loaded (True), or if the full article content is loaded (False). On average,
  only_stats loads about 1/10 and is recommended for quick metadata-based analysis. (Default is False)
  merge_body : bool, optional
  Specifies if the body field should be merged with the snippet and this last column being dropped.
  (default is False)
  Returns
  
  pandas.DataFrame
  A single Pandas Dataframe with the content from all read files.
docstring_tokens: Scans a folder and reads the content of all files matching the format ( file_format ) Parameters folderpath : str Relative or absolute folder path file_format : str optional Supported file format . Current options are AVRO JSON or CSV . ( default is AVRO ) only_stats : bool optional Specifies if only file metadata is loaded ( True ) or if the full article content is loaded ( False ) . On average only_stats loads about 1 / 10 and is recommended for quick metadata - based analysis . ( Default is False ) merge_body : bool optional Specifies if the body field should be merged with the snippet and this last column being dropped . ( default is False ) Returns pandas . DataFrame A single Pandas Dataframe with the content from all read files .
code: def read_folder(self, folderpath, file_format='AVRO', only_stats=False, merge_body=False) -> pd.DataFrame:
          """Scans a folder and reads the content of all files matching the format (file_format)
          Parameters
          ----------
          folderpath : str
              Relative or absolute folder path
          file_format : str, optional
              Supported file format. Current options are AVRO, JSON or CSV. (default is AVRO)
          only_stats : bool, optional
              Specifies if only file metadata is loaded (True), or if the full article content is loaded (False). On average,
              only_stats loads about 1/10 and is recommended for quick metadata-based analysis. (Default is False)
          merge_body : bool, optional
              Specifies if the body field should be merged with the snippet and this last column being dropped.
              (default is False)
          Returns
          -------
          pandas.DataFrame
              A single Pandas Dataframe with the content from all read files.
          """
          format_suffix = file_format.lower()
          r_df = pd.DataFrame()
          for filename in os.listdir(folderpath):
              if filename.lower().endswith("." + format_suffix):
                  t_df = self.read_file(folderpath + "/" + filename, only_stats, merge_body)
                  r_df = pd.concat([r_df, t_df])
          return r_df
code_tokens: def read_folder ( self , folderpath , file_format = 'AVRO' , only_stats = False , merge_body = False ) -> pd . DataFrame : format_suffix = file_format . lower ( ) r_df = pd . DataFrame ( ) for filename in os . listdir ( folderpath ) : if filename . lower ( ) . endswith ( "." + format_suffix ) : t_df = self . read_file ( folderpath + "/" + filename , only_stats , merge_body ) r_df = pd . concat ( [ r_df , t_df ] ) return r_df
short_docstring: Scans a folder and reads the content of all files matching the format (file_format)
  Parameters
short_docstring_tokens: Scans a folder and reads the content of all files matching the format ( file_format ) Parameters
comment: """Scans a folder and reads the content of all files matching the format (file_format)
          Parameters
          ----------
          folderpath : str
              Relative or absolute folder path
          file_format : str, optional
              Supported file format. Current options are AVRO, JSON or CSV. (default is AVRO)
          only_stats : bool, optional
              Specifies if only file metadata is loaded (True), or if the full article content is loaded (False). On average,
              only_stats loads about 1/10 and is recommended for quick metadata-based analysis. (Default is False)
          merge_body : bool, optional
              Specifies if the body field should be merged with the snippet and this last column being dropped.
              (default is False)
          Returns
          -------
          pandas.DataFrame
              A single Pandas Dataframe with the content from all read files.
          """