lib/wmap/url_crawler.rb
# Fast crawling method - build the target pool from the input file
Fast crawling method - build the target pool from the input file
Fast crawling method - build the target pool from the input file
def crawl_workers_on_file (file)
		puts "Web crawl the list of targets from file: #{file}"
		targets=file_2_list(file)
		sites=crawl_workers(targets,num=@max_parallel)
		return sites
	rescue => ee
    puts "Exception on method #{__method__}: #{ee}" if @verbose
    return nil
	end
def crawl_workers_on_file ( file ) puts "Web crawl the list of targets from file: #{file}" targets = file_2_list ( file ) sites = crawl_workers ( targets , num = @max_parallel ) return sites rescue => ee puts "Exception on method #{__method__}: #{ee}" if @verbose return nil end
Fast crawling method - build the target pool from the input file
Fast crawling method - build the target pool from the input file
file
<not_specific>