lib/wmap/google_search_scraper.rb
# Main method to collect intelligences on the Google vast data warehouse. It works by hitting the Google engines with the keyword list. This exhausive method will sweep through the Google engines in over 100+ countries and regions one by one, in order to collect all related web service links collected by known the Google, Inc. across the global Internet.
Main method to collect intelligences on the Google vast data warehouse. It works by hitting the Google engines with the keyword list. This exhausive method will sweep through the Google engines in over 100+ countries and regions one by one, in order to collect all related web service links collected by known the Google, Inc. across the global Internet.
Main method to collect intelligences on the Google vast data warehouse . It works by hitting the Google engines with the keyword list . This exhausive method will sweep through the Google engines in over 100 + countries and regions one by one in order to collect all related web service links collected by known the Google Inc . across the global Internet .
def google_workers(keyword_list=file_2_list(File_keywords)) 
		begin
			puts "Start the Google worker for: #{keyword_list}" if @verbose
			links=Array.new			
			keyword_list.map do |keyword|
				links+=google_worker(keyword)
			end
			return links.uniq.sort
		rescue Exception => ee
			puts "Exception on the method google_workers for #{keyword_list}: #{ee}" if @verbose
			return nil
		end	
	end
def google_workers ( keyword_list = file_2_list ( File_keywords ) ) begin puts "Start the Google worker for: #{keyword_list}" if @verbose links = Array . new keyword_list . map do | keyword | links += google_worker ( keyword ) end return links . uniq . sort rescue Exception => ee puts "Exception on the method google_workers for #{keyword_list}: #{ee}" if @verbose return nil end end
Main method to collect intelligences on the Google vast data warehouse.
Main method to collect intelligences on the Google vast data warehouse .
keyword_list
<not_specific>
file_2_list
<not_specific>