iMacros for scraping Google?

Discussions and Tech Support related to website data extraction, screen scraping and data mining using iMacros.

Moderators: Community Moderators, iMacros Moderators

Forum rules
Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the Google search box (at the top of each forum page) to see if a similar problem or question has already been addressed. This will search the entire contents of the forums as well as the iMacros Wiki.
3. We can respond much faster to your posts if you include the following information:

CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST

Answering your own posts (e.g. attempting to "bump" your topic) drops your topic from the list of unanswered threads, so it may actually receive less views.

iMacros for scraping Google?

by TommyLeeJones on Sun Oct 16, 2016 6:04 am

Hello everyone!

I've got a list of 5000 Google keywords. For each of them I want to go to Google and check TOP 10 pages and save collected links to a report. I would like to save to report also Titles and Desc.
Is iMacros good tool to do it? I think so I can load keywords list from CVS file and then learn iMacros to scrape Google. But what with using a lot of proxies during this task? Can iMacros handle it for me? Or can you advice me any other tool to do it?
TommyLeeJones
 
Posts: 1
Joined: Sun Oct 16, 2016 5:58 am

Re: iMacros for scraping Google?

by chivracq on Sun Oct 16, 2016 8:05 am

TommyLeeJones wrote:Hello everyone!

I've got a list of 5000 Google keywords. For each of them I want to go to Google and check TOP 10 pages and save collected links to a report. I would like to save to report also Titles and Desc.
Is iMacros good tool to do it? I think so I can load keywords list from CVS file and then learn iMacros to scrape Google. But what with using a lot of proxies during this task? Can iMacros handle it for me? Or can you advice me any other tool to do it?

"Is iMacros good tool to do it?"
=> Ah-ah...!, well, for me the Answer would be a big YES, oops...!, but iMacros is actually only one of maybe 50 Extraction Tools available on the Market, with I guess all their Pros and Cons...

Have a look at this Thread where some other User (well Developer actually) had advertized about their own Extraction Tool claiming it was better than iMacros (I never took/found the Time/Energy to investigate a bit deeper) and where I think I had posted a List or a Link to many different Extraction Tools (can be found otherwise by googling "Extraction Tools").
- I need help with the extraction

Concerning the Use of Proxies, iMacros has a 'PROXY' Command to handle Proxies, but I've never used it myself and there are a few Threads on the Forum regarding some "Difficulties" with it.

Have a look anyway at the iMacros Command Reference for a List of all available Commands, the Names are usually self-explanatory.

Another Hint about your Need would be to search the Forum a bit, you are not the first one to come up with this "Scenario", I reckon that with very little Search-work, you will find a Macro posted somewhere on the Forum already waiting for you... 8)

Mini useful Feedback for this Forum and other Users..., if after investigating several Extraction Tools you end up choosing for iMacros or some other Tool, it would still be nice if you could post the Results of your Comparison and which Tools you had a look at and what were their respective +/- Features in your Opinion and why you finally chose for which Tool and why... :idea:
- (F)CIM = (Full) Config Info Missing: iMacros + Browser + OS with all 3 Versions...
- I usually don't even read the Question if that (required) Info is not mentioned...
- Script & URL usually help a lot for a more "educated" Help...
chivracq
 
Posts: 6291
Joined: Sat Apr 13, 2013 6:07 am
Location: Amsterdam (NL)


Return to Data Extraction and Web Screen Scraping

Who is online

Users browsing this forum: No registered users and 2 guests

-->