iMacros for scraping Google?

Discussions and Tech Support related to website data extraction, screen scraping and data mining using iMacros.
Forum rules
iMacros EOL - Attention!

The renewal maintenance has officially ended for Progress iMacros effective November 20, 2023 and all versions of iMacros are now considered EOL (End-of-Life). The iMacros products will no longer be supported by Progress (aside from customer license issues), and these forums will also no longer be moderated from the Progress side.

Thank you again for your business and support.

Sincerely,
The Progress Team

Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the search box (at the top of each forum page) to see if a similar problem or question has already been addressed.
3. Try searching the iMacros Wiki - it contains the complete iMacros reference as well as plenty of samples and tutorials.
4. We can respond much faster to your posts if you include the following information: CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST
Post Reply
TommyLeeJones
Posts: 1
Joined: Sun Oct 16, 2016 12:58 pm

iMacros for scraping Google?

Post by TommyLeeJones » Sun Oct 16, 2016 1:04 pm

Hello everyone!

I've got a list of 5000 Google keywords. For each of them I want to go to Google and check TOP 10 pages and save collected links to a report. I would like to save to report also Titles and Desc.
Is iMacros good tool to do it? I think so I can load keywords list from CVS file and then learn iMacros to scrape Google. But what with using a lot of proxies during this task? Can iMacros handle it for me? Or can you advice me any other tool to do it?
chivracq
Posts: 10301
Joined: Sat Apr 13, 2013 1:07 pm
Location: Amsterdam (NL)

Re: iMacros for scraping Google?

Post by chivracq » Sun Oct 16, 2016 3:05 pm

TommyLeeJones wrote:Hello everyone!

I've got a list of 5000 Google keywords. For each of them I want to go to Google and check TOP 10 pages and save collected links to a report. I would like to save to report also Titles and Desc.
Is iMacros good tool to do it? I think so I can load keywords list from CVS file and then learn iMacros to scrape Google. But what with using a lot of proxies during this task? Can iMacros handle it for me? Or can you advice me any other tool to do it?
"Is iMacros good tool to do it?"
=> Ah-ah...!, well, for me the Answer would be a big YES, oops...!, but iMacros is actually only one of maybe 50 Extraction Tools available on the Market, with I guess all their Pros and Cons...

Have a look at this Thread where some other User (well Developer actually) had advertized about their own Extraction Tool claiming it was better than iMacros (I never took/found the Time/Energy to investigate a bit deeper) and where I think I had posted a List or a Link to many different Extraction Tools (can be found otherwise by googling "Extraction Tools").
- I need help with the extraction

Concerning the Use of Proxies, iMacros has a 'PROXY' Command to handle Proxies, but I've never used it myself and there are a few Threads on the Forum regarding some "Difficulties" with it.

Have a look anyway at the iMacros Command Reference for a List of all available Commands, the Names are usually self-explanatory.

Another Hint about your Need would be to search the Forum a bit, you are not the first one to come up with this "Scenario", I reckon that with very little Search-work, you will find a Macro posted somewhere on the Forum already waiting for you... 8)

Mini useful Feedback for this Forum and other Users..., if after investigating several Extraction Tools you end up choosing for iMacros or some other Tool, it would still be nice if you could post the Results of your Comparison and which Tools you had a look at and what were their respective +/- Features in your Opinion and why you finally chose for which Tool and why... :idea:
- (F)CI(M) = (Full) Config Info (Missing): iMacros + Browser + OS (+ all 3 Versions + 'Free'/'PE'/'Trial').
- FCI not mentioned: I don't even read the Qt...! (or only to catch Spam!)
- Script & URL help a lot for more "educated" Help...
Post Reply