Web scraper vs. crawler ?

Support for iMacros. The iMacros software is the unique solution for automating every activity inside a web browser, for data extraction and web testing.

Moderators: Community Moderators, iMacros Moderators

Forum rules
Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the Google search box (at the top of each forum page) to see if a similar problem or question has already been addressed. This will search the entire contents of the forums as well as the iMacros Wiki.
3. We can respond much faster to your posts if you include the following information:

CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST

Answering your own posts (e.g. attempting to "bump" your topic) drops your topic from the list of unanswered threads, so it may actually receive less views.

Web scraper vs. crawler ?

by leegold2 on Tue Aug 20, 2013 12:52 pm

Hi,

I wondered if compare and contrast imacros compared to a what's usually called a web crawler. It seems to me imacros is mostly a web scraper were I target what I want and imacros retrieves it. I've used Imacros to do this and IMO it's easily the best at this.

But what if I want to archive or copy a whole site, then I'd need a tool that recursively follows all links in a site and, hopefully it's javascript aware, and retrieves a copy of the site. Wouldn't that be a web crawler tool?

Am I correct in making this distinction? Different tools for different purposes?

Thanks
leegold2
 
Posts: 1
Joined: Tue Aug 20, 2013 12:37 pm

Return to General Support & Discussions

Who is online

Users browsing this forum: Google [Bot], Majestic-12 [Bot] and 6 guests

-->