Is it possibe to crawl entire website and save data?

Discussions and Tech Support related to website data extraction, screen scraping and data mining using iMacros.
Forum rules
Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the Google search box (at the top of each forum page) to see if a similar problem or question has already been addressed. This will search the entire contents of the forums as well as the iMacros Wiki.
3. We can respond much faster to your posts if you include the following information:

CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST

Answering your own posts (e.g. attempting to "bump" your topic) drops your topic from the list of unanswered threads, so it may actually receive less views.
Post Reply
firstkempo
Posts: 3
Joined: Wed Jan 17, 2007 11:50 am

Is it possibe to crawl entire website and save data?

Post by firstkempo » Wed Jul 18, 2007 8:42 am

I did not see any topic or feature about crawling entire web site and save data even in the product features or in the forum topics. I ask this question for crawling price data for all the products from a web site. To do this imacros has to crawl all the links according to the specified criteria which contains product pages and after that it should process these links accordingly. Is it possible to do that and how?
User avatar
Tech Support
Posts: 4948
Joined: Tue Sep 20, 2005 7:25 pm
Contact:

Post by Tech Support » Sat Aug 04, 2007 7:02 pm

What you want to do is possible with the Scripting Interface http://wiki.imacros.net/Web_Scripting
Post Reply