Data Extraction help

Discussions and Tech Support related to website data extraction, screen scraping and data mining using iMacros.
Forum rules
Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the Google search box (at the top of each forum page) to see if a similar problem or question has already been addressed. This will search the entire contents of the forums as well as the iMacros Wiki.
3. We can respond much faster to your posts if you include the following information:

CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST

Answering your own posts (e.g. attempting to "bump" your topic) drops your topic from the list of unanswered threads, so it may actually receive less views.
Post Reply
JerseyJosh
Posts: 1
Joined: Fri Oct 26, 2018 1:28 pm

Data Extraction help

Post by JerseyJosh » Fri Oct 26, 2018 1:32 pm

I'm far from an expert, but I've stumbled my way through many useful macros, greatly improving my workflow.

I want to take advantage of imacros web scraping, but I fail time and again.

Is anyone out there good enough to get me started? I could really use this data. My goal is to scrape public permit data and dump it into and excel (or csv) file.

An example website is below. If someone could get me started, I can easily adapt it for the other websites. Thank you very much in advance for any help!

https://www.velocityhall.com/accela/vel ... /index.cfm
chivracq
Posts: 7722
Joined: Sat Apr 13, 2013 1:07 pm
Location: Amsterdam (NL)

Re: Data Extraction help

Post by chivracq » Sat Oct 27, 2018 7:24 am

JerseyJosh wrote:I'm far from an expert, but I've stumbled my way through many useful macros, greatly improving my workflow.

I want to take advantage of imacros web scraping, but I fail time and again.

Is anyone out there good enough to get me started? I could really use this data. My goal is to scrape public permit data and dump it into and excel (or csv) file.

An example website is below. If someone could get me started, I can easily adapt it for the other websites. Thank you very much in advance for any help!

https://www.velocityhall.com/accela/vel ... /index.cfm
If you are "really" looking for Help, (I actually hesitated to approve your Post as it sounds pretty "fake") + unreachable Site, OK, we'll see...), find first a better Descriptive Thread Title, as this complete (Sub-)Forum is all about..., hum..., re-hum..., what was your Thread Title again...?, of yeah...!: "Data Extraction help" => +1 Point for posting in the correct Sub-Forum though... :wink:

Next Step would be to read the Forum Rules and to mention your "FCI" (read my Sig)... :idea:
(Many Commands are not supported on all Browsers / iMacros Versions...)

Can't check your Site from Europe-NL anyway, IP disabled from the Web-Server I think [=> "The server declined your request."] (and I have a clean IP, no Spam whatever..., they must be selecting on Country I guess... Post another Site for your next Example maybe..., but you need to to try "stg" a bit by yourself, and to read a bit of the Documentation, you have a complete Section in the Wiki about "Data Extraction"... The "Purpose" of a Forum is to help you if you have a (specific) Problem, but we can't read the Documentation for you...! :idea:
- (F)CIM = (Full) Config Info Missing: iMacros + Browser + OS with all 3 Versions...
- I usually don't even read the Question if that (required) Info is not mentioned...
- Script & URL usually help a lot for a more "educated" Help...
chivracq
Posts: 7722
Joined: Sat Apr 13, 2013 1:07 pm
Location: Amsterdam (NL)

Re: Data Extraction help

Post by chivracq » Sat Oct 27, 2018 5:02 pm

Hum, and "I can easily adapt it for the other websites." is not necessarily true, iMacros Scripts rely "heavily" on the HTML Structure of a specific Page/Site, unless you are trying to scrape different Pages from a same Site, you'll have to re-record your Actions and to re-select the Fields you want to tag or extract for each Site...
- (F)CIM = (Full) Config Info Missing: iMacros + Browser + OS with all 3 Versions...
- I usually don't even read the Question if that (required) Info is not mentioned...
- Script & URL usually help a lot for a more "educated" Help...
Post Reply