FF = 56.0 (64-bit)
IM = 9.0.3 for Firefox
OS = Windows 7 Professional SP1
I finally got this script to work (ish, under ideal conditions). The problem arises when there are gaps in the extracted data (missing tags), which is totally fine, but it messes up the formatting in the .csv. The columns are all shifted right by the number of tags that are missing.
URL is question: https://www.ontario.ca/environment-and- ... ll-records
Once a region is selected, the relevant records are listed, and then I loop this script for the number of records.
My Script:
Code: Select all
'VARIABLE SETUP
SET !EXTRACT_TEST_POPUP NO
SET !ERRORIGNORE YES
SET !TIMEOUT_PAGE 60
SET DELAY 0.2
SET !LOOP 1
SET STEP 7
SET WELLID EVAL("{{STEP}}*{{!LOOP}}-6")
SET DATE EVAL("{{STEP}}*{{!LOOP}}")
SET DEPTH EVAL("{{STEP}}*{{!LOOP}}-1")
'LOOPS THOUGH THE MAIN TABLE LIST
'=================================
TAG POS={{WELLID}} TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
TAG POS={{DATE}} TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
TAG POS={{DEPTH}} TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
'RESET POSITION
TAG POS={{WELLID}} TYPE=TD ATTR=*
WAIT SECONDS={{DELAY}}
'CLICK ON HTML RECORD
TAG POS=R1 TYPE=A ATTR=TXT:HTML
WAIT SECONDS={{DELAY}}
'PAGE LOAD ALLOWANCE
WAIT SECONDS=1.5
'PULLS REST OF WELL DATA FROM HTML RECORD
'========================================
'Well Type (Domestic, Industrial, etc.)
TAG POS=1 TYPE=TH ATTR=TXT:Well<SP>Use
WAIT SECONDS={{DELAY}}
TAG POS=R4 TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
'Well Status (Water Supply, Observation, etc.)
TAG POS=6 TYPE=P ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
'Water found at depth
TAG POS=1 TYPE=TH ATTR=TXT:Kind
WAIT SECONDS={{DELAY}}
TAG POS=R1 TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
'Static Water Level
TAG POS=1 TYPE=TD ATTR=TXT:SWL
WAIT SECONDS={{DELAY}}
TAG POS=R1 TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
'Pump Rate
TAG POS=1 TYPE=TH ATTR=TXT:Pumping<SP>Rate
WAIT SECONDS={{DELAY}}
TAG POS=R1 TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
ADD !EXTRACT //
WAIT SECONDS={{DELAY}}
'Recommended Pump rate
TAG POS=1 TYPE=TH ATTR=TXT:Recommended<SP>pump<SP>rate
WAIT SECONDS={{DELAY}}
TAG POS=R1 TYPE=TD ATTR=* EXTRACT=TXT
WAIT SECONDS={{DELAY}}
'Save Record
SAVEAS TYPE=EXTRACT FOLDER=* FILE=WELL_RECORDS_{{!NOW:ddmmyyyy}}.csv
WAIT SECONDS={{DELAY}}
'RETURN TO THE MAIN TABLE
TAG POS=1 TYPE=A ATTR=TXT:Go<SP>Back<SP>to<SP>Map&&ONCLICK:MOECC_UI.goBacktoMap()
WAIT SECONDS=1.5
Is there not a better way?
Thanks in Advance,