extraction hangs... long standing issue

Discussions and Tech Support related to website data extraction, screen scraping and data mining using iMacros.
Forum rules
Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the search box (at the top of each forum page) to see if a similar problem or question has already been addressed.
3. Try searching the iMacros Wiki - it contains the complete iMacros reference as well as plenty of samples and tutorials.
4. We can respond much faster to your posts if you include the following information:CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST
Post Reply
ltek
Posts: 45
Joined: Thu Sep 22, 2005 7:52 pm

extraction hangs... long standing issue

Post by ltek » Fri Dec 23, 2005 7:27 pm

I use the following script and the extraction just hangs. the timer continues but nothing happens. It takes about 30-40 seconds for all the data to display in a single large table in the browser window, without IM.

I tried the patch from this thread but it does not fix the issue...
http://forum.iopus.com/viewtopic.php?t=264

screenshot of IM hanging...

Image

Code: Select all

VERSION BUILD=5001024   
'
' ------ USER DEFINED VARIABLES -------
SET !VAR1 {{!NOW:yyyymmdd}}
SET !VAR2 C:\Internet\
SET !TIMEOUT 9999
SET !ERRORCONTINUE YES
' -------------------------------------
TAB T=1     
TAB CLOSEALLOTHERS   
ONLOGIN USER=<removed>
PASSWORD=<removed>
URL GOTO=<removed>     
'
' ------ FIND FRAME & TABLE -------
TAB T=1     
FRAME F=3     
TAG POS=1 TYPE=SPAN ATTR=TXT:<SP><SP><SP><SP><SP><SP><SP><SP><SP>Roster<BR><LF><BR><LF><SP><SP><SP><SP><SP>Discussion<BR><LF><BR><LF>ARMLS<SP>&<SP>Tempo<SP>Info<BR><LF><BR><LF>My<SP>Page   
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:OfficeID CONTENT= 
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:OfficeName CONTENT= 
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:PubID CONTENT= 
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:LastName CONTENT= 
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:FirstName CONTENT= 
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:City CONTENT=
TAG POS=1 TYPE=INPUT:TEXT FORM=NAME:Form ATTR=NAME:Zip CONTENT=
TAG POS=1 TYPE=SELECT FORM=NAME:Form ATTR=NAME:AgentType CONTENT=6
TAG POS=1 TYPE=INPUT:BUTTON FORM=NAME:Form ATTR=NAME:B1&&VALUE:<SP><SP>Search<SP><SP>   
'
' ------ EXTRACT MEMBER LIST TO CSV -------
EXTRACT POS=1 TYPE=TXT ATTR=<TABLE*
SAVEAS TYPE=EXTRACT FOLDER={{!VAR2}} FILE=lst_ALL_{{!VAR1}}.csv
User avatar
Tech Support
Posts: 4948
Joined: Tue Sep 20, 2005 7:25 pm
Contact:

Post by Tech Support » Sat Dec 24, 2005 3:56 am

Just to clarify: Does it hang "forever" or does it extract the data correctly after 30 seconds?
ltek
Posts: 45
Joined: Thu Sep 22, 2005 7:52 pm

Post by ltek » Sat Dec 24, 2005 4:06 am

you can see by the screenshot it was at 576 seconds... it hangs until I kill the process.
ltek
Posts: 45
Joined: Thu Sep 22, 2005 7:52 pm

Post by ltek » Sat Dec 24, 2005 5:26 pm

Here's another screen shot of a hang on a smaller table. It retrieved the table fine but the extract hangs forever at 50% - it gets to 50% in only a few seconds.

Image
sdtony
Posts: 31
Joined: Tue Dec 13, 2005 6:15 am

Post by sdtony » Tue Dec 27, 2005 1:54 am

Itek I'm having the same issue with San Diego tempo
ltek
Posts: 45
Joined: Thu Sep 22, 2005 7:52 pm

Post by ltek » Tue Dec 27, 2005 2:20 am

I wish iOpus would put some resources into fixing this issue... this is horrible. A $500 application that cannot extract data from more then a few hundred rows.
ltek
Posts: 45
Joined: Thu Sep 22, 2005 7:52 pm

Post by ltek » Mon Jan 02, 2006 6:29 pm

any chance iOpus can put some work into this one anytime soon???
User avatar
Tech Support
Posts: 4948
Joined: Tue Sep 20, 2005 7:25 pm
Contact:

Post by Tech Support » Tue Jan 03, 2006 3:56 pm

This issue is on our "to do" list and we are working on it. Please note that the issue does not happen with every web page but occurs on specific pages with problems in their html coding. Our development team will get back to you as soon as they have something worked out.
Post Reply