I need help with the extraction

Discussions and Tech Support related to website data extraction, screen scraping and data mining using iMacros.

Moderators: Community Moderators, iMacros Moderators

Forum rules
Before asking a question or reporting an issue:
1. Please review the list of FAQ's.
2. Use the Google search box (at the top of each forum page) to see if a similar problem or question has already been addressed. This will search the entire contents of the forums as well as the iMacros Wiki.
3. We can respond much faster to your posts if you include the following information:

CLICK HERE FOR IMPORTANT INFORMATION TO INCLUDE IN YOUR POST

Answering your own posts (e.g. attempting to "bump" your topic) drops your topic from the list of unanswered threads, so it may actually receive less views.

I need help with the extraction

by iSharK on Mon May 30, 2016 5:30 am

Hello Guys,
I want to extract all data from this site.
http://sec.up.nic.in/ElecLive/resultsearch.aspx
But I don't know how to :(
I want complete data from those drop down list options.
Is it possible?

Language: Hindi
iSharK
 
Posts: 2
Joined: Mon May 30, 2016 5:25 am

Re: I need help with the extraction

by chivracq on Mon May 30, 2016 11:08 am

iSharK wrote:Hello Guys,
I want to extract all data from this site.
http://sec.up.nic.in/ElecLive/resultsearch.aspx
But I don't know how to :(
I want complete data from those drop down list options.
Is it possible?

Language: Hindi

Thread Title is a bit useless, everybody "needs Help with Extraction" on the 'Data Extraction' Sub-Forum...! :roll:

CIM...! :mrgreen: (Always mention your FCI when you open a Thread, read my Sig, many Commands are not implemented for all Browsers/Versions...)

But OK, I had a look at your Site, funny Language btw...!, and if I understand you correctly, you want to extract all Options from the different DDLB's on that Page, which you can achieve using 'EXTRACT=TXTALL', like explained in the Wiki:
TXTALL
For use with a drop-down list (select element). It extracts all entries of the list.
- (F)CIM = (Full) Config Info Missing: iMacros + Browser + OS with all 3 Versions...
- I usually don't even read the Question if that (required) Info is not mentioned...
- Script & URL usually help a lot for a more "educated" Help...
chivracq
 
Posts: 6477
Joined: Sat Apr 13, 2013 6:07 am
Location: Amsterdam (NL)

Re: I need help with the extraction

by iSharK on Tue May 31, 2016 4:48 am

:D thanks and sorry to ask you a dumb ques :v will you please tell me a proc to do that?

Thanks
iSharK
 
Posts: 2
Joined: Mon May 30, 2016 5:25 am

Re: I need help with the extraction

by chivracq on Tue May 31, 2016 5:14 am

iSharK wrote::D thanks and sorry to ask you a dumb ques :v will you please tell me a proc to do that?

Thanks

Yep, maybe, but comply with 'Descriptive Thread Title' and mention your FCI like I asked you for me to follow up...
And you need to try stg (= something) a bit yourself, I won't be writing your whole Script... => So, what have you tried and where do you get stuck...?

(And I don't understand what "proc" means...?)
- (F)CIM = (Full) Config Info Missing: iMacros + Browser + OS with all 3 Versions...
- I usually don't even read the Question if that (required) Info is not mentioned...
- Script & URL usually help a lot for a more "educated" Help...
chivracq
 
Posts: 6477
Joined: Sat Apr 13, 2013 6:07 am
Location: Amsterdam (NL)

Re: I need help with the extraction

by NoraChoi on Tue May 31, 2016 6:35 pm

iSharK wrote:Hello Guys,
I want to extract all data from this site.
http://sec.up.nic.in/ElecLive/resultsearch.aspx
But I don't know how to :(
I want complete data from those drop down list options.
Is it possible?

Language: Hindi


Hi iSharK,

You can use some web scraping tools to extract data from drop down list in the web page.

I saw the site and maybe Octoparsehttp://www.octoparse.com/?fo can help you.
NoraChoi
 
Posts: 6
Joined: Wed May 25, 2016 11:14 pm

Re: I need help with the extraction

by chivracq on Tue May 31, 2016 7:36 pm

NoraChoi wrote:
iSharK wrote:Hello Guys,
I want to extract all data from this site.
http://sec.up.nic.in/ElecLive/resultsearch.aspx
But I don't know how to :(
I want complete data from those drop down list options.
Is it possible?

Language: Hindi


Hi iSharK,

You can use some web scraping tools to extract data from drop down list in the web page.

I saw the site and maybe Octoparsehttp://www.octoparse.com/?fo can help you.

@NoraChoi, we are cool on the iMacros Forum, you are allowed to post Links to Competitors of iMacros for the best Help of Users depending on their Needs but if you mention in some other Thread that you can modify the FAQ for Octoparse, don't pretend that you just "saw that Site"... :roll: :shock: (Oops, see EDIT at bottom...!)

Play the Game a bit fairly, willing to help each others, your Terms and Conditions dictate in approx English + Chinese that nearly nobody is allowed to even link to your Site without your Approval (I feel free from that Condition as you came to our Forum and I will provide a Review of your Software, on this Forum as you don't even have an own Forum...), let apart saying anything negative about your Software... (I'm a great Fan of iMacros myself, but I'm the first to bash it when stg is buggy or gets broken or not implemented especially if I've been asking for several years for some Features..., grrr....!!, or even to refer to some other Tool(s) when sbd is hitting some iMacros Limitation...), even if like the Presentation mentions, Octoparse is "the World-Leading Scraping Software" with "Millions of Users all over the World" (next Page on the Site says "tens of thousands", oops, Miracles happen or sbd cannot count...! :shock: )...!

But I would say/think (I might need to check with TechSupport), you are allowed to open your own Thread on the Forum where you can present Octoparse with what you think the Pros and Cons are, compared to iMacros (you may include other Tools as well in your Comparison...), but you don't need to spam all Threads on the iMacros Forum related a little bit to Data-Extraction, with a Link to your Site...
For some kind of "Inspiration", here is some (older/not updated anymore) Page about a Comparison between iMacros and Selenium... (Pity that Wiki Page is not maintained btw...! :cry: )
And do your Presentation/Comparison "properly", no Marketing Bullshit a la "World-Leading Scraping Software" and "Millions of Users all over the World", the iMacros Forum is a Technical Forum..., I will check everything... (and give my Feedback of course in your Thread...!, once I'll have had the time to review your Tool...).
I already qualified Octoparse of "an interesting looking Tool" in some previous Thread where you had already reacted/advertized, and from the fairly quick Look I gave to your Site a few days ago, it indeed contains a few interesting Features (I wonder btw if you'll be able to identify/mention them in your Presentation/Comparison) that would make it worth for the iMacros Developer(s) to have a Look as well and maybe integrate a few into iMacros as well... It already gave me a few Ideas, ah-ah..!, Thanks for that...

Octoparse and iMacros are just 2 among maybe 50 Tools for Data-Extractions/Data-Scrapping, all with their Qualities and strong Features..., and we (= iMacros) (hum, "we" = "they", I'm just an (Advanced) iMacros User and Volunteer helping a bit on the Forum) don't go spamming the 49 "Competitors"..., well 48, because Octoparse doesn't even have a Forum...! :roll:

For this current Thread, what the OP wants can very easily be achieved with iMacros (I would just need a few minutes to get a working Script), I just don't want to give the Solution directly because the OP didn't comply with "my Quality Standards" for "correct Use of the Forum" and I only help Users really getting stuck after they've tried their best / well at least stg...! (I help Users but I don't write their Scripts...)

EDIT:
Hum, mistake on my Side I guess, about "don't pretend that you just "saw that Site"...", I thought you were referring to the Octoparse Site that you would have kind of found by chance, but you mean the Hindi Site the OP wants to extract some Data from..., OK, my mistake..., but "I saw the Site" is a bit vaguely formulated, "I saw your Site" or "I had a look at the/your Site" wouldn't leave any space for any (mis)interpretation...

And hum, the whole "ranting" part of my Reply came from this misinterpretation, but anyway, a Presentation/Comparison of Octoparse/iMacros would still be interesting..., as well as for other similar Tools...
- (F)CIM = (Full) Config Info Missing: iMacros + Browser + OS with all 3 Versions...
- I usually don't even read the Question if that (required) Info is not mentioned...
- Script & URL usually help a lot for a more "educated" Help...
chivracq
 
Posts: 6477
Joined: Sat Apr 13, 2013 6:07 am
Location: Amsterdam (NL)

Re: I need help with the extraction

by janib4all on Tue Jun 07, 2016 1:30 pm

Yes, it's easy with iMacros to fetch all data from mentioned website - checkout for the JS tutorials.
Hire the BoT-fReeak!
botspecialist.blogspot.com
janib4all
 
Posts: 132
Joined: Tue Jul 20, 2010 11:44 pm
Location: Karachi, Sindh, Pakistan


Return to Data Extraction and Web Screen Scraping

Who is online

Users browsing this forum: Majestic-12 [Bot] and 2 guests

-->