Neep help with automating downloading text from webpages.

October 27, 2012 at 20:35:22
Specs: Windows Vista
I need some guidance on how to automate the downloading of TONS of information from a webpage... I need the information on the following website organized into this format:
question1,answer1;question2,answer2;question3,answer3;
etc.

http://quizbowldb.com/search
NOTE: To get all the information on that webpage, you have to click "search"

I could probably figure it out on my own if the information wasn't divided into groups of 15 on separate pages that are linked by "next" and "previous" buttons.
Because of that I have no idea how to tackle this one.
Thanks in advance


See More: Neep help with automating downloading text from webpages.

Report •

#1
October 27, 2012 at 21:44:51
you might be able to use wget. google on "wget windows". It's free.

Report •

#2
October 28, 2012 at 05:09:15
Hi , i have several ideas...one is telnet...other is setup an macro, that makes the following: copy all - paste somewhere - change page - copy all - paste somewhere - change page.
A simple and nice program to create macros is MacroWizard , you can get any other, run the macro in a VM to you be able to use your computer wile the macro is running, telnet is good too but...i can try to code a script that download all the info by telnet but now im running out of time and with the telnet solution with an automatic proccess you will be not able to use your computer wile its running so... See if the macro solucion is good for you

Report •
Related Solutions


Ask Question