LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 05-09-2006, 10:20 PM   #1
mpm42
LQ Newbie
 
Registered: Apr 2006
Posts: 2

Rep: Reputation: 0
Internet Programming?


Hi,

I am looking to do some major data mining on the web.
Here's my basic flow:
-Enter in some data
-'click' next
-save web page
-repeat

Is there a programming language that would allow me to mechanize this process?

Thank you,
-Matt
 
Old 05-09-2006, 11:01 PM   #2
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Ubuntu 12.04, Antix19.3
Posts: 3,794

Rep: Reputation: 282Reputation: 282Reputation: 282
So you are looking for a program where the user enters some data which will be published on a webserver as an HTML page so others can view it as a webpage?

If so, I don't know if a program like that exists, but you can create such a program in any programming/scripting language.
 
Old 05-09-2006, 11:25 PM   #3
mpm42
LQ Newbie
 
Registered: Apr 2006
Posts: 2

Original Poster
Rep: Reputation: 0
Thanks for the reply Wim.

No, that's not what I was going for.
Let me try to explain better:

There's a large database of information I need.
This entails typing in monotonous information (I have in a file).
I enter the data into a web site and then get routed to a another web site that contains a table of data I want.
I would like to then save this web page to my hard drive for later usage.
I am trying to expedite this process so I don't spend all day long typing very similar data over and over again... it seems like a program should be able to do this but I don't have any experience with web programming.

I have experience in C and perl, do you think I could do this in one of those languages?

Thanks,
-Matt
 
Old 05-09-2006, 11:45 PM   #4
chrism01
LQ Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Rocky 9.2
Posts: 18,358

Rep: Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751
I'm still not clear if you're putting data in or taking it out...
If the former, then you've got the file already...
If the latter, do you mean you have a file with lists of params (ie records) to enter into a web page that is a CGI page that then responds with the 'requested' info for each set?
If so, you prob wanr Perl WWW::Mechanize http://search.cpan.org/~petdance/WWW...W/Mechanize.pm
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Difference between Userland programming and Kernel Programming.. meetsagittarian Programming 1 02-20-2006 12:26 AM
Difference between Top Down programming & Bottom up programming minil Programming 1 06-17-2005 02:42 AM
networking / internet / programming zeadriche Programming 3 02-04-2005 03:45 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 04:42 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration