Re: Extracting Data From a Web Site

2002-12-09 Thread R P Herrold
On Mon, 9 Dec 2002, Anthony E. Greene wrote: > I don't think you can use lynx from cron; it needs a controlling terminal. export TERM=linux ; /usr/bin/lynx -dump \ http://www.whatever.com > /tmp/whatever-dump.txt works fine in cron, and will extract data from a remote websit

Re: Extracting Data From a Web Site

2002-12-09 Thread Saul Arias
On Mon, 2002-12-09 at 21:03, Anthony E. Greene wrote: > I don't think you can use lynx from cron; it needs a controlling terminal. I have a Perl script that I run from cron. It's not pretty (I know almost nothing about Perl); it just works. It's something like this: #!/usr/bin/perl -w use strict

Re: Extracting Data From a Web Site

2002-12-09 Thread Anthony E. Greene
On 09-Dec-2002/12:16 -0800, "Todd A. Jacobs" <[EMAIL PROTECTED]> wrote: >On 9 Dec 2002, Joe Giles wrote: > >> I want to grab the data from that page (Which is plain text) and dump it >> into another text document not located on the same server. I would like >> to do this from a cron job if possible

Re: Extracting Data From a Web Site

2002-12-09 Thread Todd A. Jacobs
On 9 Dec 2002, Joe Giles wrote: > I want to grab the data from that page (Which is plain text) and dump it > into another text document not located on the same server. I would like > to do this from a cron job if possible. wget, lynx, and curl will all do this in some fashion or other (see the r

Re: Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
Probably a good idea anyway. This way I can learn more :) Thanks for the information Joe On Mon, 2002-12-09 at 10:46, Vidiot wrote: > >Any examples you could give for extracting the data? I'm not that savvy > >on programming :-P > >Joe > > That question is SO open ended. > > I have no idea wh

Re: Extracting Data From a Web Site

2002-12-09 Thread Vidiot
>Any examples you could give for extracting the data? I'm not that savvy >on programming :-P >Joe That question is SO open ended. I have no idea what the web pages look like. It is probably going to require that you do get savvy with scripting, be it sed, awk, sh or perl. MB -- e-mail: [EMAIL

Re: Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
Hay, now your talking :-P... That works great so far. Thanks On Mon, 2002-12-09 at 10:31, Michael Schwendt wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 09 Dec 2002 10:01:06 -0700, Joe Giles wrote: > > > I have been tasked with grabbing various internal websites that have >

Re: Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
Any examples you could give for extracting the data? I'm not that savvy on programming :-P Thanks Joe On Mon, 2002-12-09 at 10:20, Vidiot wrote: > >I have been tasked with grabbing various internal websites that have > >basic text data on them and grabbing and storing that data in another > >tex

Re: Extracting Data From a Web Site

2002-12-09 Thread Michael Schwendt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09 Dec 2002 10:01:06 -0700, Joe Giles wrote: > I have been tasked with grabbing various internal websites that have > basic text data on them and grabbing and storing that data in another > text file without opening up the web page itself. Make sen

Re: Extracting Data From a Web Site

2002-12-09 Thread Vidiot
>I have been tasked with grabbing various internal websites that have >basic text data on them and grabbing and storing that data in another >text file without opening up the web page itself. Make sense? Example. > >www.myinternalwebsite.com has a location called deployment_packages.htm. >I want t

Re: Extracting Data From a Web Site

2002-12-09 Thread Ed Wilts
On Mon, Dec 09, 2002 at 10:01:06AM -0700, Joe Giles wrote: > > I have been tasked with grabbing various internal websites that have > basic text data on them and grabbing and storing that data in another > text file without opening up the web page itself. Make sense? Example. Have a look at wget