Re: Extracting Data From a Web Site

2002-12-09 Thread R P Herrold
On Mon, 9 Dec 2002, Anthony E. Greene wrote: > I don't think you can use lynx from cron; it needs a controlling terminal. export TERM=linux ; /usr/bin/lynx -dump \ http://www.whatever.com > /tmp/whatever-dump.txt works fine in cron, and will extract data from a remote websit

Re: Extracting Data From a Web Site

2002-12-09 Thread Saul Arias
On Mon, 2002-12-09 at 21:03, Anthony E. Greene wrote: > I don't think you can use lynx from cron; it needs a controlling terminal. I have a Perl script that I run from cron. It's not pretty (I know almost nothing about Perl); it just works. It's something like this: #!/usr/bin/perl -w use strict

Re: Extracting Data From a Web Site

2002-12-09 Thread Anthony E. Greene
On 09-Dec-2002/12:16 -0800, "Todd A. Jacobs" <[EMAIL PROTECTED]> wrote: >On 9 Dec 2002, Joe Giles wrote: > >> I want to grab the data from that page (Which is plain text) and dump it >> into another text document not located on the same server. I would like >> to do this from a cron job if possible

Re: Extracting Data From a Web Site

2002-12-09 Thread Todd A. Jacobs
On 9 Dec 2002, Joe Giles wrote: > I want to grab the data from that page (Which is plain text) and dump it > into another text document not located on the same server. I would like > to do this from a cron job if possible. wget, lynx, and curl will all do this in some fashion or other (see the r

Re: Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
Probably a good idea anyway. This way I can learn more :) Thanks for the information Joe On Mon, 2002-12-09 at 10:46, Vidiot wrote: > >Any examples you could give for extracting the data? I'm not that savvy > >on programming :-P > >Joe > > That question is SO open ended. > > I have no idea wh

Re: Extracting Data From a Web Site

2002-12-09 Thread Vidiot
>Any examples you could give for extracting the data? I'm not that savvy >on programming :-P >Joe That question is SO open ended. I have no idea what the web pages look like. It is probably going to require that you do get savvy with scripting, be it sed, awk, sh or perl. MB -- e-mail: [EMAIL

Re: Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
Hay, now your talking :-P... That works great so far. Thanks On Mon, 2002-12-09 at 10:31, Michael Schwendt wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 09 Dec 2002 10:01:06 -0700, Joe Giles wrote: > > > I have been tasked with grabbing various internal websites that have >

Re: Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
Any examples you could give for extracting the data? I'm not that savvy on programming :-P Thanks Joe On Mon, 2002-12-09 at 10:20, Vidiot wrote: > >I have been tasked with grabbing various internal websites that have > >basic text data on them and grabbing and storing that data in another > >tex

Re: Extracting Data From a Web Site

2002-12-09 Thread Michael Schwendt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09 Dec 2002 10:01:06 -0700, Joe Giles wrote: > I have been tasked with grabbing various internal websites that have > basic text data on them and grabbing and storing that data in another > text file without opening up the web page itself. Make sen

Re: Extracting Data From a Web Site

2002-12-09 Thread Vidiot
>I have been tasked with grabbing various internal websites that have >basic text data on them and grabbing and storing that data in another >text file without opening up the web page itself. Make sense? Example. > >www.myinternalwebsite.com has a location called deployment_packages.htm. >I want t

Re: Extracting Data From a Web Site

2002-12-09 Thread Ed Wilts
On Mon, Dec 09, 2002 at 10:01:06AM -0700, Joe Giles wrote: > > I have been tasked with grabbing various internal websites that have > basic text data on them and grabbing and storing that data in another > text file without opening up the web page itself. Make sense? Example. Have a look at wget

Extracting Data From a Web Site

2002-12-09 Thread Joe Giles
List, I have been tasked with grabbing various internal websites that have basic text data on them and grabbing and storing that data in another text file without opening up the web page itself. Make sense? Example. www.myinternalwebsite.com has a location called deployment_packages.htm. I want