[wellylug] spider needed

[Nick Jensen]

Can wget return the wml itself? If so, you could always just extract the 
links yourself...

   Nick


>From: Brenda O'Hagan <brenda at wallace.net.nz>
>Reply-To: wellylug at lists.wellylug.org.nz
>To: wellylug at lists.wellylug.org.nz
>Subject: Re: [wellylug] spider needed
>Date: Tue, 31 Aug 2004 12:30:54 +1200
>
>-----BEGIN PGP SIGNED MESSAGE-----
>Hash: SHA1
>
>unfortunately that won't do
>the pages are the result of ASP scripts running (on windows something)
>and rsyncing the source scripts that produce this isn't what i want
>i need to spider the resulting wapsite..
>
>any other spidering apps?? or is there a way to make wget just spider wml?
>
>
>On Tue, 31 Aug 2004 12:23, jumbophut wrote:
> > On Tue, 31 Aug 2004 11:34:11 +1200, Brenda O'Hagan wrote:
> > > -----BEGIN PGP SIGNED MESSAGE-----
> > > Hash: SHA1
> > >
> > > i need to spider a webstie for an automatic mirroring script.
> > > the site is in wml
> >
> > Sounds like the sort of thing rsync would be ideal for, although the
> > owner of the site to be mirrored would have to open up the file system
> > to you (you can run rsync over ssh to be secure).  It's not a spider,
> > so it doesn't follow links in documents, but it is designed to mirror
> > whole directories recursively, given direct access to the file system.
> >  rsync has to be installed at both ends of the connection.
> >
> > --
> > Tony (echo 'spend!,pocket awide' | sed 'y/acdeikospntw!,
> > /l at omcgtjuba.phi/')
>-----BEGIN PGP SIGNATURE-----
>Version: GnuPG v1.2.5 (GNU/Linux)
>
>iD8DBQFBM8a+KzZ2jVTsMFQRAvcdAJ92rg3d1jZ9QdiAEmk0C8oXyw2B6ACgijhz
>7KSeGfPsjuPLmsNUrOE/q3Q=
>=l434
>-----END PGP SIGNATURE-----
>
>
>--
>Wellington Linux Users Group Mailing List: wellylug at lists.wellylug.org.nz
>To Leave:  http://lists.wellylug.org.nz/mailman/listinfo/wellylug

_________________________________________________________________
Need more speed? Get Xtra JetStream  @ http://xtra.co.nz/jetstream