[wellylug] spider needed

[Brenda O'Hagan]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


i need to spider a webstie for an automatic mirroring script.
the site is in wml

wget only spiders html or ftp site - it doesn't follow links in a wml page.
the curl man page doesn't mention and spidering
what other choices do i have?
can anyone recommend a spidering application for linux, preferably open 
source..

thanks
- --Brenda
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.5 (GNU/Linux)

iD8DBQFBM7l2KzZ2jVTsMFQRAljzAJ98CutJg3AJV1yiuUqLB2Jd2bZrfACeOnkA
Gw5f6BzrKYvmP9kii3vQI2w=
=6CVc
-----END PGP SIGNATURE-----