Begin3
Title:          SpiderBot-060.tgz
Version:        1.60.004
Entered-date:   26-2-1999
Description: 	A robots set wroted in c to download web pages 
		Also, it can modified links to offline browsing.
		:
                :....... How to use : 
                    :
                    : For example, to download 2MBytes (2097152 bytes)
                    : from www.linux.org :
                    :
                    %gzip -d SpiderBot.tgz
                    %tar xf SpiderBot.tar
                    %cd Web_Utilities
                    %make -f Makefile.linux
                    %make -f Makefile.linux install
                    %mkdir /tmp/sites
                    %cd    /tmp/sites
                    %~/bin/wcopy -url www.linux.org -maxbytes 2097152 -makequery
                    :
                    : If any problem stop robot, kill robot and start again
                    : at point where robot stop :
                    :
                    %~/bin/wcopy -resume resume.www.linux.org -maxbytes 30000000
                    :
                    : And finally, if you want local urls, use
                    : mklocal to translate '/icons/go.xmp' to 
                    : '....../www.linux.org/icons/go.xmp'
                    :
                    %~/bin/mklocal.exe -dir www.linux.org -skipbin
                    :
                    :
Keywords:       www robot bot retrieval Internet http proxy url mirror
Author: 	acaldero@laurel.datsi.fi.upm.es (Alejandro Calderon Mateos)
Maintained-by:	acaldero@laurel.datsi.fi.upm.es
Primary-site: 	sunsite.unc.edu /pub/systems/Linux/apps/www/mirroring/
                SpiderBot-060.lsm    1887 
                SpiderBot-060.tgz    234524
Original-site:  http://laurel.datsi.fi.upm.es/%7Eacaldero/publico.html
Platforms: 	Linux SunOS
Copying-policy: GPL
End