Return to BSD News archive
From: BORKI@zug.use.ch (Reto Burkhalter) Subject: Re: "webcrawler" for freebsd Message-ID: <xnf$nMD4F99aLz3@borki.zug.use.ch> Date: Sat, 18 May 96 12:50:47 GMT Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!nntp.coast.net!oleane!jussieu.fr!univ-lyon1.fr!in2p3.fr!swidir.switch.ch!scsing.switch.ch!dino.active.ch!hp.use.ch!turicum.use.ch!zug.use.ch Organization: Turicum Communications References: <4muqec$921@golden.pvrr.ru> <4nh3l5$ldc@golden.pvrr.ru> X-Gateway: ZCONNECT UE turicum.use.ch [PolyNet Amiga RFC/ZC V4.23 no. 599198gr45qW-017] X-Mailer: MicroDot 1.10 [REGISTERED 004f99] Newsgroups: comp.unix.bsd.freebsd.misc MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Lines: 44 >> Oleg 'Jareth' >> 17.05.1996 OB> : OB> : I'm looking for a program that can search the web OB> : OB> : for me (in order to fill the proxy server). ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ I HAVE installed cached... (I think eyerone has missunderstood me, I have instlled cached 1.4pl3 !!!) OB> : OB> : The program should start at my homepage an grab OB> : OB> : the WWW 3 or 4 stages deep. ... and now I'm looking for a program, that can independently browse the web and collect files in order to feed the proxy. OB> : I have installed harvest from the FreeBSD ports collection OB> : and printed out the postscript manual and haven't OB> : found anything about what I'm looking for... ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ OB> : As you know, the FreeBSD ports does not consist OB> : of the broker, gatherer, .. There's only OB> : the object cache... OB> : OB> : Further Information? about the "webcrawler"... OB> 1. go tp http://www.yahoo.com OB> 2. Search for harvest home page OB> 3. get sources for everything.. AFAIK, last version is 1.4pl2 no, 1.4pl3. CUl8er, Reto