Return to BSD News archive
From: BORKI@zug.use.ch (Reto Burkhalter)
Subject: Re: "webcrawler" for freebsd
Message-ID: <xnf$nMD4F99aLz3@borki.zug.use.ch>
Date: Sat, 18 May 96 12:50:47 GMT
Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!nntp.coast.net!oleane!jussieu.fr!univ-lyon1.fr!in2p3.fr!swidir.switch.ch!scsing.switch.ch!dino.active.ch!hp.use.ch!turicum.use.ch!zug.use.ch
Organization: Turicum Communications
References: <4muqec$921@golden.pvrr.ru> <4nh3l5$ldc@golden.pvrr.ru>
X-Gateway: ZCONNECT UE turicum.use.ch [PolyNet Amiga RFC/ZC V4.23 no. 599198gr45qW-017]
X-Mailer: MicroDot 1.10 [REGISTERED 004f99]
Newsgroups: comp.unix.bsd.freebsd.misc
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
Lines: 44
>> Oleg 'Jareth'
>> 17.05.1996
OB> : OB> : I'm looking for a program that can search the web
OB> : OB> : for me (in order to fill the proxy server).
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
I HAVE installed cached... (I think eyerone has missunderstood
me, I have instlled cached 1.4pl3 !!!)
OB> : OB> : The program should start at my homepage an grab
OB> : OB> : the WWW 3 or 4 stages deep.
... and now I'm looking for a program, that can independently
browse the web and collect files in order to feed the proxy.
OB> : I have installed harvest from the FreeBSD ports collection
OB> : and printed out the postscript manual and haven't
OB> : found anything about what I'm looking for...
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OB> : As you know, the FreeBSD ports does not consist
OB> : of the broker, gatherer, .. There's only
OB> : the object cache...
OB> :
OB> : Further Information?
about the "webcrawler"...
OB> 1. go tp http://www.yahoo.com
OB> 2. Search for harvest home page
OB> 3. get sources for everything.. AFAIK, last version is 1.4pl2
no, 1.4pl3.
CUl8er,
Reto