Return to BSD News archive
#! rnews 1763 bsd
Newsgroups: comp.unix.bsd.bsdi.misc
Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!news.mel.connect.com.au!munnari.OZ.AU!news.hawaii.edu!ames!hookup!news.mathworks.com!uunet!in2.uu.net!news.sa.gov.au!murdoch.systems.sa.gov.au!not-for-mail
From: garth@pisces.systems.sa.gov.au
Subject: Re: Argh! BSDI/News Problem... help kindly requested
Message-ID: <1117cc$e262c.50@murdoch.systems.sa.gov.au>
Date: Wed, 17 Jan 1996 05:23:18 GMT
References: <30f54d00.11463334@news>
X-Newsreader: Forte Free Agent 1.0.82
Lines: 28
> I'm receiving news at about 100msgs/160sec, and my provider says I
> should be receiving more... much more! My feed should be about 100,000
> msgs/day, or so they say. However, at the speed I'm bringing them in,
> I never catch up. In fact, doing the math results in me getting about
> 54,000 per day.
>
> The question: WHY?!
It might be your link speed -- squeezing 100,000 articles a day down a 64k
link is pretty difficult. If it's not that, it's latency. Each time your
feed sends you an IHAVE, your server spends time looking in its history
database for the message-id. Even fast lookups are sometimes just too slow.
There are only 84k seconds in a day. You don't want to spend any more than
you have to looking things up.
The solution we're using here is to have our feed deliver us multiple feeds.
They have us set up in their newsfeeds file multiple times, each feed with a
different set of groups. This gives us, in effect, 4x as much time to waste
looking up message-ids.
--
garth@pisces.systems.sa.gov.au | Garth Kidd
+61-8-207-7740 (voice) | Internet Consultant
+61-8-207-7860 (fax) | Southern Systems
| Adelaide, AUSTRALIA