Return to BSD News archive
#! rnews 1763 bsd Newsgroups: comp.unix.bsd.bsdi.misc Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!news.mel.connect.com.au!munnari.OZ.AU!news.hawaii.edu!ames!hookup!news.mathworks.com!uunet!in2.uu.net!news.sa.gov.au!murdoch.systems.sa.gov.au!not-for-mail From: garth@pisces.systems.sa.gov.au Subject: Re: Argh! BSDI/News Problem... help kindly requested Message-ID: <1117cc$e262c.50@murdoch.systems.sa.gov.au> Date: Wed, 17 Jan 1996 05:23:18 GMT References: <30f54d00.11463334@news> X-Newsreader: Forte Free Agent 1.0.82 Lines: 28 > I'm receiving news at about 100msgs/160sec, and my provider says I > should be receiving more... much more! My feed should be about 100,000 > msgs/day, or so they say. However, at the speed I'm bringing them in, > I never catch up. In fact, doing the math results in me getting about > 54,000 per day. > > The question: WHY?! It might be your link speed -- squeezing 100,000 articles a day down a 64k link is pretty difficult. If it's not that, it's latency. Each time your feed sends you an IHAVE, your server spends time looking in its history database for the message-id. Even fast lookups are sometimes just too slow. There are only 84k seconds in a day. You don't want to spend any more than you have to looking things up. The solution we're using here is to have our feed deliver us multiple feeds. They have us set up in their newsfeeds file multiple times, each feed with a different set of groups. This gives us, in effect, 4x as much time to waste looking up message-ids. -- garth@pisces.systems.sa.gov.au | Garth Kidd +61-8-207-7740 (voice) | Internet Consultant +61-8-207-7860 (fax) | Southern Systems | Adelaide, AUSTRALIA