*BSD News Article 82848


Return to BSD News archive

Path: euryale.cc.adfa.oz.au!newshost.carno.net.au!harbinger.cc.monash.edu.au!munnari.OZ.AU!news.ecn.uoknor.edu!feed1.news.erols.com!howland.erols.net!news.sprintlink.net!news-peer.sprintlink.net!news.sprintlink.net!news-hub.sprintlink.net!news.sprintlink.net!news-atl-21.sprintlink.net!node2.frontiernet.net!not-for-mail
From: dsf@node5.frontiernet.net (Dan Foster)
Newsgroups: comp.unix.bsd.freebsd.misc
Subject: Re: ccd help
Date: 14 Nov 1996 18:25:32 -0500
Organization: Frontier Internet, A reliable part of your life
Lines: 45
Message-ID: <56g9pc$seo@node5.frontiernet.net>
References: <3270DC0C.15E4@loopback.com> <328826FB.FF6D5DF@webspan.net> <56er96$us@cantina.clinet.fi> <E0vrxI.I9E@news.interactive.net>
NNTP-Posting-Host: node5.frontiernet.net

In article <E0vrxI.I9E@news.interactive.net>,
Chris Mauritz  <ritz@interactive.net> wrote:

>I get about 4 articles per second.  The limiting factor is
>the speed at which my newsfeeds can hand me articles since
>the machine and the disks are relatively idle.  Average 
>disk seeks (according to iostat) is about 7-7.5ms so I suspect
>this machine is more than capable of trouncing a 7 article/sec
>threshold.  

Yup, that was my impression, too.

The problem may be if you're not using streaming mode to get
articles in/out (as IHAVE is pretty slow when done for every article in
order). I notice that when I don't run streaming mode... I get 4 arts/sec...
when I run with streaming, I get 11 arts/sec. I'm pushing for 15 arts/sec
which may be possible if I can shave 1.2ms off history lookups by reorg'ing
dynamically my history filesystem a bit plus turning off mirroring. We also
don't run RAID 5 (overhead for parity is too big for news).

I must admit that I'm not sure if streaming/non-streaming is an issue with
Cnews or anything other than INN, sorry.

As for optimizing NNRP access... best tip would be to reduce active file to
around 500K (as opposed to 1.2MB - users *noticed* this difference right
away) by carrying only the groups you need/want (ie I carry alt.*, comp.*,
etc... and a few specific groups/hierarchies upon user request).

Anything that means less work for innd (or Cnews or whatever) means more time
to focus on other channels/areas, which may lend itself to a performance boost.
Lots of things you can do.

> I just need to find someone who can shove the
>articles out the door fast enough for me to even remotely
>stress the setup.  If anyone has a stunningly fast news 
>server who'd like to feed me for a few days, I'd be happy
>to add their feed to my current one and post the results.

Email me if you're interested. Our setup uses a IBM SP/2 supercomputer
with SSA disks (80 MB/sec technology) and a lot of patches to innd 1.4unoff4
for performance boosts. Wouldn't mind giving a 7 day feed or something.

-Dan Foster
Frontier Internet
Internet: dsf@frontiernet.net