*BSD News Article 72055


Return to BSD News archive

Path: euryale.cc.adfa.oz.au!newshost.anu.edu.au!harbinger.cc.monash.edu.au!news.rmit.EDU.AU!news.unimelb.EDU.AU!munnari.OZ.AU!news.ecn.uoknor.edu!news.ysu.edu!usenet.ins.cwru.edu!nerd.apk.net!sed.psrw.com!psinntp	!psinntp!howland.reston.ans.net!gatech!news.mathworks.com!uunet!inXS.uu.net!news.fido.net!dispatch.news.demon.net!demon!mail2news.demon.co.uk!mauve.demon.co.uk
From: Ian Stirling <root@mauve.demon.co.uk>
Newsgroups: demon.ip.support,demon.tech.unix,comp.unix.bsd.freebsd.misc
Subject: Re: Batch FTP and Web Pages
Followup-To: demon.ip.support,demon.tech.unix,comp.unix.bsd.freebsd.misc
Date: Wed, 26 Jun 1996 18:21:14 GMT
Lines: 57
Message-ID: <199606261821.SAA02204@mauve.demon.co.uk>
References: <31c2e7bd.14691630@news.demon.co.uk> <834878464snz@pair.com> <834921960snz@michaels.demon.co.uk> <835206024.5881.2@diltd.demon.co.uk> <slrn4sgtd6.ds.dom@myrddin.demon.co.uk> <835294223.22071.1@diltd.demon.co.uk> <slrn4sjj16.cs.dom@myrddin.demon.co.uk>
X-NNTP-Posting-Host: mauve.demon.co.uk
X-Newsreader: TIN [version 1.2 PL2]
X-Mail2News-Path: disperse.demon.co.uk!post.demon.co.uk!mauve.demon.co.uk

Dominic Mitchell (dom@myrddin.demon.co.uk) wrote:
: On Thu, 20 Jun 1996 18:10:20 GMT, Ric Harwood <ric@diltd.demon.co.uk> wrote:
: > Hi Dom, {:^)
: >
: > In demon.ip.support, dom@myrddin.demon.co.uk (Dominic Mitchell),
: > Dominic Mitchell wrote:
: >
: > >What exactly do you mean by batch http?
: >
: > As batch ftp. We send an email to ftp@demon.net containing  the ftp
: > URL of the file required. Multiple retrevals can be retreieved by
: > putting each url on a new line. Then I can log on to ftp.demon as
: > diltd rather than anonymously and ftp the file. A local example,
: > would be that I could get:
: > ftp://area51.upsu.plym.ac.uk/pub/docs/hackers/hacker.definitions
: > by batch ftp, but not:
: > http://area51.upsu.plym.ac.uk/~ric/files/flame.txt
: >
: > Obviously no big advantge for those two anyway, but for sites in the
: > US the time saving is often large.

Or makes it possible to get at all, site in US, wanted to download a 1.7Mb
PDF file, took 1 min to download 20K, and died between 20 and 40K most
times, Assuming a possibility of 1/2 that it'll fall over at 30K,
it'd likely take 2^60 attempts or so, about 10^20 attempts, which at
1000 attempts a day would take rather longer to download than my phone budget
allows :)
A www-server that could do reget, or restart or whatever would
be very usefull, can such a thing exist?



: OK, that shouldn't be too hard to do in itself, but what would you
: want done with inline images, for example?  Just ignore them (easy)
: or retrieve them as well (less easy, have to parse HTML).

: > >If so, then there was a package recently announced (past month) on
: > >comp.os.linux.announce which used the lynx browser to do just such a
: > >thing.
: >
: > When I get my ppp working... {;^)

: If you follow the slack-3.0.tar.gz file from ftp.demon.co.uk, you
: shouldn't have too many problems, just takes a little while to get your
: head round it all.

: -Dom


--
Ian Stirling.                        | I have a web page, but it's only
AKA Caeser, Bolonewbie.              | accessible by local users :(
| which sort of makes it less usefull :)

Two fish in a tank: one says to the other, do you know how to drive this
thing?