Re: Alta Vista

Sander Vesik (sander@HALDJAS.FOLKLORE.EE)
Wed, 13 Mar 1996 11:07:19 +0200

On Tue, 12 Mar 1996, Taylor wrote:

> Also sprach 'Alexander Chislenko' :
>
> >It's not quite like Big Brother - it doesn't punish you for things that
> >it find out about you - it just leaves the punishment to others ;-)
>
> It's more like a tool to make us all Big Brother.
>
> >Also, if you do not want your pages catalogued by Alta Vista or any other
> >spider, just indicate it in the "robots.txt" file.
> >The biggest spiders are polite creatures, and they all respect the
> >"robot exclusion protocol".

It does not matter, whetever the spider accepts the robot exclusion file
or not... The fact is that deep, deep, indeed very deep near the roots of
the Earth there is a little thing called the Web server configuration
file. Now, if you have got a decent one (like the Cern httpd 3.0) there
is that feature called URL protection. You can tell, who can read your
files and who not - just tell it that no machine from the .gov and .mil
domains should not be able to read your Web page and they wont. They may, of
course walk over to another computer. But the web spiders don't walk
from one machine to the other, they call from the same one (or same ones).

> True, but much of the information I get back I think should be cataloged.
> The scary thing is really the ease that one can assemble a profile on an
> individual. Not that I think the public shouldn't have the ability to do
> that. Large corporations certainly do, the government certainly does. But
> more and more I think that author David Brin was right in his assesment
> that privacy is an outdated concept.
>
> ----------------------------------------------------------------------------
> You need to lurk. L - U - R - K Lurk
> ---------------------------------------------the ouija to lauri anderson----
> taylor@taylor.org
>