[CrackMonkey] [dave@farber.net: IP: U.S. DoD [seems to be djf] looking for pro-Sklyarov pages?]
Lukas Eklund
leklund at tastytronic.net
Tue Aug 28 22:47:23 PDT 2001
Quoting Seth David Schoen:
> I'm feeling skeptical. They've indexed a lot of my stuff; I'm not
> sure there's a clear pattern. Couldn't it just be an ordinary search
> engine?
I'd have to agree. But it is weird how it doesn't index entire sites.
For example, on rfk.org it only tried to get robots.txt (which doesn't
exist) and nothing else. Of course that could be due the crazy <pre>
tag layout of the site come to think of it. Although the googlebot
made quick work of the site about 90 minutes ago.
end ramble
--
lukas | SELF-EVIDENT, adj. Evident to one's self and to nobody else.
eklund | -- Ambrose Bierce
More information about the Crackmonkey
mailing list