[Dshield] Test

George A. Theall theall at tifaware.com
Sun Feb 19 20:44:43 GMT 2006


On Sat, Feb 18, 2006 at 11:06:08AM -0500, Tom wrote:

> Anyone know anything about this spider other than its coming from china?
> 
> HTTP_USER_AGENT : hl_ftien_spider
> REMOTE_ADDR : 211.100.29.23

Well, the fact that it checks for a robots.txt file and ignores
restrictions found there has caused me to ban it from web sites I
control. 

George
-- 
theall at tifaware.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 191 bytes
Desc: not available
Url : http://www.dshield.org/pipermail/list/attachments/20060219/f7895ef0/attachment.bin


More information about the list mailing list