Spider Specifications

Administration

Administrator
Mar 24, 2002
178
1
18
Montreal
RoboCrawl Spider
Name RoboCrawl Spider
Cover Page http://www.canadiancontent.net/
Details Page http://www.canadiancontent.net/corp/spider.html
Operational Status active
Description The Canadian Content robot indexes for it's search database.
Robot Purpose indexing
Software Type standalone
Software Platform linux
Software Language C and C++
Availability none
Owner's Name Canadian Content Interactive Media
Owner's Home Page http://www.canadiancontent.net/
Owner's Email Address staff@canadiancontent.net
Exclusion Protocol yes
Exclusion Tag RoboCrawl
Supports NOINDEX yes

Robot Host ncc.canadiancontent.net, ncc.air-net.no, canadiancontent.net, spider.canadiancontent.net
HTTP From no
HTTP User-Agent RoboCrawl (http://www.canadiancontent.net)
History Our robot is a newer project at Canadian Content.
Environment service
Identifier robocrawl
Updated July 30th, 2001
Update By Christopher Walsh and Adam Rutter