We decided to include a forum for questions, complaints, comments about our spider, RoboCrawl.
You can find additional details about our spider at http://www.robotstxt.org/wc/active/html/robocrawl.html .
You may submit your URL at the following address: http://www.canadiancontent.net/corp/suggest.html .
The spider follows the robots.txt standard and the Meta tags specifying additional instructions.
You can find additional details about our spider at http://www.robotstxt.org/wc/active/html/robocrawl.html .
You may submit your URL at the following address: http://www.canadiancontent.net/corp/suggest.html .
The spider follows the robots.txt standard and the Meta tags specifying additional instructions.