Directory
Encyclopedia
Basic Search Help
Advanced Search
About
Silk our Crawler
Add URL
Toolbar
Slider Google Button
|
|
|
|
Silk - Slider.com Crawler
Slider Silk is the name of our crawler. It is currently indexing all sites part of the DMOZ directory to create a fulltext search index.
Silk User Agent
Silk identifies itself by the user agent string:
Silk/1.0 (+https://www.slider.com/silk.htm)
Report a Problem
If you have experienced any problems with our crawler, please Contact Us.
Please note that Silk adheres to the robots.txt standard.
|