Just seconds after registering, your web site can be searchable with the features
you want and reliability you need. No software to install or maintenance required. Search
results can match your website design seamlessly.
Why didn't Spiderline crawl documents on other sites that I linked to?
Check your URL Configuration Patterns. In order to make documents on other websites searchable, but only the documents you link to and not the entire other website, enter "/ INDEX NOFOLLOW" on...
(No rating)
2005-01-20
Views: 3850
Can Spiderline index ASP sites?
Yes, Spiderline can index ASP, PHP, JSP, CFM, MPE, and any other dynamically produced HTML.
(No rating)
2005-01-19
Views: 6252
Does NOINDEX keep documents from being counted?
Yes, if the NOINDEX and page or directory is in the URL patterns, this is because the document is avoided by the crawler.
No, if the pages are being ommited by Robot Meta-tags, this is becuase...
(No rating)
2005-06-27
Views: 4810
Print