snareshiver
15th February 2010, 05:47
Hi,
I have added a canonical Tag in the Homepage to avoid crawling of Session ids.
But recently, we added a Article page with the following url
Myhomepage/ArticleControl.do?parameter=getArticleList
The above link is restricted in Robots.txt file. Please tell for what reason the url is restricted in robots file.
I have added a canonical Tag in the Homepage to avoid crawling of Session ids.
But recently, we added a Article page with the following url
Myhomepage/ArticleControl.do?parameter=getArticleList
The above link is restricted in Robots.txt file. Please tell for what reason the url is restricted in robots file.