Dismiss Notice
Hey Guest, make sure to follow us on Twitter! Say hi and we'll be sure to follow back!

Does our robots.txt look correct?

Discussion in 'Magento Support' started by nightmare99, Apr 30, 2015.

  1. nightmare99

    nightmare99 UKBF Regular Free Member

    Posts: 192 Likes: 31
    As per the title really, does the below robots.txt look ok for a magento store?

     
    Posted: Apr 30, 2015 By: nightmare99 Member since: Jan 31, 2011
    #1
  2. Cameron Ziafat

    Cameron Ziafat eCommerce Specialist Full Member - Verified Business

    Posts: 98 Likes: 19
  3. AntoineR

    AntoineR UKBF Newcomer Free Member

    Posts: 7 Likes: 2
    1) These lines can forbid indexing your products and categories (tested) :) :
    Disallow: /catalog/category/view/
    Disallow: /catalog/product/view/

    I would recommend to remove them for sure.

    2) Why do you disallow this Disallow: /catalog/product/gallery/?
    3) Do you need to allow the checkout? Why?
    #Disallow: /checkout/
     
    Posted: May 4, 2015 By: AntoineR Member since: Mar 10, 2015
    #3
  4. Harry.D88

    Harry.D88 UKBF Newcomer Free Member

    Posts: 6 Likes: 0
    I think it's good :) But I think you should change something:
    User-agent: *
     
    Posted: May 28, 2015 By: Harry.D88 Member since: May 28, 2015
    #4
  5. Infigic

    Infigic UKBF Newcomer Free Member

    Posts: 3 Likes: 0
    yes It' s looking fine, but i think you need to change #Disallow: /checkout/
     
    Posted: Dec 30, 2016 By: Infigic Member since: Dec 30, 2016
    #5
  6. Freshwebservices

    Freshwebservices UKBF Contributor Free Member

    Posts: 41 Likes: 7
    Posted: Jan 3, 2017 By: Freshwebservices Member since: Jul 30, 2007
    #6