It is important to create and optimize the robots.txt to make your Magento store secure and improve SEO.
The robots.txt ("robots dot text") is a text file that help Search engine robots (such as Google bot and Bing bot) to determine which information to index. By default there is no robots.txt in Magento Community or Enterprise distributive so you should create it yourself.
See more
Magento is SEO friendly shop engine that allows you to get more traffic from search engines. However it is very important to configure Magento SEO features correctly from very beginning.
In this article we gathered all default Magento SEO features. Use this article as SEO guide or SEO checklist for every new store you launch, and your Magento will be search engine optimized.
See more