Tag : robot.txt file

How To Allow Only Google Yahoo MSN bots

For getting index fast in various kind of search engine it’s very important to allow them in your website. Today we are going to learn how to allow them with just few lines of code.Lets get started- Open a robot.txt file and write followint code. This code allow only google, yahoo, msn bots crawling of your web contents. You need [...]