Stop search engine robots indexing Your private folders by ‘robots.txt’.
May 16 2009
Posted by Webmasters-central.com in Search engine Marketing |
What is ‘robots.txt’ file?
You have private folders and membership areas on your website? Then you need this ‘robots.txt’ to stop the search engines to crawl in to your private folders. Once the search engines crawl in to your private folders, they are going to be indexed in the search engine results.
Robots.txt is a simple text [...]
Categories
Most popular
- Cron Tutorial – Managing cron tab or cron job is Easy! - 21,975 views
- Installing ioncube loaders on Godaddy hosting. - 9,691 views
- What is a subdomain? How to create a subdomain? - 5,803 views
- Domain name basics. - 2,325 views
- How to know whether cron is working or not? - 1,265 views
- How to get Server path or script path to a file? - 1,264 views
- Article submission sites – Submit your articles to these web sites. - 1,122 views
- Anchor text? How to Optimize it? - 1,038 views