If you are concerned about the privacy of your website and you do not want the search engine crawlers or bots to crawl certain pages of your website, then "Robots.txt" is the one-stop solution that will keep the crawlers away from the 'No Entry' zone.
Confused? Probably, you are wondering about the need of keeping the search engine bots away from the pages, when everyone wants their website to be indexed in the search engines. True!
Comments Off
Whether you own a small three page hobbyist website or a monster E-commerce store there are several things you can check to ensure you are not placing any barriers in the way of your search engine optimisation campaign. Below you will find the 5 most commonly checked areas when a website is critiqued by an outsider. Any webmaster has the ability to check these and, depending on your content management system, you should be able to...
*This short but very useful tip was submitted by Charly Wargnier.* When doing SEO changes for large scale companies, implementing a proper robot.txt is crucial. I will not go back to the robot.txt definition bla, bla… millions have done that before me. No, instead, just a simple formula to use whenever the geek inside you has a Robot.txt Writer’s block! So, type “inurl:robots.txt filetype:txt” and, ta-daa! See what the big names are doing. You will find the robots.txt...
*The guest tip is by Umair Asif* There are times when we would like Google and other search engines to completely remove a URL from search engine results. These would be incidents like accidentally leaving personal information on the web page or website being bombarded with spammers, etc. In these critical moments, webmasters can take several actions to remove the URL of a page but with so many alternatives, it sometimes...
It may be not a frequent situation but it may happen so that you need to remove a page from Google SERPs really fast. What's the best way to do that?
Try this:
Exclude the page in Robots.txt + remove the pages using the URL removal tool in Webmaster Tools.
Return 410 status code for the page (to show the page is gone for ever);
Don't do this:
7 Comments
More and more people are searching for images over the Internet. This results into tons of untargeted traffic that means more spam, more pain for servers and no benefit at all. The thing is most popular search engines (including Google) is text-based. It won't know that your image is about flowers if you call it apple.jpg, use "apple" in the alt text or just tell something about apples in the text located near the image. Therefore there...
There are two main reasons why you would want to hide your affiliate links from Google: They "leak" link juice; They say, Google hates affiliate links because they show to Google that the site's content is "second-hand" So, we are running into the dilemma here: we want to monetize Google traffic and we don't want to risk our reputation. Two main strategies to use are (note: to avoid link juice leak, the combination of these strategies...
