Is Your New Website Getting Indexed by Search Engines?
Wednesday, November 4th, 2009You’ve launched a great new website and you’re awaiting patiently for it to be indexed.
You Google. Relentlessly.
Your homepage could be indexed within a week or so. Unfortunately, it’s not uncommon for it to take an entire month (or even two) for the deeper level pages to be indexed.
But if you’re not careful, you’ll never see your website in the search results. Why? It could be a few things…
If you use WordPress
You have an option during development to stop search bots from crawling your site. You should take it. The option is in a small space in a deep corner of your Admin: the privacy settings.
If you use the setting, great; just make sure upon launch, make your site visible!
NoIndex, Nofollow, Robots.txt
Not to get too geeky, but when you check the privacy setting above in WordPress, what you’re doing is adding a robots.txt file and noindexing the site.
However, you don’t need WordPress to do this. You can add a robots.txt file in any website – and there are certain pages you might want to use it for like your Privacy policy.
That being said, don’t nofollow, noindex your entire site after launch…
…or add any pages deeper than the homepage to your robots.txt file. In this case, that little backslash can make a world of difference.
How to make your site index faster
So you’ve launched. You’ve gotten rid of your noindex, nofollow tag and you’re ready to be found. Here are some ways to get found faster:
- Add Google Webmaster Tools. By adding this simple (and down the road, helpful) tool, you’re killing two birds with one stone and also submitting your website to Google.
- Add the Bing Toolbox. Like Webmaster Tools, this automatically submits your website to Bing, along with some other added benefits.
- Create a sitemap and submit it to your Google Webmaster Tools and Bing Toolbox account. While it may not help your site be crawled faster – it will certainly help search engines find those deeper pages a little quicker.
- Get links. Lots and lots of links. The links from quality, established websites you have, the better! Think about it: those websites get crawled on a regular basis, follow a new link to your site and voila! Not to mention…now you have a link to establish expertise.
- Along the same lines, submit to directories.
- Submit yourself on social sites websites like Digg, Reddit, StumbleUpon, etc. Then have friends/colleagues help you go “hot” on those sites.
- Create a presence on Twitter, Facebook, and LinkedIn. Then link to your new website.