May 24th, 2007
Learn To Blog And Earn Money: Wednesday
The Learn to Blog and Earn Money Series continues. I left you with what to do on the first Tuesday of starting a blog. Today, I will cover what you should do on the Wednesday of your first week: Robot Walk-Through.
The best analogy I can think of is being all dressed up and dinner is served waiting for you on the table. There is just one hang up, there is a big Do Not Enter sign on the front door. Similarly, the way Search Engines index your blog is to send little robot crawlers to your site to track what you’ve written and follow the links. You don’t want to block these little guys out of your site with a Do Not Enter sign.
Here are some reasons a robot might not be reaching your landing page and possible ways to fix the problem:
Robots can’t follow your links. A major reason this can happen is having no links from your home page to all of your landing pages (About, Contact, other posts, etc.).
Often, this is an easy fix:
Most, if not all, WordPress templates offer homepages with links to your other landing pages. I recommend for bloggers to make sure that your “category” pages are in your sidebars. This helps with the robot walk-through or the “crawl.”
No stand-alone landing pages. Maybe your site was developed in Flash, in which case it really isn’t a group of individual pages but is one big file that’s hard for the Search Engines to index as separate pages.
Your site asks too much from the visitor. If the President came to visit, you wouldn’t turn him away if he wasn’t wearing the right hat (well, maybe this is a bad example). The idea is you want to treat your spiders in a welcoming way! Some web sites won’t display to a viewer who doesn’t have JavaScript. Guess who doesn’t have JavaScript? The robots! You’ll need to eliminate this from your landing pages.
A server outage interrupted indexing. I’ve talked about the importance of having the proper hosting. I use infinfx, but that’s because I’m having thousands of viewers to my sites. Another cost effective hosting company that handles sites very well with less than 3,000 visitors a day is HostMonster. If you don’t have the right server, then you might have your pages linked and structured properly but the robot might come crawling just at the moment your systems administrator spills his Dr. Pepper soda on the server. What happens here, well the robot finds no site to index. There’s nothing you can do in a situation like this but wait until the next indexing cycle.
Your site is too big. Maybe your landing pages exist alongside thousands of other pages in your site. Robots don’t index every page from every site, so they may simply have moved on before they got to the ones you think are most important.
Quick fix:
Just be sure to add links that place your landing pages no more than two clicks away from the home page.
You told the robots to stay away. That wasn’t very nice of you! Double-check that none of your landing pages has a tag on it that says meta name=”robots” content=”noindex”.
Your site is being penalized. It’s possible, but unlikely, that you are violating a search engine’s guidelines without knowing it. If none of the other problems are striking a chord and you are absolutely sure that your pages are not present in the index, this might be your situation. It’s a tough one. Probably your best bet is to post a note in an SEO forum and see if the community has any suggestions.
Now that you all know what keeps that Do Not Enter sign visible to all the Search Engine robots, let them in and have a feast on your site! The next post of this series will look at Site Text. Stay tuned!!!