The Internet in Japan

If your site isn’t found in the search engines, it is probably because the robots couldn’t deal with it. It could be something as simple as not being able to find the site, or it may be more complicated issues involving the robot’s not being able to crawl the site or figure out what your pages are all about.Submitting your site to the major search engines: that will help with the “can’t find it” problem. Even having links pointing back to your site can be enough to attract the search engine robots. Google, for example, suggests that you may not have to submit your pages; they will find your site if you have a link pointing back to it from at least one other site on the web. If the robots can find your site but can’t make sense of it, then you may need to look at the content and technology used on your pages. Frames, Flash, dynamically generated pages, and invalid HTML source code can cause problems when the search engine robot tries to access your web pages. While some search engines are beginning to be able to index dynamically generated pages and Flash (e.g. Google and AllTheWeb), use of some of these technologies can hinder your ability to be indexed by the search engine robots. Text in images cannot be read by the search engine robots.Using ALT image text is an important way to help the robots “read” your images. Websites with extensive images rely heavily on ALT text to present their content.

How Do I Get The Most Out Of Indexing?

If you know what to “feed” the spidering robots you will help yourself with search engine ranking. Having a website full of good content is the major factor. Search engines exist to serve their visitors, not to rank your website. You need to be sure to present yourself in your site in the way that will be most useful to the search engine visitor. Each search engine has its own idea of what is important in a page, but they all value text highly. Making sure that the text on your pages includes your most important keyword phrases will help the search engine evaluate the content of those pages. Making sure that you have good title and meta tags will further assist the search engines in understanding what your page is about. If the text on the page is about widgets, the title is about widgets, and the meta tags are about widgets, the search engine will have a pretty good idea that you are all about widgets. When their visitors search for widgets, the search engines know to list your site in the results. A sitemap page is a very good way of giving the search engine robot every opportunity to reach your website pages. Since robots click through the links of your web pages, make sure that at least your most important pages are included in the sitemap; you may even want to include all your pages there, depending on the size of your site. Be sure to add a link to the sitemap page from each page on your site. Another important consideration is that of keeping all of your pages within a small number of “clicks” from your top page. Many robots will not follow links more than two or three levels deep, so if your “widgets” page can only be reached from your home page by following multiple links (e.g. home page >> about us page >> products page >> widgets page), the robot may not crawl deep enough to get to the widgets page. Testing Your Website For Search Engine Robot Accessibility To get an idea just what the search engine robot “sees” on your page, you can look at the Sim Spider tool. You may be surprised at how different your site looks to the robot. You can find this tool at http://www.searchengineworld.com/cgi-bin/sim_spider.cgi You will see text and ALT image text show up in the results. If your entire website is built in Flash, you will see nothing at all because robots don’t understand Flash movies.

The Bottom Line

When it comes to search engine robots, think simply. Lots of good content and text, hyperlinks the robots can follow, optimization of your pages, topical links pointing back to your site and a sitemap will help insure the best results when the robots come visiting.

One interesting and little known form of SEO is leaving keyword-enriched comments on other people’s blogging sites. This is the secret to SEO success that many bloggers use to attract them to their bummarketing links or to their website selling products. In fact leaving comments on other people’s blogs that are relevant to your own can double and even triple the visitors to your own site. Your first task is to do a Technorati search by posting an article and then searching for your article to see whom else might be blogging on it. This is one way of finding blogs you can exchange links with. Yet another way is to do a Google search to try and pick the right blog. One key to picking good blogs to comment on is to pick ones that have high quality content and keywords that are similar to your own but don’t have many other comments on them. If you choose a blogger that is deluged with comments he or she may not bother to backline to you as you are at the end of the caboose. One way to get a blogger to pay attention to you is to ask a provocative yet relevant question of the material he or she is posting. This not only attracts people to the link to your blog it also will get the attention of the owner of the blogger site who may even choose to engage in a long exchange of comments with your. This is great for both of you as it is organic SEO full of the terms and phrases that people naturally search for and the search engines will love to pick up the naturally refreshed content. This is the best kind of SEO because a) you don’t have to pay for it and b) it is great word of mouth that often reinforces your credibility as an expert.