Speaking Chinese and English, it is what I do. As my mother tongue is English and I live in Toronto, Canada, it was natural for me to post in English and use Google, Bing, Yahoo, DuckDuckGo and other English biased search engines. I also have the ability to speak and write in Chinese, so I often do bilingual posts just for fun. As I regularly monitor my raw access server log, I can see that Google, Bing, Yahoo, DuckDuckGo, Baidu, Sogou, 360, Yandex and other search engines regularly index my content. I wondered how well they index my posts, and if there are any hints and tips that might make getting my content indexed better.
They have not caught on yet, as many Chinese search engines offer no explanation in English of their services, yet their bots are out there crawling all sites on the internet. I am trying to kill as many bots, scrapers, spiders, crawlers, and checkers as possible, and if I don’t find an explanation of what a site does, I’ll ban the user agent from my site. This might seem a little unfair, but I don’t want bots eating my bandwidth, and to have my ISP force me to pay more for hosting, all because they wish to crawl my site.
Call it part of my personality, but I like to be thorough. I also like to have proof of some statement, even if proof is difficult or impossible to come by. When scientific double blind studies are not possible, I don’t mind having a sliding scale of proof where a little proof is better than no proof at all. I dislike old wive’s tales and relish when Mythbusters does their show. A case in fact is my reliance on Google as a search engine. Of course all my knowledgeable friends rely on Google as much as I do, and it’s the best search engine that I’ve used, but it’s far from perfect. Today I wondered if Yahoo’s search engine, the one I used to use long ago, had improved enough to rival Google. The skinny is that Google still is the best for my research, but don’t write off Yahoo either.
I really love Drupal 6’s feed aggregator. It has the ability to aggregate numerous RSS (Really Simple Sybndication) news or blog feeds, categorize them, and keep them current, all in the effort to save you the trouble of going to each news source and hunting for relevant news. All you have to do is chose a category, read the summary and click the link for the article you what you want.
