Tag: Sogou

Posting To Multi-Language Search Engines: Google, Baidu, Sogou, 360

Speaking Chinese and English, it is what I do. As my mother tongue is English and I live in Toronto, Canada, it was natural for me to post in English and use Google, Bing, Yahoo, DuckDuckGo and other English biased search engines. I also have the ability to speak and write in Chinese, so I often do bilingual posts just for fun. As I regularly monitor my raw access server log, I can see that Google, Bing, Yahoo, DuckDuckGo, Baidu, Sogou, 360, Yandex and other search engines regularly index my content. I wondered how well they index my posts, and if there are any hints and tips that might make getting my content indexed better.

Identifying Chinese Search Engines

They have not caught on yet, as many Chinese search engines offer no explanation in English of their services, yet their bots are out there crawling all sites on the internet. I am trying to kill as many bots, scrapers, spiders, crawlers, and checkers as possible, and if I don’t find an explanation of what a site does, I’ll ban the user agent from my site. This might seem a little unfair, but I don’t want bots eating my bandwidth, and to have my ISP force me to pay more for hosting, all because they wish to crawl my site.