Tag Archives: search

Language codes for Twitter

Brueghel's Tower of BabelHow to find tweets in a specific language?

That’s an issue for many Twitter users, including language learners and native speakers of other languages. Because of the dominance of English on the web, it’s easy to find English tweets. But finding tweets in other languages is not so straightforward.

One solution could be to tag each tweet with a language code. Using IANA’s existing language codes seems an ideal solution for compatibility and ease of recognition. This coding system is used widely on the web and in its basic form uses a two-letter code for each language. For example, the code for English is en, the code for Maori is mi.

It would be possible to use a tag prefix symbol in front of each code so that we could search for tweets in that language. But we need to use a different tag prefix than is currently used for tweet topics. Ideally, we could use just a single non-alpha character: where # is used for topic tags, we could use something like the percent sign. So, a tweet in modern Greek might be tagged with %el.

It might also be useful to flag tweets written in a non-standard language character set. For example, because of the limitations of some Twitter clients, we might want an additional symbol to tag a tweet that it is in Greek but which is transliterated into an English character set. Eg %el!

Since there is a lack of documentation on which specific characters are distinguished by Twitter’s search function, any use of a new tag prefix to denote language will require some trial-and-error testing to ensure it works effectively. If the polyglot community of Twitter users could agree on such a coding system, it would make it much easier to find relevant posts in languages other than English.

Image: Brueghel’s Tower of Babel

A bug in bing.com?

The beta version of bing. com, Microsoft’s new search engine, looks fast but it does seem to have a bug in handling language settings in the preferences.

When I first went to the bing site, it quite naturally provided radio buttons to either search the whole web or just in New Zealand. Very sensible.

However, when I went into my preferences and chose to search only in English and Greek, it seems to have decided I’m in Greece and forgotten I’m in New Zealand:

bing search box

I fixed this by deleting the two bing cookies _FS and _FP in my Safari preferences. So far the faulty setting has not reappeared, so perhaps it only happens when creating a new set of preferences. I’ve since found when I change the search settings this also rewrites the cookies so it is easy to correct.

Another sign that there is some slight confusion between location and language comes when you set the search for Greece and the interface language changes to Greek. You can then change the interface language back to English but this is not properly handled – eg clicking on ‘Help’ or ‘Legal’ results in a page of Greek text and no option to view it in English.