Google's new Translate app shines in a crowded field

Google's new Translate app shines in a crowded field


Let the magic begin, right?

Google's translation app is being updated with the ability to translate live conversations.


Actually, there's also an iPhone 6 between them on the table, which is where the magic really resides on this recent morning. The two Googlers - Parisian-born product manager Julie Cattiau and software engineer Otavio Good - are here to unveil the company's latest Translate app, supercharged with what Google calls the biggest update in years.

"I'd like a cup of coffee without milk or sugar," Good says in English into the phone, which almost immediately repeats his words in French.

In addition to tranlsating spoken conversations, Google uses Word Lens technology to instantly translate written words through your phone's camera.

In addition to tranlsating spoken conversations, Google uses Word Lens technology to instantly translate written words through your phone's camera.Credit:Word Lens

"I'll bring you that right now," Cattiau replies in French, her response rendered aloud in English.

Get ready: Your own personal interpreter is coming soon. As it gains quickly in sophistication, machine-assisted translation promises to connect the world by bridging scores of languages while giving high-school Spanish teachers a run for their money. Google's free app, which was officially launched to the world early Wednesday, is an advanced mobile-translating tool, recognising more than three dozen languages. But it's part of a much bigger trend, with services like Microsoft's Skype Translator instantly turning video-chats into real-time multilingual conversations. Twitter has used the tech giant's Bing translation technology to instantly translate tweets, while Facebook pursues its own translation efforts.

"I'm passionate about translation," says 26-year-old Cattiau, who has worked at Google the past three-and-a-half years. "With our new app, we're able to detect the languages being spoken so you don't even have to press the translate button on the phone each time you talk. It's now so much more natural."

Reviewers say while the app is not perfect, it is good enough to hold conversations and order food.

"In our tests using a high-end Moto X smartphone, the app was able to translate several sentences flawlessly when I spoke with a colleague fluent in French about Paris," wrote Victor Luckerson with Time, "Some sentences came back in English somewhat garbled ('what you eat and when you were there' instead of 'what did you eat when you were there'), but for the most part it was pretty easy to maintain a dialogue using context clues."

Good, whose Word Lens technology was integrated into the updated app after Google bought his company last May, stands up with the phone to show off the app's other key feature: the ability to point the camera at foreign-language text, whether it's a street sign or a restaurant menu, and have an English translation appear like magic on the smart phone or tablet screen.

"Let's say you're in Moscow and you point the camera at a sign in the subway," says the soft-spoken engineer, adding that this feature works without an Internet or data connection. He aims his phone at one of the demo signs on the wall at Google's San Francisco headquarters. Instantly, an image of that same sign appears on the screen, but with "Access to City" replacing the Russian text.


"Often the hardest part of travelling is navigating the local language," Google developers say in a blog post about the new app. "If you've ever asked for 'pain' in Paris and gotten funny looks, confused 'embarazada' (pregnant) with 'embarrassed' in Mexico, or stumbled over pronunciation pretty much anywhere, you know the feeling."

Good says translation technology has come a long way in recent years. While there have been products introduced in the past at events like the Consumer Electronics Show in Las Vegas "where the technology could recognise symbols," says Good, "achieving a robust recognition of text has required a lot of work."

He says Google's purchase of his company last May has put things on the fast track.

Translate, which first launched in 2001, saw a huge spike in its linguistic oomph in 2006 when developers began using "statistical machine translation," essentially mapping languages across the Internet. As Google's algorithms learn to pair up, say, "maison" in French with "house" in English, the computers gradually build a dynamic translator, word by word.

"We base translation on machine learning, by looking at billions of Web pages that have been translated into other languages," says Cattiau. "We find 'dog' has been translated millions of times into 'chien,' for example, so the computer now knows the two mean the same thing."

The app's conversation feature can handle 38 languages, and is now available for the first time on iOS. That number of languages, too, is expected to grow. Cattiau says a "translation community" of Google users lend a hand, helping to translate obscure languages to assist Google's robots. "Users can rate a translation, improve or submit a new one. Users in Kazakhstan, for example, helped us so much with translating their language so that Kazakh on our app is now almost 100-per cent based on the community's assistance."

San Jose Mercury News

Most Viewed in Technology