Contact our team

Understanding the Impact of AI and Big Data on the Language Industry

July 18, 2018

big data and AI for LSPsIn today’s data-driven world, the technology sector is abuzz with the potential of Artificial Intelligence (AI) and the power of Big Data. It’s exciting, futuristic stuff, and offers all sorts of new opportunities for a variety of services, including language service providers (LSPs).

How big is Big Data?

When we talk about Big Data, we mean big data — 2.5 quintillion bytes of data are added to the world’s digital repositories every day. In 2015, roughly 7.9 zettabytes were collected (1 zettabyte = 1 trillion gigabytes), and we’re expected to reach 176 zettabytes by 2025.

All of this data creates huge sets of structured and unstructured digital information that comes from pretty much everywhere. For example, big data sets can include your past sales data, online buyer reviews, real-time streaming, scientific experiments, government censuses, and pretty much anything else you can think of.

What do we get from AI and Big Data?

At its purest level, artificial intelligence is the product of thinking that is done by computer software. For now, practical use of AI is found chiefly in programs that utilize machine learning and deep learning – both of which use algorithms to parse data and then make intelligent decisions (and even build new neural networks) based on what was learned.

Big Data is about analysis, or as The ATA Chronicle puts it, “taking large amounts of data and using software tools to identify previously undiscovered patterns, trends, correlations, and associations.”

For LSPs, one benefit of applying AI learning to Big Data could be early identification of changing industry trends – which could result in better advanced planning for customers’ changing needs.

Consumer benefits

Some experts believe AI’s benefits will result in more people being able to take advantage of translation and localization services as they become more affordable. The hope, ultimately, is that more companies, organizations, and individuals will be able to converse with others throughout the world.

The historical model these experts cite is the clothing industry, where the upheaval of industrialization eventually revolutionized the industry by increasing the speed of production and lowering its cost, enabling an explosive increase in the sales of lower-cost goods.

Are we there yet?

The short answer is “no,” though some, such as VentureBeat, predict AI will mature pretty quickly and be a formidable force in translations by 2024. For now, though, human intervention in translations, especially regulated translations, is absolutely mandatory.

In fact, a man vs. machine competition demonstrated just that in South Korea last year. In this competition, four human translators were each given a different piece of content (under 250 words) to translate. They each had 50 minutes to complete the work while three AI translation programs (Naver’s Papago, Google Translate and Systran) were simultaneously assigned the same four jobs. Competition scoring was based on accuracy, language expression, logic and organization. Despite the fact that each one of the AI programs beat the human translators in turnaround time, it was still a worst-case scenario for AI.

“Some 90 percent of the artificial intelligence programs’ translations had grammatical errors,” said Kwak Jung-chul, president of the Korean Association of Translators and Interpreters. “The programs failed to understand the message that writers were trying to convey.”

The future of AI in language services

Experts have been weighing in on what we can expect as AI use grows in modern business. One especially interesting area to look at is web robots (also called chatbots or just bots). You’ve probably come across one of these while shopping on Amazon, surfing Facebook or working inside a Microsoft platform – and chances are you will only see more of them as time goes on.

Customer service chatbots are, according to Forbes, “[an] evolving technology [that] makes it easier for businesses to engage their customers, cut down on their workload and proactively prevent minor customer service issues from becoming major problems.” The value of a customer service bot, however, depends entirely on the quality of the automated script on which the bot runs. High quality scripts in multiple languages can result in higher customer satisfaction as well as the opportunity to obtain new business from different markets.

Push to pull translation

Andrew Joscelyne, writing for the Globalization and Localization Association (GALA), points out another interesting trend that could have a major influence on the future of the translation industry. He calls the shift “push to pull translation.”

Here’s what that means: Traditionally, companies have doled out (pushed) information that they consider to be important – and only translated it into the languages they’ve deemed profitable. This is the “push” side of the equation – the company chooses the type of information to distribute and the language/s to distribute it in. However, as online audiences grow, they may want to “pull” information (including languages) that companies don’t yet offer.

For example, a growing company might receive requests for business in 30 different languages – but it only has translators for 3 of those languages. That’s a major loss of potential business! Big Data can help companies look at users’ digital profiles, geolocations and personalized habits to help determine which additional languages and information could increase business the most.

Challenges and opportunities

It’s clear, then, that AI and Big Data stand to transform language services and are already beginning to do so. Once LSPs learn to leverage the wisdom buried in Big Data and begin to take advantage of more advanced AI, all of us will be able to communicate more freely with other people in other places.

For now, however, human translators continue to be a necessity in the fields of business, law, life sciences and intellectual property. In these regulated industries, quality simply can’t be sacrificed for convenience.