Microsoft AI translates Chinese to English like humans

Researchers from the company''s Asia and US labs said their system achieved human parity on a commonly-used test set of news stories - called "newstest2017" - that was released at a conference recently, a blog post said late on Wednesday.

Indo-Asian News Service
San Francisco, Publish Date: Mar 15 2018 1:20PM | Updated Date: Mar 15 2018 1:20PM
Microsoft AI translates Chinese to English like humansFile Photo

A team of Microsoft researchers, including one of Indian-origin, has created an Artificial Intelligence (AI)-powered machine system that can translate sentences of news articles from Chinese to English with the same quality and accuracy as humans.

Researchers from the company's Asia and US labs said their system achieved human parity on a commonly-used test set of news stories -- called "newstest2017" -- that was released at a conference recently, a blog post said late on Wednesday.

According to Arul Menezes, an IIT-Bombay alumni and Partner Research Manager of Microsoft's machine translation team, the team set out to prove that its systems could perform about as well as a person when it used a language pair -- like Chinese to English -- for which there is a lot of data.

"Given the best-case situation as far as data and availability of resources goes, we wanted to find out if we could actually match the performance of a professional human translator," said Menezes.

To ensure the results were both accurate and at par with what people would have done, the team hired external bilingual human evaluators who compared Microsoft's results to two independently produced human reference translations.

"Hitting human parity in a machine translation task is a dream that all of us have had. We just did not realise we would be able to hit it so soon," said Xuedong Huang, Technical Fellow in charge of Microsoft's speech, natural language and machine translation efforts.

To reach the human parity milestone on this dataset, three research teams in Microsoft's Beijing and Redmond, Washington, research labs worked together to make the system more accurate. 

"Much of our research is really inspired by how we humans do things," said Tie-Yan Liu, Principal Research Manager with Microsoft Research Asia in Beijing.

The team used dual-learning method. Every time they sent a sentence through the system to be translated from Chinese to English, the research team also translated it back from English to Chinese. 

That's similar to what people might do to make sure that their automated translations were accurate, and it allowed the system to refine and learn from its own mistakes. 

Dual learning, which was developed by the Microsoft research team, can also be used to improve results in other AI tasks.

Another method, called deliberation networks, is similar to how people edit and revise their own writing by going through it again and again. 

The researchers taught the system to repeat the process of translating the same sentence over and over, gradually refining and improving the response, Microsoft said.

Latest News

  1. Independents bag all 13 wards of Kupwara municipal body
  2. Independents bag all 13 wards of Kupwara municipal body
  1. SMC polls: Former Congress MP Tariq Karra's wife loses from Ward 31
  2. SMC polls: Former Congress MP Tariq Karra's wife loses from Ward 31
  1. Multiple blasts rock Kabul polling stations: official, witnesses
  2. Multiple blasts rock Kabul polling stations: official, witnesses
  1. JK polls: BJP fails to open account in Ladakh region
  2. JK polls: BJP fails to open account in Ladakh region
  1. Minister denies Railways' lapse in Amritsar tragedy
  2. Minister denies Railways' lapse in Amritsar tragedy
  1. Amritsar survivors, families recall night of horror
  2. Amritsar survivors, families recall night of horror
  1. North Korean hacker group stole $571 mn in crypto attacks
  2. North Korean hacker group stole $571 mn in crypto attacks
  1. Delhi court frames molestation charges against R K Pachauri
  2. Delhi court frames molestation charges against R K Pachauri
  1. Civic polls: BJP emerges winner in four south Kashmir districts, set to control four municipal bodies
  2. Civic polls: BJP emerges winner in four south Kashmir districts, set to control four municipal bodies
  1. Congress party gets majority in two municipal committees in Bandipora in north Kashmir
  2. Congress party gets majority in two municipal committees in Bandipora in north Kashmir
  1. Independents sweep Handwara municipal body polls results
  2. Independents sweep Handwara municipal body polls results
  1. Baramulla Municipal council: Congress wins 12 seats, BJP 6
  2. Baramulla Municipal council: Congress wins 12 seats, BJP 6
  1. Municipal committee Ganderbal: Independents win 13 wards; BJP, Congress win 2 each
  2. Municipal committee Ganderbal: Independents win 13 wards; BJP, Congress win 2 each
  1. Ramban municipal committee polls: Congress, BJP and Independents win two wards each
  2. Ramban municipal committee polls: Congress, BJP and Independents win two wards each
  1. Kokernag municipal committee polls: Congress wins ten wards
  2. Kokernag municipal committee polls: Congress wins ten wards
  1. Kerala MLA Abdul Razak dies of heart attack
  2. Kerala MLA Abdul Razak dies of heart attack
  1. Mattan municipal committee polls: BJP wins 7, Congress two wards
  2. Mattan municipal committee polls: BJP wins 7, Congress two wards
  1. Banihal municipal committee: Congress wins all four wards, BJP draws blank
  2. Banihal municipal committee: Congress wins all four wards, BJP draws blank
  1. Kargil municipal committee: Congress wins 5, Independents 8 wards
  2. Kargil municipal committee: Congress wins 5, Independents 8 wards
  1. Congress wins all 13 wards of Leh municipal committee, BJP draws blank
  2. Congress wins all 13 wards of Leh municipal committee, BJP draws blank
  1. Congress wins 20 out of 25 wards in Anantnag municipal council
  2. Congress wins 20 out of 25 wards in Anantnag municipal council
  1. BJP candidate gets 8 out of nine votes, wins ward 74 of Srinagar Municipal Corporation
  2. BJP candidate gets 8 out of nine votes, wins ward 74 of Srinagar Municipal Corporation
  1. US 'saddened' by confirmed Khashoggi death: White House
  2. US 'saddened' by confirmed Khashoggi death: White House
  1. Police begin probe as train mows down 58 Dussehra revellers in Punjab
  2. Police begin probe as train mows down 58 Dussehra revellers in Punjab
  1. Khashoggi died in fight at consulate, admits Saudi Arabia
  2. Khashoggi died in fight at consulate, admits Saudi Arabia
  1. Counting begins for Jammu and Kashmir municipal polls
  2. Counting begins for Jammu and Kashmir municipal polls
x
This site uses cookies to deliver our services and to show you relevant news and ads. By using our site, you acknowledge that you have read and understand our Cookie Policy, Privacy Policy, and our Terms of Service.That's Fine