Neural machine translation
Neural machine translation (NMT) is the approach to machine translation in which a large neural network is trained to maximize translation performance. It is a radical departure from the phrase-based statistical translation approaches, in which a translation system consists of subcomponents that are separately optimized.[1]
The artificial neural network (ANN) is a unique learning algorithm inspired by the functional aspects and structure of the brain’s biological neural networks. With use of ANN, it is possible to execute a number of tasks, such as classification, clustering, and prediction, using machine learning techniques like supervised or reinforced learning. Therefore, ANN is a subset of machine learning algorithms.
A bidirectional recurrent neural network (RNN), known as an encoder, is used by the neural network to encode a source sentence for a second RNN, known as a decoder, that is used to predict words in the target language.[2]
NMT models are inspired by deep representation learning. They require only a fraction of the memory needed by traditional statistical machine translation (SMT) models. Furthermore, unlike conventional translation systems, each and every component of the neural translation model is trained jointly to maximize the translation performance.[3]
When a new neural network is created, it is trained for certain domains or applications. Once an automatic learning mechanism is established, the network practices. With time it starts operating according to its own judgment, turning into an "expert".[1]
References
- 1 2 Wołk, Krzysztof; Marasek, Krzysztof (2015). "Neural-based Machine Translation for Medical Text Domain. Based on European Medicines Agency Leaflet Texts". Procedia Computer Science (64): 2–9. doi:10.1016/j.procs.2015.08.456.
- ↑ Dzmitry Bahdanau, Cho Kyunghyun, Yoshua Bengio (2014). "Neural Machine Translation by Jointly Learning to Align and Translate". Cornell University Library. Retrieved 20 October 2015.
- ↑ Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, Yoshua Bengio (3 September 2014). "On the Properties of Neural Machine Translation: Encoder–Decoder Approaches". Cornell University Library. Retrieved 26 October 2015.
External links
- Neural machine translation at LISA, the machine learning laboratory of the University of Montreal