Ye, Xiang's Blog

  • Home
  • About
  • Categories
  • Archives
  • Table of Contents
  • Overview
  1. 1. Transformer and Translation Model
Xiang Ye

Xiang Ye

22 posts
26 categories
26 tags
GitHub E-Mail
0%

First Step to NLP

Posted on 2022-09-27 Edited on 2022-09-29 In Machine Learning , Applications , Natural Language Processing
First Step to NLP

1. Transformer and Translation Model

The model is trained by teacher-forcing method. The input is a sentence of language which is needed to be translated. The shifted right outputs is the tokens already translated. The output probabilities is the prediction of the next token.

# Natural Language Processing
Hexo
Small Things for Linux
© 2025 Xiang Ye