Ye, Xiang's Blog

  • Home
  • About
  • Categories
  • Archives
  • Table of Contents
  • Overview
  1. 1. Transformer and Translation Model
Xiang Ye

Xiang Ye

22 posts
25 categories
24 tags
GitHub Gitee E-Mail
0%

First Step to NLP

Posted on 2022-09-27 Edited on 2026-01-08 In Machine Learning , Applications , Natural Language Processing
First Step to NLP

1. Transformer and Translation Model

The model is trained by teacher-forcing method. The input is a sentence of language which is needed to be translated. The shifted right outputs is the tokens already translated. The output probabilities is the prediction of the next token.

# Natural Language Processing
Make and Cmake
Small Things for Linux
© 2026 Xiang Ye