Transformers
Generative Pretrained Transformer
Расширенная статья: Натренированный генерирующий трансформер
GPT-1
- https://openai.com/blog/language-unsupervised/
- https://github.com/openai/finetune-transformer-lm
- https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
- https://arxiv.org/pdf/1706.03762.pdf
->
Trinh & Lee 2018
GPT-2
Основные ссылки
- https://openai.com/blog/better-language-models/
- https://www.openai.com/blog/gpt-2-1-5b-release/
- https://github.com/openai/gpt-2
- https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
Apache OpenNLP
Natural Language Toolkit
NLTK
