Transformers

• https://huggingface.co/transformers/
• https://github.com/huggingface/transformers

Generative Pretrained Transformer

Расширенная статья: Натренированный генерирующий трансформер

GPT-1

• https://openai.com/blog/language-unsupervised/
• https://github.com/openai/finetune-transformer-lm
• https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
• https://arxiv.org/pdf/1706.03762.pdf

->

Trinh & Lee 2018

GPT-2

Основные ссылки

• https://openai.com/blog/better-language-models/
• https://www.openai.com/blog/gpt-2-1-5b-release/
• https://github.com/openai/gpt-2
• https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf

Apache OpenNLP

https://opennlp.apache.org/

Natural Language Toolkit

NLTK

https://www.nltk.org/