AI Research Wiki
Search
Search
Dark mode
Light mode
Explorer
Tag: transformer
7 items with this tag.
Apr 11, 2026
Positional Encoding
transformer
sequence-modeling
position
Apr 11, 2026
Self-Attention
attention
transformer
sequence-modeling
Apr 11, 2026
Attention Is All You Need
transformer
self-attention
machine-translation
architecture
Apr 11, 2026
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
pretraining
bidirectional
masked-language-model
fine-tuning
transformer
Apr 11, 2026
Improving Language Understanding by Generative Pre-Training
pretraining
fine-tuning
transfer-learning
language-model
transformer
Apr 11, 2026
Language Models are Unsupervised Multitask Learners
language-model
zero-shot
transfer-learning
scaling
transformer
Apr 11, 2026
RoFormer: Enhanced Transformer with Rotary Position Embedding
positional-encoding
self-attention
transformer