Tag Index

2 items with this tag.

• Apr 11, 2026

  Fine-Tuning

  • fine-tuning
  • transfer-learning
  • adaptation

• Apr 11, 2026

  Low-Rank Adaptation

  • parameter-efficient
  • fine-tuning
  • adaptation

1 item with this tag.

• Apr 11, 2026

  Constitutional AI: Harmlessness from AI Feedback

  • constitutional-ai
  • alignment
  • rlhf
  • ai-feedback

5 items with this tag.

• Apr 11, 2026

  Anthropic

  • organization
  • ai-lab
  • alignment
  • ai-safety

• Apr 11, 2026

  Google Brain

  • organization
  • ai-lab
  • google

• Apr 11, 2026

  Google DeepMind

  • organization
  • ai-lab
  • google

• Apr 11, 2026

  Meta AI

  • organization
  • ai-lab
  • open-source

• Apr 11, 2026

  OpenAI

  • organization
  • ai-lab
  • alignment

1 item with this tag.

• Apr 11, 2026

  Anthropic

  • organization
  • ai-lab
  • alignment
  • ai-safety

9 items with this tag.

• Apr 11, 2026

  Constitutional AI

  • alignment
  • safety
  • rlaif

• Apr 11, 2026

  Direct Preference Optimization

  • alignment
  • preference-learning
  • optimization

• Apr 11, 2026

  Reinforcement Learning from Human Feedback

  • rlhf
  • alignment
  • reinforcement-learning

• Apr 11, 2026

  Anthropic

  • organization
  • ai-lab
  • alignment
  • ai-safety

• Apr 11, 2026

  OpenAI

  • organization
  • ai-lab
  • alignment

• Apr 11, 2026

  Constitutional AI: Harmlessness from AI Feedback

  • constitutional-ai
  • alignment
  • rlhf
  • ai-feedback

• Apr 11, 2026

  Direct Preference Optimization: Your Language Model is Secretly a Reward Model

  • direct-preference-optimization
  • alignment
  • rlhf
  • preference-learning

• Apr 11, 2026

  GPT-4 Technical Report

  • multimodal
  • frontier-model
  • scaling
  • alignment

• Apr 11, 2026

  InstructGPT: Training Language Models to Follow Instructions with Human Feedback

  • rlhf
  • alignment
  • instruction-following
  • language-model

7 items with this tag.

• Apr 11, 2026

  BERT (Bidirectional Encoder Representations from Transformers)

  • architecture
  • encoder-only
  • pretraining
  • natural-language-understanding

• Apr 11, 2026

  Encoder-Decoder Architecture

  • architecture
  • sequence-to-sequence
  • machine-translation

• Apr 11, 2026

  Generative Pre-trained Transformer (GPT)

  • architecture
  • language-model
  • decoder-only
  • autoregressive

• Apr 11, 2026

  Mixture of Experts (MoE)

  • architecture
  • sparse-models
  • scaling
  • efficiency

• Apr 11, 2026

  Transformer

  • architecture
  • attention
  • sequence-modeling

• Apr 11, 2026

  Mixture of Experts

  • architecture
  • efficiency
  • scaling

• Apr 11, 2026

  Attention Is All You Need

  • transformer
  • self-attention
  • machine-translation
  • architecture

6 items with this tag.

• Apr 11, 2026

  Transformer

  • architecture
  • attention
  • sequence-modeling

• Apr 11, 2026

  Attention

  • attention
  • sequence-modeling
  • neural-networks

• Apr 11, 2026

  FlashAttention

  • efficiency
  • attention
  • systems

• Apr 11, 2026

  Self-Attention

  • attention
  • transformer
  • sequence-modeling

• Apr 11, 2026

  Neural Machine Translation by Jointly Learning to Align and Translate

  • attention
  • machine-translation
  • encoder-decoder

• Apr 11, 2026

  FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

  • attention
  • efficiency
  • gpu-optimization
  • systems

1 item with this tag.

• Apr 11, 2026

  Generative Pre-trained Transformer (GPT)

  • architecture
  • language-model
  • decoder-only
  • autoregressive

1 item with this tag.

• Apr 11, 2026

  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  • pretraining
  • bidirectional
  • masked-language-model
  • fine-tuning
  • transformer

1 item with this tag.

• Apr 11, 2026

  Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

  • chain-of-thought
  • prompting
  • reasoning
  • in-context-learning

1 item with this tag.

• Apr 11, 2026

  Scaling Laws

  • scaling
  • empirical-laws
  • compute

1 item with this tag.

• Apr 11, 2026

  Scaling Laws for Neural Language Models

  • scaling-laws
  • language-modeling
  • compute-efficiency

1 item with this tag.

• Apr 11, 2026

  Chinchilla: Training Compute-Optimal Large Language Models

  • scaling-laws
  • compute-optimal
  • language-model

1 item with this tag.

• Apr 11, 2026

  Constitutional AI: Harmlessness from AI Feedback

  • constitutional-ai
  • alignment
  • rlhf
  • ai-feedback

1 item with this tag.

• Apr 11, 2026

  Generative Pre-trained Transformer (GPT)

  • architecture
  • language-model
  • decoder-only
  • autoregressive

1 item with this tag.

• Apr 11, 2026

  Direct Preference Optimization: Your Language Model is Secretly a Reward Model

  • direct-preference-optimization
  • alignment
  • rlhf
  • preference-learning

5 items with this tag.

• Apr 11, 2026

  Mixture of Experts (MoE)

  • architecture
  • sparse-models
  • scaling
  • efficiency

• Apr 11, 2026

  FlashAttention

  • efficiency
  • attention
  • systems

• Apr 11, 2026

  Mixture of Experts

  • architecture
  • efficiency
  • scaling

• Apr 11, 2026

  FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

  • attention
  • efficiency
  • gpu-optimization
  • systems

• Apr 11, 2026

  Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

  • mixture-of-experts
  • sparsity
  • scaling
  • efficiency

1 item with this tag.

• Apr 11, 2026

  LLaMA: Open and Efficient Foundation Language Models

  • open-source
  • efficient-training
  • language-model
  • scaling-laws

1 item with this tag.

• Apr 11, 2026

  Word Embeddings

  • representation-learning
  • nlp
  • embeddings

1 item with this tag.

• Apr 11, 2026

  Chain-of-Thought Prompting

  • prompting
  • reasoning
  • emergent-abilities

1 item with this tag.

• Apr 11, 2026

  Scaling Laws

  • scaling
  • empirical-laws
  • compute

3 items with this tag.

• Apr 11, 2026

  Neural Machine Translation by Jointly Learning to Align and Translate

  • attention
  • machine-translation
  • encoder-decoder

• Apr 11, 2026

  Sequence to Sequence Learning with Neural Networks

  • sequence-to-sequence
  • machine-translation
  • encoder-decoder
  • lstm

• Apr 11, 2026

  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  • transfer-learning
  • encoder-decoder
  • pretraining
  • nlp-benchmark

1 item with this tag.

• Apr 11, 2026

  BERT (Bidirectional Encoder Representations from Transformers)

  • architecture
  • encoder-only
  • pretraining
  • natural-language-understanding

1 item with this tag.

• Apr 11, 2026

  In-Context Learning

  • in-context-learning
  • few-shot
  • prompting

1 item with this tag.

• Apr 11, 2026

  Language Models are Few-Shot Learners

  • few-shot-learning
  • in-context-learning
  • language-model
  • scaling

5 items with this tag.

• Apr 11, 2026

  Fine-Tuning

  • fine-tuning
  • transfer-learning
  • adaptation

• Apr 11, 2026

  Low-Rank Adaptation

  • parameter-efficient
  • fine-tuning
  • adaptation

• Apr 11, 2026

  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  • pretraining
  • bidirectional
  • masked-language-model
  • fine-tuning
  • transformer

• Apr 11, 2026

  Improving Language Understanding by Generative Pre-Training

  • pretraining
  • fine-tuning
  • transfer-learning
  • language-model
  • transformer

• Apr 11, 2026

  LoRA: Low-Rank Adaptation of Large Language Models

  • fine-tuning
  • parameter-efficiency
  • low-rank-adaptation

1 item with this tag.

• Apr 11, 2026

  GPT-4 Technical Report

  • multimodal
  • frontier-model
  • scaling
  • alignment

2 items with this tag.

• Apr 11, 2026

  Google Brain

  • organization
  • ai-lab
  • google

• Apr 11, 2026

  Google DeepMind

  • organization
  • ai-lab
  • google

1 item with this tag.

• Apr 11, 2026

  FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

  • attention
  • efficiency
  • gpu-optimization
  • systems

1 item with this tag.

• Apr 11, 2026

  Learning Paths

  • learning
  • guide

3 items with this tag.

• Apr 11, 2026

  In-Context Learning

  • in-context-learning
  • few-shot
  • prompting

• Apr 11, 2026

  Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

  • chain-of-thought
  • prompting
  • reasoning
  • in-context-learning

• Apr 11, 2026

  Language Models are Few-Shot Learners

  • few-shot-learning
  • in-context-learning
  • language-model
  • scaling

1 item with this tag.

• Apr 11, 2026

  Index

  • index

1 item with this tag.

• Apr 11, 2026

  InstructGPT: Training Language Models to Follow Instructions with Human Feedback

  • rlhf
  • alignment
  • instruction-following
  • language-model

7 items with this tag.

• Apr 11, 2026

  Generative Pre-trained Transformer (GPT)

  • architecture
  • language-model
  • decoder-only
  • autoregressive

• Apr 11, 2026

  Chinchilla: Training Compute-Optimal Large Language Models

  • scaling-laws
  • compute-optimal
  • language-model

• Apr 11, 2026

  Improving Language Understanding by Generative Pre-Training

  • pretraining
  • fine-tuning
  • transfer-learning
  • language-model
  • transformer

• Apr 11, 2026

  Language Models are Unsupervised Multitask Learners

  • language-model
  • zero-shot
  • transfer-learning
  • scaling
  • transformer

• Apr 11, 2026

  Language Models are Few-Shot Learners

  • few-shot-learning
  • in-context-learning
  • language-model
  • scaling

• Apr 11, 2026

  InstructGPT: Training Language Models to Follow Instructions with Human Feedback

  • rlhf
  • alignment
  • instruction-following
  • language-model

• Apr 11, 2026

  LLaMA: Open and Efficient Foundation Language Models

  • open-source
  • efficient-training
  • language-model
  • scaling-laws

2 items with this tag.

• Apr 11, 2026

  Pretraining

  • pretraining
  • language-modeling
  • self-supervised-learning

• Apr 11, 2026

  Scaling Laws for Neural Language Models

  • scaling-laws
  • language-modeling
  • compute-efficiency

1 item with this tag.

• Apr 11, 2026

  Learning Paths

  • learning
  • guide

1 item with this tag.

• Apr 11, 2026

  LoRA: Low-Rank Adaptation of Large Language Models

  • fine-tuning
  • parameter-efficiency
  • low-rank-adaptation

1 item with this tag.

• Apr 11, 2026

  Sequence to Sequence Learning with Neural Networks

  • sequence-to-sequence
  • machine-translation
  • encoder-decoder
  • lstm

4 items with this tag.

• Apr 11, 2026

  Encoder-Decoder Architecture

  • architecture
  • sequence-to-sequence
  • machine-translation

• Apr 11, 2026

  Attention Is All You Need

  • transformer
  • self-attention
  • machine-translation
  • architecture

• Apr 11, 2026

  Neural Machine Translation by Jointly Learning to Align and Translate

  • attention
  • machine-translation
  • encoder-decoder

• Apr 11, 2026

  Sequence to Sequence Learning with Neural Networks

  • sequence-to-sequence
  • machine-translation
  • encoder-decoder
  • lstm

1 item with this tag.

• Apr 11, 2026

  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  • pretraining
  • bidirectional
  • masked-language-model
  • fine-tuning
  • transformer

1 item with this tag.

• Apr 11, 2026

  Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

  • mixture-of-experts
  • sparsity
  • scaling
  • efficiency

1 item with this tag.

• Apr 11, 2026

  GPT-4 Technical Report

  • multimodal
  • frontier-model
  • scaling
  • alignment

1 item with this tag.

• Apr 11, 2026

  BERT (Bidirectional Encoder Representations from Transformers)

  • architecture
  • encoder-only
  • pretraining
  • natural-language-understanding

1 item with this tag.

• Apr 11, 2026

  Attention

  • attention
  • sequence-modeling
  • neural-networks

3 items with this tag.

• Apr 11, 2026

  Transfer Learning

  • transfer-learning
  • pretraining
  • nlp

• Apr 11, 2026

  Word Embeddings

  • representation-learning
  • nlp
  • embeddings

• Apr 11, 2026

  Efficient Estimation of Word Representations in Vector Space

  • word-embeddings
  • representation-learning
  • nlp

1 item with this tag.

• Apr 11, 2026

  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  • transfer-learning
  • encoder-decoder
  • pretraining
  • nlp-benchmark

2 items with this tag.

• Apr 11, 2026

  Meta AI

  • organization
  • ai-lab
  • open-source

• Apr 11, 2026

  LLaMA: Open and Efficient Foundation Language Models

  • open-source
  • efficient-training
  • language-model
  • scaling-laws

1 item with this tag.

• Apr 11, 2026

  Direct Preference Optimization

  • alignment
  • preference-learning
  • optimization

5 items with this tag.

• Apr 11, 2026

  Anthropic

  • organization
  • ai-lab
  • alignment
  • ai-safety

• Apr 11, 2026

  Google Brain

  • organization
  • ai-lab
  • google

• Apr 11, 2026

  Google DeepMind

  • organization
  • ai-lab
  • google

• Apr 11, 2026

  Meta AI

  • organization
  • ai-lab
  • open-source

• Apr 11, 2026

  OpenAI

  • organization
  • ai-lab
  • alignment

1 item with this tag.

• Apr 11, 2026

  The Road to Modern LLMs

  • overview

1 item with this tag.

• Apr 11, 2026

  LoRA: Low-Rank Adaptation of Large Language Models

  • fine-tuning
  • parameter-efficiency
  • low-rank-adaptation

1 item with this tag.

• Apr 11, 2026

  Low-Rank Adaptation

  • parameter-efficient
  • fine-tuning
  • adaptation

1 item with this tag.

• Apr 11, 2026

  Positional Encoding

  • transformer
  • sequence-modeling
  • position

1 item with this tag.

• Apr 11, 2026

  RoFormer: Enhanced Transformer with Rotary Position Embedding

  • positional-encoding
  • self-attention
  • transformer

2 items with this tag.

• Apr 11, 2026

  Direct Preference Optimization

  • alignment
  • preference-learning
  • optimization

• Apr 11, 2026

  Direct Preference Optimization: Your Language Model is Secretly a Reward Model

  • direct-preference-optimization
  • alignment
  • rlhf
  • preference-learning

6 items with this tag.

• Apr 11, 2026

  BERT (Bidirectional Encoder Representations from Transformers)

  • architecture
  • encoder-only
  • pretraining
  • natural-language-understanding

• Apr 11, 2026

  Pretraining

  • pretraining
  • language-modeling
  • self-supervised-learning

• Apr 11, 2026

  Transfer Learning

  • transfer-learning
  • pretraining
  • nlp

• Apr 11, 2026

  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  • pretraining
  • bidirectional
  • masked-language-model
  • fine-tuning
  • transformer

• Apr 11, 2026

  Improving Language Understanding by Generative Pre-Training

  • pretraining
  • fine-tuning
  • transfer-learning
  • language-model
  • transformer

• Apr 11, 2026

  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  • transfer-learning
  • encoder-decoder
  • pretraining
  • nlp-benchmark

3 items with this tag.

• Apr 11, 2026

  Chain-of-Thought Prompting

  • prompting
  • reasoning
  • emergent-abilities

• Apr 11, 2026

  In-Context Learning

  • in-context-learning
  • few-shot
  • prompting

• Apr 11, 2026

  Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

  • chain-of-thought
  • prompting
  • reasoning
  • in-context-learning

2 items with this tag.

• Apr 11, 2026

  Chain-of-Thought Prompting

  • prompting
  • reasoning
  • emergent-abilities

• Apr 11, 2026

  Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

  • chain-of-thought
  • prompting
  • reasoning
  • in-context-learning

1 item with this tag.

• Apr 11, 2026

  Reinforcement Learning from Human Feedback

  • rlhf
  • alignment
  • reinforcement-learning

2 items with this tag.

• Apr 11, 2026

  Word Embeddings

  • representation-learning
  • nlp
  • embeddings

• Apr 11, 2026

  Efficient Estimation of Word Representations in Vector Space

  • word-embeddings
  • representation-learning
  • nlp

1 item with this tag.

• Apr 11, 2026

  Constitutional AI

  • alignment
  • safety
  • rlaif

4 items with this tag.

• Apr 11, 2026

  Reinforcement Learning from Human Feedback

  • rlhf
  • alignment
  • reinforcement-learning

• Apr 11, 2026

  Constitutional AI: Harmlessness from AI Feedback

  • constitutional-ai
  • alignment
  • rlhf
  • ai-feedback

• Apr 11, 2026

  Direct Preference Optimization: Your Language Model is Secretly a Reward Model

  • direct-preference-optimization
  • alignment
  • rlhf
  • preference-learning

• Apr 11, 2026

  InstructGPT: Training Language Models to Follow Instructions with Human Feedback

  • rlhf
  • alignment
  • instruction-following
  • language-model

1 item with this tag.

• Apr 11, 2026

  Constitutional AI

  • alignment
  • safety
  • rlaif

7 items with this tag.

• Apr 11, 2026

  Mixture of Experts (MoE)

  • architecture
  • sparse-models
  • scaling
  • efficiency

• Apr 11, 2026

  Mixture of Experts

  • architecture
  • efficiency
  • scaling

• Apr 11, 2026

  Scaling Laws

  • scaling
  • empirical-laws
  • compute

• Apr 11, 2026

  Language Models are Unsupervised Multitask Learners

  • language-model
  • zero-shot
  • transfer-learning
  • scaling
  • transformer

• Apr 11, 2026

  Language Models are Few-Shot Learners

  • few-shot-learning
  • in-context-learning
  • language-model
  • scaling

• Apr 11, 2026

  GPT-4 Technical Report

  • multimodal
  • frontier-model
  • scaling
  • alignment

• Apr 11, 2026

  Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

  • mixture-of-experts
  • sparsity
  • scaling
  • efficiency

3 items with this tag.

• Apr 11, 2026

  Chinchilla: Training Compute-Optimal Large Language Models

  • scaling-laws
  • compute-optimal
  • language-model

• Apr 11, 2026

  LLaMA: Open and Efficient Foundation Language Models

  • open-source
  • efficient-training
  • language-model
  • scaling-laws

• Apr 11, 2026

  Scaling Laws for Neural Language Models

  • scaling-laws
  • language-modeling
  • compute-efficiency

2 items with this tag.

• Apr 11, 2026

  Attention Is All You Need

  • transformer
  • self-attention
  • machine-translation
  • architecture

• Apr 11, 2026

  RoFormer: Enhanced Transformer with Rotary Position Embedding

  • positional-encoding
  • self-attention
  • transformer

1 item with this tag.

• Apr 11, 2026

  Pretraining

  • pretraining
  • language-modeling
  • self-supervised-learning

4 items with this tag.

• Apr 11, 2026

  Transformer

  • architecture
  • attention
  • sequence-modeling

• Apr 11, 2026

  Attention

  • attention
  • sequence-modeling
  • neural-networks

• Apr 11, 2026

  Positional Encoding

  • transformer
  • sequence-modeling
  • position

• Apr 11, 2026

  Self-Attention

  • attention
  • transformer
  • sequence-modeling

2 items with this tag.

• Apr 11, 2026

  Encoder-Decoder Architecture

  • architecture
  • sequence-to-sequence
  • machine-translation

• Apr 11, 2026

  Sequence to Sequence Learning with Neural Networks

  • sequence-to-sequence
  • machine-translation
  • encoder-decoder
  • lstm

1 item with this tag.

• Apr 11, 2026

  Mixture of Experts (MoE)

  • architecture
  • sparse-models
  • scaling
  • efficiency

1 item with this tag.

• Apr 11, 2026

  Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

  • mixture-of-experts
  • sparsity
  • scaling
  • efficiency

2 items with this tag.

• Apr 11, 2026

  FlashAttention

  • efficiency
  • attention
  • systems

• Apr 11, 2026

  FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

  • attention
  • efficiency
  • gpu-optimization
  • systems

5 items with this tag.

• Apr 11, 2026

  Fine-Tuning

  • fine-tuning
  • transfer-learning
  • adaptation

• Apr 11, 2026

  Transfer Learning

  • transfer-learning
  • pretraining
  • nlp

• Apr 11, 2026

  Improving Language Understanding by Generative Pre-Training

  • pretraining
  • fine-tuning
  • transfer-learning
  • language-model
  • transformer

• Apr 11, 2026

  Language Models are Unsupervised Multitask Learners

  • language-model
  • zero-shot
  • transfer-learning
  • scaling
  • transformer

• Apr 11, 2026

  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  • transfer-learning
  • encoder-decoder
  • pretraining
  • nlp-benchmark

7 items with this tag.

• Apr 11, 2026

  Positional Encoding

  • transformer
  • sequence-modeling
  • position

• Apr 11, 2026

  Self-Attention

  • attention
  • transformer
  • sequence-modeling

• Apr 11, 2026

  Attention Is All You Need

  • transformer
  • self-attention
  • machine-translation
  • architecture

• Apr 11, 2026

  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  • pretraining
  • bidirectional
  • masked-language-model
  • fine-tuning
  • transformer

• Apr 11, 2026

  Improving Language Understanding by Generative Pre-Training

  • pretraining
  • fine-tuning
  • transfer-learning
  • language-model
  • transformer

• Apr 11, 2026

  Language Models are Unsupervised Multitask Learners

  • language-model
  • zero-shot
  • transfer-learning
  • scaling
  • transformer

• Apr 11, 2026

  RoFormer: Enhanced Transformer with Rotary Position Embedding

  • positional-encoding
  • self-attention
  • transformer

1 item with this tag.

• Apr 11, 2026

  Efficient Estimation of Word Representations in Vector Space

  • word-embeddings
  • representation-learning
  • nlp

1 item with this tag.

• Apr 11, 2026

  Language Models are Unsupervised Multitask Learners

  • language-model
  • zero-shot
  • transfer-learning
  • scaling
  • transformer