Skip to content

Paper Index

All 107 summaries at a glance, grouped by category. Generated by scripts/build_manifest.py - do not edit by hand.

Architectures

# Paper Year Source
01 Attention Is All You Need 2017 link
11 An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Vision Transformer) 2020 link
20 Mamba: Linear-Time Sequence Modeling with Selective State Spaces 2023 link
37 Mixtral of Experts (and the Mixture-of-Experts Architecture) 2024 link
55 Sequence to Sequence Learning with Neural Networks (Seq2Seq) 2014 link
66 Neural Machine Translation by Jointly Learning to Align and Translate (Bahdanau Attention) 2014 link
67 Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity 2021 link
73 Deep Residual Learning for Image Recognition (ResNet) 2015 link
74 U-Net: Convolutional Networks for Biomedical Image Segmentation 2015 link
75 GQA: Grouped-Query Attention (and Multi-Query Attention) 2023 link
88 Masked Autoencoders Are Scalable Vision Learners (MAE) 2021 link

Language Models

# Paper Year Source
03 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 2018 link
04 Language Models are Few-Shot Learners (GPT-3) 2020 link
05 Training Language Models to Follow Instructions with Human Feedback (InstructGPT) 2022 link
14 Constitutional AI: Harmlessness from AI Feedback 2022 link
15 LLaMA: Open and Efficient Foundation Language Models 2023 link
17 LLaMA 2: Open Foundation and Fine-Tuned Chat Models 2023 link
19 Direct Preference Optimization (DPO): Your Language Model is Secretly a Reward Model 2023 link
26 DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning 2025 link
27 DeepSeek-V3 Technical Report 2024 link
28 Qwen3: Technical Report 2025 link
30 Claude 3.5 Sonnet: Computer Use and Enhanced Capabilities 2024 link
31 OpenAI o1: Learning to Reason with Reinforcement Learning 2024 link
33 LLaMA 3.3: Matching 405B Performance with 70B Parameters 2024 link
36 GPT-4 Technical Report 2023 link
40 GPT-4o: The First Omni Model 2024 link
41 Llama 4: Natively Multimodal Open-Source AI 2025 link
42 GPT-5: Unified Intelligence 2025 link
43 Claude 4 Family: The Agentic AI Leader 2025 link
56 Codex: Evaluating Large Language Models Trained on Code 2021 link
64 Language Models are Unsupervised Multitask Learners (GPT-2) 2019 link
65 Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (T5) 2019 link
93 Improving Language Understanding by Generative Pre-Training (GPT-1) 2018 link
94 PaLM: Scaling Language Modeling with Pathways 2022 link
95 Mistral 7B 2023 link
96 Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations 2023 link

Image & Video Generation

# Paper Year Source
02 Generative Adversarial Networks (GANs) 2014 link
06 Denoising Diffusion Probabilistic Models (DDPM) 2020 link
07 High-Resolution Image Synthesis with Latent Diffusion Models (Stable Diffusion) 2021 link
44 Sora and Diffusion Transformers (DiT): Video Generation as World Simulation 2022 link
48 DALL-E 3: Improving Image Generation with Better Captions 2023 link
57 Auto-Encoding Variational Bayes (VAE) 2013 link
69 Classifier-Free Diffusion Guidance 2021 link
70 Denoising Diffusion Implicit Models (DDIM) 2020 link
71 ControlNet: Adding Conditional Control to Text-to-Image Diffusion Models 2023 link
72 Flow Matching and Rectified Flow: The New Default for Image Generation (Stable Diffusion 3) 2022 link
89 Neural Discrete Representation Learning (VQ-VAE) 2017 link
90 Taming Transformers for High-Resolution Image Synthesis (VQ-GAN) 2020 link
91 Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding (Imagen) 2022 link
92 DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation 2022 link

Multimodal

# Paper Year Source
08 Learning Transferable Visual Models From Natural Language Supervision (CLIP) 2021 link
23 GPT-4V(ision): System Card 2023 link
29 Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities 2025 link
32 SAM 2: Segment Anything in Images and Videos 2024 link
46 LLaVA: Visual Instruction Tuning 2023 link
47 Gemini 3: Google's Most Capable AI Model 2025 link
49 Whisper: Robust Speech Recognition via Large-Scale Weak Supervision 2022 link

Techniques & Methods

# Paper Year Source
09 Chain-of-Thought Prompting Elicits Reasoning in Large Language Models 2022 link
10 LoRA: Low-Rank Adaptation of Large Language Models 2021 link
12 Scaling Laws for Neural Language Models 2020 link
13 Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (RAG) 2020 link
16 FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness 2022 link
18 Training Compute-Optimal Large Language Models (Chinchilla) 2022 link
21 ReAct: Synergizing Reasoning and Acting in Language Models 2022 link
22 QLoRA: Efficient Finetuning of Quantized LLMs 2023 link
24 Toolformer: Language Models Can Teach Themselves to Use Tools 2023 link
25 Tree of Thoughts: Deliberate Problem Solving with Large Language Models 2023 link
34 Meta Chain-of-Thought: Towards System 2 Reasoning in LLMs 2025 link
35 rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking 2025 link
38 GRPO: Group Relative Policy Optimization 2024 link
39 RLVR: Reinforcement Learning from Verifiable Rewards 2024 link
45 Speculative Decoding: Fast Inference from Transformers 2022 link
50 Scaling LLM Test-Time Compute: The Theoretical Foundation for Reasoning Models 2024 link
51 Let's Verify Step by Step: Process Reward Models 2023 link
52 PagedAttention: Efficient LLM Serving with vLLM 2023 link
53 Efficient Estimation of Word Representations in Vector Space (Word2Vec) 2013 link
54 RoFormer: Enhanced Transformer with Rotary Position Embedding (RoPE) 2021 link
58 Generative Agents: Interactive Simulacra of Human Behavior 2023 link
59 Model Context Protocol (MCP): An Open Standard for AI Tool Integration 2024 link
60 GraphRAG: From Local to Global - A Graph RAG Approach to Query-Focused Summarization 2024 link
61 AlphaGeometry: Solving Olympiad Geometry Without Human Demonstrations 2024 link
62 AlphaEvolve: A Gemini-Powered Coding Agent for Designing Advanced Algorithms 2025 link
63 Proximal Policy Optimization Algorithms (PPO) 2017 link
68 Highly Accurate Protein Structure Prediction with AlphaFold (AlphaFold 2) 2021 link
76 ZeRO and Megatron-LM: How Trillion-Parameter Models Are Actually Trained 2019 link
77 Self-Consistency Improves Chain of Thought Reasoning in Language Models 2022 link
78 Reflexion: Language Agents with Verbal Reinforcement Learning 2023 link
79 Self-Instruct: Aligning Language Models with Self-Generated Instructions 2022 link
80 FLAN: Finetuned Language Models Are Zero-Shot Learners (Instruction Tuning) 2021 link
81 Emergent Abilities of Large Language Models (and the Mirage Rebuttal) 2022 link
82 Sparse Autoencoders and Monosemanticity: Reading the Features Inside a Model 2024 link
83 Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training 2024 link
84 SWE-bench: Can Language Models Resolve Real-World GitHub Issues? 2023 link
85 Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena 2023 link
86 GPTQ and AWQ: Post-Training Quantization for Large Language Models 2022 link
87 Dense Passage Retrieval, ColBERT, and Sentence-BERT: The Retrieval Half of RAG 2020 link
97 STaR: Bootstrapping Reasoning With Reasoning (Self-Taught Reasoner) 2022 link
98 Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking 2024 link
99 Self-Refine: Iterative Refinement with Self-Feedback 2023 link
100 Voyager: An Open-Ended Embodied Agent with Large Language Models 2023 link
101 Accurate Structure Prediction of Biomolecular Interactions with AlphaFold 3 2024 link
102 Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm 2017 link
103 KTO: Model Alignment as Prospect Theoretic Optimization 2024 link
104 Genie: Generative Interactive Environments 2024 link
105 Mastering Diverse Domains through World Models (DreamerV3) 2023 link
106 Evolutionary-Scale Prediction of Atomic-Level Protein Structure with a Language Model (ESM-2 / ESMFold) 2023 link
107 Human-Level Play in the Game of Diplomacy by Combining Language Models with Strategic Reasoning (CICERO) 2022 link