Paper Notes

Notes on papers I read.

2025

Oct 17Blockwise Parallel Transformer for Large Context Models | Paper Notes
- AI
- Paper Notes
Sep 10Fast Inference from Transformers via Speculative Decoding | Paper Notes
- AI
- Paper Notes
Sep 10Fast Transformer Decoding: One Write-Head is All You Need | Paper Notes
- AI
- Paper Notes
Sep 10GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints | Paper Notes
- AI
- Paper Notes
Sep 10Ring Attention with Blockwise Transformers for Near-Infinite Context | Paper Notes
- AI
- Paper Notes
Sep 9Effective Long-Context Scaling of Foundation Models | Paper Notes
- AI
- Paper Notes
Sep 6YaRN: Efficient Context Window Extension of Large Language Models | Paper Notes
- AI
- Paper Notes
Aug 29Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention | Paper Notes
- AI
- Paper Notes
Aug 28FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness | Paper Notes
- AI
- Paper Notes
Aug 28Longformer: The Long-Document Transformer | Paper Notes
- AI
- Paper Notes
Aug 27ReAct: Synergizing Reasoning and Acting in Language Models | Paper Notes
- AI
- Paper Notes
Aug 27RoFormer: Enhanced Transformer with Rotary Position Embedding | Paper Notes
- AI
- Paper Notes
Aug 27The Impact of Positional Encoding on Length Generalization in Transformers | Paper Notes
- AI
- Paper Notes
Aug 27Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation | Paper Notes
- AI
- Paper Notes
Aug 26Chain-of-Thought Prompting Elicits Reasoning in Large Language Models | Paper Notes
- AI
- Paper Notes
Aug 26Tree of Thoughts: Deliberate Problem Solving with Large Language Models | Paper Notes
- AI
- Paper Notes
Aug 22Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer | Paper Notes
- AI
- Paper Notes
Aug 22Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer | Paper Notes
- AI
- Paper Notes
Aug 21Language Models are Few-Shot Learners | Paper Notes
- AI
- Paper Notes
Aug 20Language Models are Unsupervised Multitask Learners | Paper Notes
- AI
- Paper Notes
Aug 19BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding | Paper Notes
- AI
- Paper Notes
Aug 14Improving Language Understanding by Generative Pre-Training | Paper Notes
- AI
- Paper Notes
Aug 12Attention Is All You Need | Paper Notes
- AI
- Paper Notes
- Python
Aug 10Neural Machine Translation by Jointly Learning to Align and Translate | Paper Notes
- AI
- Paper Notes
- Python
Aug 7Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inference | Paper Notes
- AI
- Paper Notes
Aug 6Sequence to Sequence Learning with Neural Networks | Paper Notes
- AI
- Paper Notes
- Python
Jul 30GloVe: Global Vectors for Word Representation | Paper Notes
- AI
- Paper Notes
- Python
Jul 20Efficient Estimation of Word Representations in Vector Space | Paper Notes
- AI
- Paper Notes
- Python