Skip to content

Pull requests: karpathy/llm.c

New pull request New
Clear current search query, filters, and sorts
125 Open 492 Closed
125 Open 492 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Issue #243: Add GPT-2 initialization from scratch
#832 opened Oct 9, 2025 by matt-langston Loading… updated Oct 14, 2025
1
Assignment Submission: RMSNorm Implementation
#831 opened Oct 4, 2025 by Mainak-learner • Draft updated Oct 4, 2025
added RoPE/GQA/SwiGLU
#830 opened Oct 3, 2025 by DavranDev Loading… updated Oct 3, 2025
Add 🦀 Rust port with safety + CUDA to notable forks
#827 opened Sep 11, 2025 by phildav Loading… updated Sep 22, 2025
Fix: Offset cast to int in fseekCheck breaks datasets >2GB
#828 opened Sep 12, 2025 by Ferraronp Loading… updated Sep 12, 2025
Fix for CUDA 13.0 and WSL builds
#825 opened Aug 24, 2025 by ademeure Loading… updated Aug 24, 2025
cuDNN for llama3
#808 opened May 1, 2025 by ngc92 Loading… updated Jul 24, 2025
Fix numpy.int32 overflow when printing token counts
#822 opened Jul 3, 2025 by ffuuugor Loading… updated Jul 3, 2025
add llama 3 support to llm.c
#754 opened Sep 13, 2024 by karpathy • Draft updated Jun 26, 2025
Create PMLL.c
#819 opened Jun 21, 2025 by drQedwards Loading… updated Jun 25, 2025
2
feat: add my name for YOLO badge
#820 opened Jun 24, 2025 by nguyenhoanghai1605 Loading… updated Jun 24, 2025
Update README.md
#789 opened Dec 14, 2024 by joeyabdalla Loading… updated Jun 20, 2025
1
Fix: Correct typo in code comment (logile -> logfile)
#814 opened May 24, 2025 by lurenss Loading… updated May 24, 2025
Makefile: Detect nccl on rpm based distros.
#812 opened May 15, 2025 by MathieuBordere Loading… updated May 15, 2025
~2x perf improvement beating PyTorch (cublasLt, TF32, CUDA graphs, kernel fusion, etc…)
#89 opened Apr 12, 2024 by ademeure Loading… updated May 5, 2025
3
Correction: memory_ops for encoder_forward
#797 opened Feb 26, 2025 by MasterSkepticista Loading… updated Feb 26, 2025
FIX TypeError: normal_() got an unexpected keyword argument 'generator' #723
#791 opened Dec 24, 2024 by earlytobed Loading… updated Dec 24, 2024
1
fix: false-positive check for nccl install on ubuntu
#775 opened Oct 2, 2024 by leiDnedyA Loading… updated Dec 22, 2024
1
1
Simplified/faster "backward bias" kernel (column reduction)
#699 opened Jul 19, 2024 by ademeure Loading… updated Dec 12, 2024
4
A CS 231n-style port of this project, implementing LLMs solely with NumPy
#784 opened Nov 18, 2024 by davidtag Loading… updated Nov 18, 2024
muP (maximum update parametrization)
#650 opened Jun 26, 2024 by gordicaleksa Loading… updated Nov 6, 2024
9
Mapping "py" gpt2 functionalities to match "c"
#783 opened Oct 31, 2024 by omarswelam Loading… updated Oct 31, 2024
Verify vocab is padded before reshaping
#782 opened Oct 23, 2024 by austinleedavis Loading… updated Oct 23, 2024
FP32 FlashAttention
#781 opened Oct 20, 2024 by ssiu Loading… updated Oct 20, 2024
Re: Fixed modal script for updated cudnn version, and read errors
#743 opened Aug 14, 2024 by vyom1611 Loading… updated Oct 19, 2024
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.