llms-from-scratch

llms-from-scratch

Latest Version: N/A

Step-by-step implementation of a ChatGPT-like LLM in PyTorch from scratch.

Owner: rasbt

OSSauto-discoveredgithub-searchai

Stars

85.7k

GitHub star count

Last Release

N/A

N/A

Contributors

57

N/A

Health Score

N/A

N/A

Key Features

  • ai

  • artificial intelligence

  • chatbot

  • chatgpt

  • deep learning

Tech Stack

Jupyter Notebook
auto-discovered
github-search
ai
artificial-intelligence
chatbot
chatgpt
deep-learning
from-scratch
generative-ai
gpt
language-model
large-language-models

About

Step-by-step implementation of a ChatGPT-like LLM in PyTorch from scratch.

llms-from-scratch is a open-source project built primarily with Jupyter Notebook and maintained by rasbt. The project is distributed under the NOASSERTION license.

Current DevRadar signals show community adoption at 85.7K stars, 13K forks, 57 contributors. Freshness signals include last commit 2026-02-19. Current discovery action is "track", with ongoing monitoring of maintenance and ecosystem momentum.

Analyst Note

Step-by-step implementation of a ChatGPT-like LLM in PyTorch from scratch.

Best For

  • Technical stack evaluation for engineering teams
  • Dependency governance and upgrade planning in production systems
  • Track delivery cadence and release quality from rasbt
  • ai

Not Ideal For

  • Release cadence may shift with maintainer priorities; plan controlled upgrade windows

Typical Use Cases

Technical stack evaluation for engineering teamsDependency governance and upgrade planning in production systemsTrack delivery cadence and release quality from rasbt

Decision Snapshot

  • Product type: Open Source
  • Primary language: Jupyter Notebook
  • Pricing model: Free
  • License: NOASSERTION
Data Basis
  • Last Sync: Feb 22, 2026, 03:24 PM
  • Metrics Updated: Feb 22, 2026, 03:24 PM
  • Completeness: 82%
  • Last Verified: Feb 22, 2026, 03:24 PM

Data Status

Stale
Last SyncFeb 22, 2026, 03:24 PM
Metrics UpdatedFeb 22, 2026, 03:24 PM
Completeness82%
Last VerifiedFeb 22, 2026, 03:24 PM

Pros & Cons

Pros

  • Strong community adoption.
  • Broad maintainer participation.
  • Active maintenance cadence.

Cons

  • -Release cadence may shift with maintainer priorities; plan controlled upgrade windows

All Metrics

Adoption

4/4
Stars85.7k
Forks13.0k
Open Issues0
Contributors57

Health

0/4
Health ScorePending
Trend ScorePending
Activity ScorePending
Reliability ScorePending

Core

1/5
Latest VersionPending
Last ReleasePending
Last Commit2/19/2026
StatusPending
Activity LevelPending

Security

0/1
Security ScorePending