Code

add/mlpc#16

Code

Open

karpathy wants to merge 26 commits intomasterEurekaLabsAI/mlp:masterfrom add/mlpcEurekaLabsAI/mlp:add/mlpcCopy head branch name to clipboard

+857

Commits

Commits on Jul 20, 2024

• C imp - wip

  gordicaleksa

  committed
  50fed6b

  Copy full SHA for 50fed6b

• Backward pass wip

  gordicaleksa

  committed
  65990ad

  Copy full SHA for 65990ad

• backward done - before testing

  gordicaleksa

  committed
  d555526

  Copy full SHA for d555526

• Allocate single big buffer for params

  gordicaleksa

  committed
  2272279

  Copy full SHA for 2272279

• Use buffers for grads, grads acts, acts

  gordicaleksa

  committed
  a046e83

  Copy full SHA for a046e83

• free mem, zero grad, fix adam update

  gordicaleksa

  committed
  f3d04d7

  Copy full SHA for f3d04d7

• Mini refactor

  gordicaleksa

  committed
  484ad37

  Copy full SHA for 484ad37

• Add comments, compiles successfully

  gordicaleksa

  committed
  0ecd0e7

  Copy full SHA for 0ecd0e7

• Refactor fwd pass

  gordicaleksa

  committed
  f4ae934

  Copy full SHA for f4ae934

• Fix bwd pass shortcut placement; fwd step working

  gordicaleksa

  committed
  03448cc

  Copy full SHA for 03448cc

• Simplify backward

  gordicaleksa

  committed
  7a0e654

  Copy full SHA for 7a0e654

• Minor refactor of bwd

  gordicaleksa

  committed
  403c90f

  Copy full SHA for 403c90f

• Got equivalent results with PyTorch!

  gordicaleksa

  committed
  7b4f8d9

  Copy full SHA for 7b4f8d9

Commits on Jul 21, 2024

• Annotate, add pictorial representation

  gordicaleksa

  committed
  8ab1d77

  Copy full SHA for 8ab1d77

• Merge branch 'master' into add_c_imp

  gordicaleksa

  committed
  34ccc7e

  Copy full SHA for 34ccc7e

• Add tanh, remove relu

  gordicaleksa

  committed
  9b6f581

  Copy full SHA for 9b6f581

• Use common rng

  gordicaleksa

  committed
  ad5d202

  Copy full SHA for ad5d202

• Remove create model from checkpoint func - declutter

  gordicaleksa

  committed
  6c764ba

  Copy full SHA for 6c764ba

• Transpose fc1/2 weights

  gordicaleksa

  committed
  a96a40a

  Copy full SHA for a96a40a

Commits on Jul 22, 2024

• Merge branch 'master' into add_c_imp

  gordicaleksa

  committed
  c4c8b0e

  Copy full SHA for c4c8b0e

• Update hyperparams - sync with pt/np references

  gordicaleksa

  committed
  e0f5ae6

  Copy full SHA for e0f5ae6

• Add timer logic

  gordicaleksa

  committed
  a97009a

  Copy full SHA for a97009a

• Add sampling logic

  gordicaleksa

  committed
  1a1f40d

  Copy full SHA for 1a1f40d

• Increase loss printing precision

  gordicaleksa

  committed
  abc5d6a

  Copy full SHA for abc5d6a

Commits on Jul 23, 2024

• Fix segfault issue due to uninit pointers on mac

  gordicaleksa

  committed
  91232d1

  Copy full SHA for 91232d1

Commits on Jul 24, 2024

• many changes. it's still a total mess, few more hours of work remaining

  karpathy

  committed
  cbf08bf

  Copy full SHA for cbf08bf