shen/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2024-11-25 16:22:50 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
main
LLMs-from-scratch/ch04
History
Sebastian Raschka b6c4b2f9f1
Some checks are pending
Check hyperlinks / test (push) Waiting to run
Details
Spell Check / spellcheck (push) Waiting to run
Details
PEP8 Style checks / flake8 (push) Waiting to run
Details
Update bonus section formatting (#400)
2024-10-12 10:26:08 -05:00
..
01_main-chapter-code note about random numbers 2024-09-22 12:02:03 -05:00
02_performance-analysis update card 2024-10-11 12:15:01 -05:00
README.md Update bonus section formatting (#400) 2024-10-12 10:26:08 -05:00

README.md

Chapter 4: Implementing a GPT Model from Scratch to Generate Text

 

Main Chapter Code

 

Bonus Materials

  • 02_performance-analysis contains optional code analyzing the performance of the GPT model(s) implemented in the main chapter
  • ch05/07_gpt_to_llama contains a step-by-step guide for converting a GPT architecture implementation to Llama 3.2 and loads pretrained weights from Meta AI (it might be interesting to look at alternative architectures after completing chapter 4, but you can also save that for after reading chapter 5)