shen/LLMs-from-scratch

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2024-11-25 16:22:50 +08:00

History

rasbt cd2753a36d Some checks failed Code tests (Linux) / test (push) Has been cancelled Details Code tests (macOS) / test (push) Has been cancelled Details Test PyTorch 2.0 and 2.4 / test (2.0.1) (push) Has been cancelled Details Test PyTorch 2.0 and 2.4 / test (2.4.0) (push) Has been cancelled Details Code tests (Windows) / test (push) Has been cancelled Details Check hyperlinks / test (push) Has been cancelled Details Spell Check / spellcheck (push) Has been cancelled Details PEP8 Style checks / flake8 (push) Has been cancelled Details update mmap section		2024-10-14 14:27:19 -05:00
..
memory-efficient-state-dict.ipynb	update mmap section	2024-10-14 14:27:19 -05:00
previous_chapters.py	Memory efficient weight loading (#401 )	2024-10-14 10:30:25 -05:00
README.md	Memory efficient weight loading (#401 )	2024-10-14 10:30:25 -05:00

README.md

Memory-efficient Model Weight Loading

This folder contains code to illustrate how to load model weights more efficiently

memory-efficient-state-dict.ipynb: contains code to load model weights via PyTorch's load_state_dict method more efficiently