Commit Graph

755 Commits

Author SHA1 Message Date
rasbt
bfa4215774
llama note
Some checks failed
Code tests (Linux) / test (push) Has been cancelled
Code tests (macOS) / test (push) Has been cancelled
Test PyTorch 2.0 and 2.4 / test (2.0.1) (push) Has been cancelled
Test PyTorch 2.0 and 2.4 / test (2.4.0) (push) Has been cancelled
Code tests (Windows) / test (push) Has been cancelled
Check hyperlinks / test (push) Has been cancelled
Spell Check / spellcheck (push) Has been cancelled
PEP8 Style checks / flake8 (push) Has been cancelled
2024-09-26 07:41:11 -05:00
Sebastian Raschka
7ef5129e18
Fix truncation issue in classify_review function (#373)
Some checks are pending
Code tests (Linux) / test (push) Waiting to run
Code tests (macOS) / test (push) Waiting to run
Test PyTorch 2.0 and 2.4 / test (2.0.1) (push) Waiting to run
Test PyTorch 2.0 and 2.4 / test (2.4.0) (push) Waiting to run
Code tests (Windows) / test (push) Waiting to run
Check hyperlinks / test (push) Waiting to run
Spell Check / spellcheck (push) Waiting to run
PEP8 Style checks / flake8 (push) Waiting to run
2024-09-25 19:54:36 -05:00
Sebastian Raschka
b56d0b2942
Add llama2 unit tests (#372)
* add llama2 unit tests

* update

* updates

* updates

* update file path

* update requirements file

* rmsnorm test

* update
2024-09-25 19:40:36 -05:00
rasbt
a6d8e93da3
improve formatting 2024-09-24 18:49:17 -05:00
Daniel Kleine
ff31b345b0
ch05/07 gpt_to_llama text improvements (#369)
* fixed typo

* fixed RMSnorm formula

* fixed SwiGLU formula

* temperature=0 for untrained model for reproducibility

* added extra info hf token
2024-09-24 18:45:49 -05:00
rasbt
d144bd5b7a
add json import 2024-09-23 09:12:35 -05:00
rasbt
6bc3de165c
move access token to config.json 2024-09-23 08:56:16 -05:00
rasbt
58df945ed4
add llama3 comparison 2024-09-23 08:17:10 -05:00
Sebastian Raschka
0467c8289b
GPT to Llama (#368)
* GPT to Llama

* fix urls
2024-09-23 07:34:06 -05:00
rasbt
dc1b1a05b0
note about random numbers 2024-09-22 12:02:03 -05:00
Daniel Kleine
5f36d2af4c
removed unnecessary imports (#367) 2024-09-22 11:59:37 -05:00
Sebastian Raschka
76e9a9ec02
Add user interface to ch06 and ch07 (#366)
* Add user interface to ch06 and ch07

* pep8

* fix url
2024-09-21 20:33:00 -05:00
rasbt
6f6dfb6796
remove unused function from user interface 2024-09-21 14:17:35 -05:00
Sebastian Raschka
52ee1c7cdb
Add missing bullet point 2024-09-21 12:59:12 -05:00
Sebastian Raschka
222f7b16f8 update gpt-2 paper url 2024-09-20 07:00:06 -07:00
Daniel Kleine
eefe4bf12b
Chainlit bonus material fixes (#361)
* fix cmd

* moved idx to device

* improved code with clone().detach()

* fixed path

* fix: added extra line for pep8

* updated .gitginore

* Update ch05/06_user_interface/app_orig.py

* Update ch05/06_user_interface/app_own.py

* Apply suggestions from code review

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-18 08:08:50 -07:00
Sebastian Raschka
ea9b4e83a4
Add chatpgpt-like user interface (#360)
* Add chatpgpt-like user interface

* fixes
2024-09-17 08:26:44 -05:00
rasbt
b4f72812ed
update link checking 2024-09-15 08:16:23 -05:00
rasbt
6110858d5b
Clarify API usage limits in bonus content 2024-09-15 08:05:04 -05:00
Daniel Kleine
cc0c28dbf5
improved .vscode setup instructions (#353)
* improved .vscode project setup

* fixed spell check

* add missing 'p'

* Update README.md

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-15 07:43:43 -05:00
Jinge Wang
4210386cec
Fix 2 typos in 04_preferene-tuning-with-dpo (#356) 2024-09-15 07:36:22 -05:00
rasbt
962dc6f5de
update setup guide 2024-09-13 08:16:53 -05:00
Mingyuan Xu
f77c376b05
Run generate example in ch06 optionally on GPU (#352)
* model.to("cuda")

model.to("cuda")

* update device placement

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2024-09-13 08:01:52 -05:00
rasbt
6f92909e58
Clarify extension instalation 2024-09-12 07:59:17 -05:00
Sebastian Raschka
11f97a13b6
Simplify conda section 2024-09-11 21:17:59 -05:00
rasbt
f1accdf273
clarifications 2024-09-11 20:16:35 -05:00
rasbt
fe2136e7c9
update title 2024-09-10 21:43:32 -05:00
Sebastian Raschka
835ed29dbf
reflection-tuning dataset generation (#349) 2024-09-10 21:42:12 -05:00
rasbt
8ad50a3315
update gpt-2 paper link 2024-09-09 06:31:28 -05:00
rasbt
1e48c13e89
update gpt-2 paper link 2024-09-08 15:49:44 -05:00
rasbt
b94546aa14
minor spelling fix 2024-09-08 15:35:36 -05:00
Daniel Kleine
2ee3df622e
nbviewer links / typo (#346)
* fixed typo

* removed remaining nbviewer links

* Update mha-implementations.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-07 07:27:28 +02:00
Sebastian Raschka
ad12c8da06
Einsum multi-head attention (#345)
* Einsum multi-head attention

* update diff
2024-09-05 18:24:33 +02:00
Gustavo Monti
34e16991bb
updating REAMDE from chapter 02 inclund 04_bonus section (#344)
* updating REAMDE from chapter 02 inclund 04_bonus section

* Update ch02/README.md

---------

Co-authored-by: Gustavo Monti Rocha <gustavo.rocha@intelliway.com.br>
Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-09-05 08:09:46 +02:00
Sebastian Raschka
91db4e3a0f
Revert nbviewer links 2024-09-05 08:09:33 +02:00
rasbt
9de277421e
consistent header for appendix E 2024-08-30 08:08:01 +02:00
Sebastian Raschka
d391796ec2
use nbviewer links (#339) 2024-08-29 09:09:10 +02:00
rasbt
3760adbd3d
refresh figures 2024-08-27 08:26:40 +02:00
Daniel Kleine
c7267c3b09
ch06/03 fixes (#336)
* fixed bash commands

* fixed help docstrings

* added missing logreg bash cmd

* Update train_bert_hf.py

* Update train_bert_hf_spam.py

* Update README.md

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-27 08:23:25 +02:00
rasbt
91cdfe3309
sklearn baseline and roberta-large update 2024-08-26 10:31:54 +02:00
TITC
4f791e6cc2
add RoBERTa and params frozen (#335)
* add roberta experiment result

* add roberta & params frozen

* Update README.md

* modify lr

* modify lr

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-08-26 10:27:09 +02:00
Sebastian Raschka
26f94876f7
Update README.md 2024-08-24 07:22:18 -05:00
Sebastian Raschka
564362044a
add BERT experiment results (#333)
* add BERT experiment results

* cleanup

* formatting
2024-08-23 08:40:40 -05:00
Sebastian Raschka
ed257789a4
grammar fix 2024-08-21 19:16:21 -05:00
Sebastian Raschka
c2117ca073 topk comment 2024-08-20 20:44:15 -05:00
rasbt
9f0bda7af5
add note about duplicated cell 2024-08-19 21:04:18 -05:00
Sebastian Raschka
01cb137bfd
Note about MPS devices (#329) 2024-08-19 20:58:45 -05:00
Sebastian Raschka
c443035d56
Note about MPS in ch06 and ch07 (#325) 2024-08-19 08:11:33 -05:00
Sebastian Raschka
8ef5022511
Note about ch05 mps support (#324) 2024-08-19 07:40:24 -05:00
rasbt
e7cb2ebd8d
update lora experiments 2024-08-16 08:57:46 -05:00