Nicolas Patry
|
e943a294bc
|
fix(server): harden the weights choice to save on disk. (#561)
- Look at `transformers` base class to check for
`_key_to_ignore_on_load_missing` or `_tied_weights` which are the
standard attributes to select the keys to NOT save on disk (since they
are ignored)
- Modified safetensors code (to be reflected in safetensors even if it's
an internal function).
- Will not work for trust_remote_code=True repos (like santacoder).
Should help with :
https://github.com/huggingface/text-generation-inference/issues/555
and : https://github.com/huggingface/text-generation-inference/pull/501
and https://github.com/huggingface/text-generation-inference/issues/556
and
https://github.com/huggingface/text-generation-inference/issues/482#issuecomment-1623713593
|
2023-07-07 14:50:12 +02:00 |
|
Ehsan M. Kermani
|
f092ba9b22
|
feat(server): add watermarking tests (#248)
|
2023-04-27 19:16:35 +02:00 |
|
OlivierDehaene
|
3f2542bb6a
|
fix(server): fix escape characters in stop sequence (#155)
|
2023-04-05 19:37:41 +02:00 |
|
OlivierDehaene
|
3fef90d50f
|
feat(clients): Python client (#103)
|
2023-03-07 18:52:22 +01:00 |
|
OlivierDehaene
|
0fbc691946
|
feat: add safetensors conversion (#63)
|
2023-02-14 13:02:16 +01:00 |