hf_text-generation-inference/server/tests/utils
Nicolas Patry e943a294bc
fix(server): harden the weights choice to save on disk. (#561)
- Look at `transformers` base class to check for
  `_key_to_ignore_on_load_missing` or `_tied_weights` which are the
  standard attributes to select the keys to NOT save on disk (since they
  are ignored)

- Modified safetensors code (to be reflected in safetensors even if it's
  an internal function).
  
- Will not work for trust_remote_code=True repos (like santacoder).

Should help with :
https://github.com/huggingface/text-generation-inference/issues/555
and : https://github.com/huggingface/text-generation-inference/pull/501
and https://github.com/huggingface/text-generation-inference/issues/556
and
https://github.com/huggingface/text-generation-inference/issues/482#issuecomment-1623713593
2023-07-07 14:50:12 +02:00
..
test_convert.py fix(server): harden the weights choice to save on disk. (#561) 2023-07-07 14:50:12 +02:00
test_hub.py feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00
test_tokens.py fix(server): fix escape characters in stop sequence (#155) 2023-04-05 19:37:41 +02:00
test_watermark.py feat(server): add watermarking tests (#248) 2023-04-27 19:16:35 +02:00