hf_text-generation-inference

Commit Graph

Author	SHA1	Message	Date
Nicolas Patry	9c739651cd	Upgrade fbgemm (#2398 ) * Upgrade fbgemm * Fix fbgemm version	2024-08-12 14:08:38 +02:00
OlivierDehaene	e7e3aa6cac	chore: update to torch 2.4 (#2259 ) * chore: update to torch 2.4 * remove un-necessary patch * fix	2024-07-23 20:39:43 +00:00
OlivierDehaene	53ec0b790b	feat(fp8): use fbgemm kernels and load fp8 weights directly (#2248 ) * feat(fp8): add support for fbgemm * allow loading fp8 weights directly * update outlines * fix makefile * build fbgemm * avoid circular import and fix dockerfile * add default dtype * refactored weights loader * fix auto conversion * fix quantization config parsing * force new nccl on install * missing get_weights implementation * increase timeout	2024-07-20 19:02:04 +02:00

Author

SHA1

Message

Date

Nicolas Patry

9c739651cd

Upgrade fbgemm (#2398 )

* Upgrade fbgemm

* Fix fbgemm version

2024-08-12 14:08:38 +02:00

OlivierDehaene

e7e3aa6cac

chore: update to torch 2.4 (#2259 )

* chore: update to torch 2.4

* remove un-necessary patch

* fix

2024-07-23 20:39:43 +00:00

OlivierDehaene

53ec0b790b

feat(fp8): use fbgemm kernels and load fp8 weights directly (#2248 )

* feat(fp8): add support for fbgemm

* allow loading fp8 weights directly

* update outlines

* fix makefile

* build fbgemm

* avoid circular import and fix dockerfile

* add default dtype

* refactored weights loader

* fix auto conversion

* fix quantization config parsing

* force new nccl on install

* missing get_weights implementation

* increase timeout

2024-07-20 19:02:04 +02:00

3 Commits