2 Commits

Author	SHA1	Message	Date
OlivierDehaene	e7e3aa6cac	chore: update to torch 2.4 (#2259) ... * chore: update to torch 2.4 * remove un-necessary patch * fix	2024-07-23 20:39:43 +00:00
OlivierDehaene	53ec0b790b	feat(fp8): use fbgemm kernels and load fp8 weights directly (#2248) ... * feat(fp8): add support for fbgemm * allow loading fp8 weights directly * update outlines * fix makefile * build fbgemm * avoid circular import and fix dockerfile * add default dtype * refactored weights loader * fix auto conversion * fix quantization config parsing * force new nccl on install * missing get_weights implementation * increase timeout	2024-07-20 19:02:04 +02:00