7 Commits

Author	SHA1	Message	Date
OlivierDehaene	a2985036aa	feat(server): Add model tests (#6)	2022-12-08 18:49:33 +01:00
Nick Hill	31d76e238d	fix(batching): Avoid theoretical hang in batcher loop (#5) ... - Avoid theoretical hang in batcher loop - Avoid a couple of clones in the router generate method - Keep attention mask tensors as integers - Remove num_heads attribute Co-authored-by: OlivierDehaene <Olivier.dehaene@gmail.com>	2022-12-05 10:10:59 +01:00
OlivierDehaene	daa1d81d5e	feat(server): Support Galactica (#4)	2022-12-01 19:31:54 +01:00
OlivierDehaene	dccd5c2b1a	feat(server): Clarify CausalLMBatch concatenate method	2022-11-09 18:24:07 +01:00
OlivierDehaene	4236e41b0d	feat(server): Improved doc	2022-11-07 12:53:56 +01:00
OlivierDehaene	427d7cc444	feat(server): Support AutoModelForSeq2SeqLM	2022-11-04 18:03:04 +01:00
OlivierDehaene	c5665f5c8b	feat(server): Support generic AutoModelForCausalLM	2022-11-04 14:22:47 +01:00