Nicolas Patry 0c9b6cdd76 Choosing input/total tokens automatically based on available VRAM? (#2673) ... * Choosing input/total tokens automatically based on available VRAM? * Update doc. * Remove generated files. * Trying to fix non chunking targets. * Attempt #2 * fix. * QuantLinear is rocm compatible. * Much simpler logic after the overhead. * Updating logic + non flash. * Revert doc text. * Simple updates. * Fix integration mt0 (transformers update).		2024-10-28 04:59:49 +01:00
..
client	Choosing input/total tokens automatically based on available VRAM? (#2673)	2024-10-28 04:59:49 +01:00
grpc-metadata	Rebase TRT-llm (#2331)	2024-07-31 10:33:10 +02:00
trtllm	Add support for stop words in TRTLLM (#2678)	2024-10-25 10:58:34 +02:00
v2	Fixing "deadlock" when python prompts for trust_remote_code by always (#2664)	2024-10-25 06:39:21 +02:00
v3	Choosing input/total tokens automatically based on available VRAM? (#2673)	2024-10-28 04:59:49 +01:00