..
__snapshots__
fix: improve tool type, bump pydantic and outlines ( #1650 )
2024-03-21 12:45:56 -04:00
test_bloom_560m.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_bloom_560m_sharded.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_flash_awq.py
fix(router): fix openapi and add jsonschema validation ( #1578 )
2024-02-21 11:05:32 +01:00
test_flash_awq_sharded.py
fix(router): fix openapi and add jsonschema validation ( #1578 )
2024-02-21 11:05:32 +01:00
test_flash_falcon.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_flash_gemma.py
feat: add support for Gemma ( #1583 )
2024-02-21 14:15:22 +01:00
test_flash_grammar_llama.py
fix: correctly index into mask when applying grammar ( #1618 )
2024-03-01 18:22:01 +01:00
test_flash_llama.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_flash_llama_gptq.py
feat: add cuda memory fraction ( #659 )
2023-07-24 11:43:58 +02:00
test_flash_medusa.py
Revamp medusa implementation so that every model can benefit. ( #1588 )
2024-02-26 19:49:28 +01:00
test_flash_mistral.py
fix(router): fix openapi and add jsonschema validation ( #1578 )
2024-02-21 11:05:32 +01:00
test_flash_neox.py
feat(server): add paged attention to flash models ( #516 )
2023-06-30 19:09:59 +02:00
test_flash_neox_sharded.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_flash_phi.py
fix(router): fix openapi and add jsonschema validation ( #1578 )
2024-02-21 11:05:32 +01:00
test_flash_qwen2.py
feat: Qwen2 ( #1608 )
2024-02-28 15:50:31 +01:00
test_flash_santacoder.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_flash_starcoder.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_flash_starcoder2.py
feat: starcoder2 ( #1605 )
2024-02-28 12:07:08 +01:00
test_flash_starcoder_gptq.py
fix(router): fix openapi and add jsonschema validation ( #1578 )
2024-02-21 11:05:32 +01:00
test_grammar_llama.py
fix: correctly index into mask when applying grammar ( #1618 )
2024-03-01 18:22:01 +01:00
test_idefics.py
fix: prefer spaces url over temp url ( #1662 )
2024-03-21 17:34:25 +01:00
test_mamba.py
fix(router): fix openapi and add jsonschema validation ( #1578 )
2024-02-21 11:05:32 +01:00
test_mpt.py
feat(server): Add Non flash MPT. ( #514 )
2023-07-03 13:01:46 +02:00
test_mt0_base.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_neox.py
feat(server): Rework model loading ( #344 )
2023-06-08 14:51:52 +02:00
test_neox_sharded.py
feat(server): Rework model loading ( #344 )
2023-06-08 14:51:52 +02:00
test_t5_sharded.py
feat(server): only compute prefill logprobs when asked ( #406 )
2023-06-02 17:12:30 +02:00
test_tools_llama.py
fix: improve tool type, bump pydantic and outlines ( #1650 )
2024-03-21 12:45:56 -04:00