| .. |
|
custom_kernels
|
All integration tests back everywhere (too many failed CI). (#2428)
|
2024-08-16 21:19:46 +02:00 |
|
exllama_kernels
|
Update ROCM libs and improvements (#2579)
|
2024-09-30 10:54:32 +02:00 |
|
exllamav2_kernels
|
Update ROCM libs and improvements (#2579)
|
2024-09-30 10:54:32 +02:00 |
|
tests
|
feat: prefill chunking (#2600)
|
2024-10-16 12:49:33 +02:00 |
|
text_generation_server
|
Break cycle between the attention implementations and KV cache (#2627)
|
2024-10-17 14:54:22 +02:00 |
|
.gitignore
|
Impl simple mamba model (#1480)
|
2024-02-08 10:19:45 +01:00 |
|
Makefile
|
Lots of improvements (Still 2 allocators) (#2449)
|
2024-08-29 16:29:01 +02:00 |
|
Makefile-awq
|
chore: add pre-commit (#1569)
|
2024-02-16 11:58:58 +01:00 |
|
Makefile-eetq
|
Upgrade EETQ (Fixes the cuda graphs). (#1729)
|
2024-04-12 08:15:28 +02:00 |
|
Makefile-exllamav2
|
Upgrading exl2. (#2415)
|
2024-08-14 11:58:08 +02:00 |
|
Makefile-fbgemm
|
Add Directory Check to Prevent Redundant Cloning in Build Process (#2486)
|
2024-09-07 13:19:43 +02:00 |
|
Makefile-flash-att
|
Hotfixing `make install`. (#2008)
|
2024-06-04 23:34:03 +02:00 |
|
Makefile-flash-att-v2
|
Update ROCM libs and improvements (#2579)
|
2024-09-30 10:54:32 +02:00 |
|
Makefile-flashinfer
|
Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)
|
2024-09-11 18:10:40 +02:00 |
|
Makefile-lorax-punica
|
Enable multiple LoRa adapters (#2010)
|
2024-06-25 14:46:27 -04:00 |
|
Makefile-selective-scan
|
chore: add pre-commit (#1569)
|
2024-02-16 11:58:58 +01:00 |
|
Makefile-vllm
|
Update ROCM libs and improvements (#2579)
|
2024-09-30 10:54:32 +02:00 |
|
README.md
|
chore: add pre-commit (#1569)
|
2024-02-16 11:58:58 +01:00 |
|
poetry.lock
|
Add support for fused MoE Marlin for AWQ (#2616)
|
2024-10-08 11:56:41 +02:00 |
|
pyproject.toml
|
nix: add black and isort to the closure (#2619)
|
2024-10-09 11:08:02 +02:00 |
|
requirements_cuda.txt
|
Mllama flash version (#2585)
|
2024-10-02 11:22:13 +02:00 |
|
requirements_intel.txt
|
Mllama flash version (#2585)
|
2024-10-02 11:22:13 +02:00 |
|
requirements_rocm.txt
|
Mllama flash version (#2585)
|
2024-10-02 11:22:13 +02:00 |
8ec57558cd