hf_text-generation-inference/docs/source
drbh 5489406c4a
PR 2634 CI - Fix the tool_choice format for named choice by adapting OpenAIs scheme (#2645)
* add OpenAI like tool_choice for named choice

* add tests

* fix: run linter and bump api docs

* fix: consolidate changes and remove old tool type

* feat: improve, simplify and rename tool choice struct add required support and refactor

* fix: simplify tool choice logic, improve tests, openapi and rust docs

* fix: refactor away prepare_chat_input and improve tool grammar apply control flow

* feat: update docs and add tool choice configuration section

* fix: simplify naming, tool choice default and improve test

* fix: adjust tool choice none logic, add test and small refactors

* fix: add missing snapshot file

* fix: adjust tool choice type in test

* fix: adjust default when json tool choice is

* fix: remove trailing space lint after rebase

* fix: remove mostly mocked unit test

---------

Co-authored-by: Linus Bierhoff <linus.bierhoff@icloud.com>
2024-11-19 13:31:59 -05:00
..
basic_tutorials PR 2634 CI - Fix the tool_choice format for named choice by adapting OpenAIs scheme (#2645) 2024-11-19 13:31:59 -05:00
conceptual chore: prepare 2.4.0 release (#2695) 2024-10-25 21:10:49 +00:00
reference Add initial support for compressed-tensors checkpoints (#2732) 2024-11-10 13:54:07 +01:00
_toctree.yml Small fixes for supported models (#2471) 2024-10-14 15:26:39 +02:00
architecture.md Update architecture.md (#2577) 2024-09-30 08:56:20 +02:00
index.md fix typos in docs and add small clarifications (#1790) 2024-04-22 12:15:48 -04:00
installation.md MI300 compatibility (#1764) 2024-05-17 15:30:47 +02:00
installation_amd.md chore: prepare 2.4.0 release (#2695) 2024-10-25 21:10:49 +00:00
installation_gaudi.md MI300 compatibility (#1764) 2024-05-17 15:30:47 +02:00
installation_inferentia.md MI300 compatibility (#1764) 2024-05-17 15:30:47 +02:00
installation_intel.md chore: prepare 2.4.0 release (#2695) 2024-10-25 21:10:49 +00:00
installation_nvidia.md chore: prepare 2.4.0 release (#2695) 2024-10-25 21:10:49 +00:00
quicktour.md chore: prepare 2.4.0 release (#2695) 2024-10-25 21:10:49 +00:00
supported_models.md Support qwen2 vl (#2689) 2024-10-30 12:40:51 -04:00
usage_statistics.md feat: allow any supported payload on /invocations (#2683) 2024-10-23 11:26:01 +00:00