hf_text-generation-inference

Commit Graph

Author	SHA1	Message	Date
drbh	de6cb15fa5	fix: improve tool type, bump pydantic and outlines (#1650 ) This PR resolves a couple - [X] adjusts the tool response to align with openai's tools response type - [X] bumps pydantic to `2.6.4` in all apps (resolves dependency issue when running tests) - [X] bump `outlines` version and fix import for new name	2024-03-21 12:45:56 -04:00
drbh	7dbaf9e901	fix: correctly index into mask when applying grammar (#1618 ) This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models	2024-03-01 18:22:01 +01:00
drbh	9b6db5f793	Support tools (#1587 ) This work in progress PR begins to add support for tools. Tools relies on grammar support and still has some unsolved challenges. Opening the PR for visibility and feedback	2024-02-28 11:10:27 +01:00

Author

SHA1

Message

Date

drbh

de6cb15fa5

fix: improve tool type, bump pydantic and outlines (#1650 )

This PR resolves a couple 

- [X] adjusts the tool response to align with openai's tools response
type
- [X] bumps pydantic to `2.6.4` in all apps (resolves dependency issue
when running tests)
- [X] bump `outlines` version and fix import for new name

2024-03-21 12:45:56 -04:00

drbh

7dbaf9e901

fix: correctly index into mask when applying grammar (#1618 )

This PR fixes how the grammar mask is index when generating text and
adds a new test to ensure the grammars work with non flash models

2024-03-01 18:22:01 +01:00

drbh

9b6db5f793

Support tools (#1587 )

This work in progress PR begins to add support for tools. Tools relies
on grammar support and still has some unsolved challenges. Opening the
PR for visibility and feedback

2024-02-28 11:10:27 +01:00

3 Commits