hf_text-generation-inference/aml/README.md

15 lines
457 B
Markdown
Raw Normal View History

2023-02-06 06:33:56 -07:00
# Azure ML endpoint
## Create all resources
2022-10-15 12:21:50 -06:00
2023-02-06 06:33:56 -07:00
```shell
2022-10-17 02:39:59 -06:00
az ml model create -f model.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace
2022-10-15 12:21:50 -06:00
az ml online-endpoint create -f endpoint.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace
az ml online-deployment create -f deployment.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace
2023-02-06 06:33:56 -07:00
```
## Update deployment
```shell
az ml online-deployment update -f deployment.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace
2022-10-15 12:21:50 -06:00
```