huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-19 22:02:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
remove_post_load_weights
text-generation-inference/aml
History
OlivierDehaene e114d87486
feat(ci): push to AML registry (#56)
2023-02-06 14:33:56 +01:00
..
deployment.yaml feat(ci): push to AML registry (#56) 2023-02-06 14:33:56 +01:00
endpoint.yaml Update aml deployment 2022-10-17 10:39:59 +02:00
model.yaml feat(ci): push to AML registry (#56) 2023-02-06 14:33:56 +01:00
README.md feat(ci): push to AML registry (#56) 2023-02-06 14:33:56 +01:00

README.md

Azure ML endpoint

Create all resources

az ml model create -f model.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace
az ml online-endpoint create -f endpoint.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace
az ml online-deployment create -f deployment.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace

Update deployment

az ml online-deployment update -f deployment.yaml -g HuggingFace-BLOOM-ModelPage -w HuggingFace