gistfile1.txt

$ sky launch -c mixtral ./azure_serve.yaml


Task from YAML spec: ./azure_serve.yaml
I 03-20 09:31:10 optimizer.py:691] == Optimizer ==
I 03-20 09:31:10 optimizer.py:702] Target: minimizing cost
I 03-20 09:31:10 optimizer.py:714] Estimated cost: $7.3 / hour
I 03-20 09:31:10 optimizer.py:714]
I 03-20 09:31:10 optimizer.py:837] Considered resources (1 node):
I 03-20 09:31:10 optimizer.py:907] --------------------------------------------------------------------------------------------------------
I 03-20 09:31:10 optimizer.py:907]  CLOUD   INSTANCE                	vCPUs   Mem(GB)   ACCELERATORS   REGION/ZONE   COST ($)   CHOSEN   
I 03-20 09:31:10 optimizer.py:907] --------------------------------------------------------------------------------------------------------
I 03-20 09:31:10 optimizer.py:907]  Azure   Standard_NC48ads_A100_v4	48  	440   	A100-80GB:2	eastus    	7.35      	✔	 
I 03-20 09:31:10 optimizer.py:907]  Azure   Standard_NC96ads_A100_v4	96  	880   	A100-80GB:4	eastus    	14.69          	 
I 03-20 09:31:10 optimizer.py:907]  Azure   Standard_ND96asr_v4     	96  	900   	A100:8     	eastus    	27.20          	 
I 03-20 09:31:10 optimizer.py:907]  Azure   Standard_ND96amsr_A100_v4   96  	1924  	A100-80GB:8	eastus    	32.77          	 
I 03-20 09:31:10 optimizer.py:907] --------------------------------------------------------------------------------------------------------
I 03-20 09:31:10 optimizer.py:907]
Launching a new cluster 'mixtral'. Proceed? [Y/n]: