Skip to content

Instantly share code, notes, and snippets.

@chainzero
Created February 27, 2024 15:58
Show Gist options
  • Save chainzero/b21f34f4be2cbb0a882177b00c52e90b to your computer and use it in GitHub Desktop.
Save chainzero/b21f34f4be2cbb0a882177b00c52e90b to your computer and use it in GitHub Desktop.
GPU deployment with ram specified
- SDL used in testing:
```
---
version: "2.0"
services:
obtaingpuone:
image: ubuntu:22.04
command:
- "sh"
- "-c"
args:
- 'uptime;
nvidia-smi;
sleep infinity'
expose:
- port: 8080
as: 80
to:
- global: true
profiles:
compute:
obtaingpu:
resources:
cpu:
units: 0.1
memory:
size: 256Mi
gpu:
units: 1
attributes:
vendor:
nvidia:
- model: a100
ram: 40Gi
storage:
size: 256Mi
placement:
akash:
pricing:
obtaingpu:
denom: uakt
amount: 100000
deployment:
obtaingpuone:
akash:
profile: obtaingpu
count: 1
```
- Order details when created from CLI using provider services version 0.5.2
```
provider-services query market order get --dseq 15197472 --owner akash1w3k6qpr4uz44py4z68chfrl7ltpxwtkngnc6xk
created_at: "15197474"
order_id:
dseq: "15197472"
gseq: 1
oseq: 1
owner: akash1w3k6qpr4uz44py4z68chfrl7ltpxwtkngnc6xk
spec:
name: akash
requirements:
attributes: []
signed_by:
all_of: []
any_of: []
resources:
- count: 1
price:
amount: "100000.000000000000000000"
denom: uakt
resource:
cpu:
attributes: []
units:
val: "100"
endpoints:
- kind: SHARED_HTTP
sequence_number: 0
gpu:
attributes:
- key: vendor/nvidia/model/a100/ram/40Gi
value: "true"
units:
val: "1"
id: 1
memory:
attributes: []
quantity:
val: "268435456"
storage:
- attributes: []
name: default
quantity:
val: "268435456"
state: open
```
- Order details when created with Cloudmos
```
provider-services query market order get --dseq 15197499 --owner akash1w3k6qpr4uz44py4z68chfrl7ltpxwtkngnc6xk
created_at: "15197501"
order_id:
dseq: "15197499"
gseq: 1
oseq: 1
owner: akash1w3k6qpr4uz44py4z68chfrl7ltpxwtkngnc6xk
spec:
name: akash
requirements:
attributes: []
signed_by:
all_of: []
any_of: []
resources:
- count: 1
price:
amount: "10000.000000000000000000"
denom: uakt
resource:
cpu:
attributes: []
units:
val: "100"
endpoints:
- kind: SHARED_HTTP
sequence_number: 0
gpu:
attributes:
- key: vendor/nvidia/model/a100
value: "true"
units:
val: "1"
id: 1
memory:
attributes: []
quantity:
val: "268435456"
storage:
- attributes: []
name: default
quantity:
val: "268435456"
state: open
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment