ferrisargyle
ferrisargyle
/ genai-llm-audit-log.json
Last active
September 5, 2023 20:24
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "protoPayload": { | |
| "@type": "type.googleapis.com/google.cloud.audit.AuditLog", | |
| "authenticationInfo": { | |
| "principalEmail": "account@domain", | |
| "principalSubject": "user:account@domain" | |
| }, | |
| "requestMetadata": { | |
| "callerIp": "x.x.x.x", | |
| "callerSuppliedUserAgent": "grpc-python/1.51.3 grpc-c/29.0.0 (linux; chttp2),gzip(gfe)", |
ferrisargyle
/ consumerquota-limits-zero.txt
Created
August 6, 2023 01:53
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| - consumerOverride: | |
| dimensions: | |
| base_model: text-bison | |
| region: ... | |
| name: ... | |
| defaultLimit: '60' | |
| dimensions: | |
| base_model: text-bison | |
| region: ... |
ferrisargyle
/ consumerquota-limits-nonzero.txt
Last active
August 6, 2023 01:48
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| consumerQuotaLimits: | |
| - metric: aiplatform.googleapis.com/online_prediction_requests_per_base_model | |
| quotaBuckets: | |
| - {} | |
| - dimensions: | |
| region: ... | |
| - consumerOverride: | |
| dimensions: | |
| base_model: text-bison | |
| region: us-central1 |
ferrisargyle
/ quota-list.sh
Created
August 6, 2023 01:44
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| gcloud alpha services quota list --service=aiplatform.googleapis.com \ | |
| --consumer=projects/[project] \ | |
| --filter=metric=aiplatform.googleapis.com/online_prediction_requests_per_base_model \ | |
| > tmp.txt |
ferrisargyle
/ quota-override-nonzero.sh
Created
August 6, 2023 01:41
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| gcloud alpha services quota update --service=aiplatform.googleapis.com \ | |
| --consumer=projects/[project] --dimensions=region=[region] \ | |
| --dimensions=base_model=text-bison --value=59 \ | |
| --metric=aiplatform.googleapis.com/online_prediction_requests_per_base_model \ | |
| --unit=1/min/{project}/{region}/{base_model} \ |
ferrisargyle
/ quota-override-zero.sh
Last active
August 6, 2023 01:39
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| gcloud alpha services quota update --service=aiplatform.googleapis.com \ | |
| --consumer=projects/[project] --dimensions=region=[region] \ | |
| --dimensions=base_model=text-bison --value=0 \ | |
| --metric=aiplatform.googleapis.com/online_prediction_requests_per_base_model \ | |
| --unit=1/min/{project}/{region}/{base_model} \ | |
| --force |
ferrisargyle
/ ai-platform-training.sh
Created
December 26, 2020 23:58
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Example Custom Container Job | |
| # To submit a job to AI Platform Training | |
| ## Set required environment variables | |
| ``` | |
| # Replace with your project id, region, and image name | |
| PROJECT=[project-id] | |
| REGION=[region] | |
| IMAGE_URI=gcr.io/${PROJECT}/[image-name]:latest |
ferrisargyle
/ papermill-training-parameter.sh
Created
December 26, 2020 23:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /home/jupyter/AIHub:~$ sudo papermill \ | |
| ./training-local-args.ipynb \ | |
| ./training-output.ipynb -p epochs 2 |
ferrisargyle
/ papermill-training-monitor.sh
Created
December 26, 2020 23:47
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ~$ sudo tail -f /proc/<pid>/fd/1 |
ferrisargyle
/ papermill-training-output-file.sh
Created
December 26, 2020 23:45
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /home/jupyter/AIHub:~$ sudo papermill \ | |
| /home/jupyter/AIHub/training-local-args.ipynb \ | |
| /home/jupyter/AIHub/training-output.ipynb -p epochs 2 &> \ | |
| ~/output.txt & | |
| /home/jupyter/AIHub:~$ disown |
NewerOlder