Qfl3x

Best Practices

Testing with pytest:

We want to implement tests for the Lambda function.

Installing pytest as a dev dependency using pipenv:

pipenv install --dev pytest

Qfl3x

Week 5 of MLOps Zoomcamp

Link to Course: https://github.com/DataTalksClub/mlops-zoomcamp

Monitoring

Why monitor ML models:

Our ML production models are production software and thus face the same problems faced by other production SE/SD software. However, in addition to these general issues, certain ML-specific issues may occur in ML production models that don't in SE/SD. As such, SE/SD tools are not sufficient to monitor ML production models.

Monitoring ML models is mostly around monitoring four sectors:

Qfl3x

In order to add a new IAM service account to publish on PubSub and download its key, we must:

1. Create a new IAM service account
2. Give it PubSub Editor role

Creating a new IAM service account:

To create a new IAM service account, simply follow the instructions provided here: https://cloud.google.com/iam/docs/creating-managing-service-accounts#creating

Giving it a PubSub Editor role:

Qfl3x

Week 4 of MLOps-Zoomcamp

Link to Course: https://github.com/DataTalksClub/mlops-zoomcamp

Deployment

Quick recap:

We've learned how to rewrite our training into a workflow. Now we'll study how to deploy the resulting model.

Qfl3x

NOTE: commands and UI are deprecated

Content:

• Negative Engineering
• What is workflow orchestration?
• Introduction to Prefect 2.0
• First Prefect flow and Basics

Workflow Orchestration

Qfl3x

Week 2 of MLOps Zoomcamp

Link to Course: https://github.com/DataTalksClub/mlops-zoomcamp

Introduction to MLflow, ML experiments and model registry.

Introduction:

Definitions:

• ML experiment: the process of building an ML model; The whole process in which a Data Scientist creates and optimizes a model

Qfl3x

GameAction [AppID 570, ActionID 5] : LaunchApp changed task to UpdatingAppInfo with ""
GameAction [AppID 570, ActionID 5] : LaunchApp changed task to SynchronizingCloud with ""
GameAction [AppID 570, ActionID 5] : LaunchApp changed task to ProcessingShaderCache with ""
GameAction [AppID 570, ActionID 5] : LaunchApp changed task to SiteLicenseSeatCheckout with ""
GameAction [AppID 570, ActionID 5] : LaunchApp changed task to CreatingProcess with ""
GameAction [AppID 570, ActionID 5] : LaunchApp waiting for user response to CreatingProcess ""
GameAction [AppID 570, ActionID 5] : LaunchApp continues with user response "CreatingProcess"
Opted-in Controller Mask: 0
Game update: AppID 570 "", ProcID 10977, IP 0.0.0.0:0
ERROR: ld.so: object '/home/qflex/.local/share/Steam/ubuntu12_32/gameoverlayrenderer.so' from LD_PRELOAD cannot be preloaded (wrong ELF class: ELFCLASS32): ignored.

Qfl3x

Computer Information:
    Manufacturer:  Unknown
    Model:  Unknown
    Form Factor: Desktop
    No Touch Input Detected

Processor Information:
    CPU Vendor:  GenuineIntel
    CPU Brand:  Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
    CPU Family:  0x6

Qfl3x