MLFlow

mlflow is an open source platform for managing the end to end machine learning lifecycl see mlflow docs to learn more this document provides an overview of the use of the aishield api with mlflow and logs artifact received from the api in the following sections, you can learn how to install packages, load datasets, train the model, prepare an artifact for an aishield api call, and perform the aishield api call installation to install packages, run the following command pip install r requirements txt load dataset download the mnist dataset from tensorflow, preprocess it, and split the data set into train, test, and validation in a ratio of 54k 6k 10k visualize sample data model training create model architecture and train it on training data after training, validate on the validation dataset model accuracy is expected to be around 99 3% prepare artifact for the aishield api call save a sample of data, its label, and model as a zip file the zip file is needed during the aishield api call aishield api call requirements get aishield api endpoint, x api key, and ord id from the aishield team call the model registration api this api will return a unique model id and path to upload data, model, and label it will also return a sample request payload for a model analysis api upload the data, model, and label to the given url after successful upload, call the model analysis api and pass the payload in the response, you will get a unique job id and monitor link the monitor link can be used to track the progress of the triggered job monitor the progress of the job id using the get api, and after successful completion, download the artifacts and log them to mlflow as an artifact the artifacts will contain vulnerability and defense reports, attack samples, defense artifact load the aishield provided defense model and pass a sample of original data and attack data to get a prediction from the defense model to integrate with siem solutions such as microsoft sentinel and splunk, please follow the instructions below for the microsoft sentinel connector, provide azure log customer id and azure log shared key while creating the aisdefensemodel object for splunk connector, provide splunk url and splunk authorization while creating the aisdefensemodel object to learn more see the reference implementatoin notebook for flflow