Polyaxon allows users to manage all logs generated by jobs, builds, and experiments containers in Azure Storage.

Create an Azure Storage account

You should create a storage account (e.g. plx-storage) and a blob (e.g. logs). You should then create a file with your access information json object, e.g. az-key.json. This file should include the following information:

{ 
  "AZURE_ACCOUNT_NAME": "plx-storage",
  "AZURE_ACCOUNT_KEY": "your key",
  "AZURE_CONNECTION_STRING": "your connection string",
}

Create a secret on Kubernetes

You should then create a secret with this access keys information on Kubernetes on the same namespace as Polyaxon deployment:

kubectl create secret generic az-secret --from-file=az-secret.json=path/to/az-key.json -n polyaxon

Use the secret name and secret in your logs persistence definition

persistence:
  logs:
    store: azure
    bucket: wasbs://[CONTAINER-NAME]@[ACCOUNT-NAME].blob.core.windows.net/
    secret: [SECRET-NAME]
    secretKey: [SECRET-KEY]

e.g.

persistence:
  logs:
    store: azure
    bucket: wasbs://[email protected]/
    secret: az-secret
    secretKey: az-secret.json