Storage Account
Datalogz uses Azure Storage Account to stage external files for ingestion into the target warehouse. This is default for Snowflake warehouses and optional for Postgres warehouses.
Login to Azure Portal and create a new Gen2 Storage Account (hierarchical namespace).
Add the storage account to the appropriate virtual network from Storage Account > Networking panel.
Create a new container named
datalogzbidiagnostics
Set the access level to Private
Ensure the following environment variables have been added to your Azure Key Vault. These are required for your VM or environment credentials to be authenticated to read/write to the storage container:
Navigate to Key Vault > Secrets and click Generate/Import
Create a new secret key and value for each of the following:
AZURE-BLOB-CONTAINER-NAME
AZURE-BLOB-STORAGE-ACCOUNT-NAME
AZURE-BLOB-CONNECTION-STRING
The values for these are available in your Storage Account:
The value for
AZURE-BLOB-CONTAINER-NAME
should be set todatalogzbidiagnostics
The value for
AZURE-BLOB-STORAGE-ACCOUNT-NAME
should be set to the name of your storage account.The value for
AZURE-BLOB-CONNECTION-STRING
can be found in:Storage Account > Access Keys > Connection String
Last updated