Storage

Safe way to pass ConnectionString to commands

• Set the environment variable:

$env:AZURE_STORAGE_CONNECTION_STRING="DefaultEndpointsProtocol=..."

• Use the value of the environment variable in azure cli or scripts by specifying the connection string as follows:

$env:AZURE_STORAGE_CONNECTION_STRING

List storage containers

az storage container list --connection-string "DefaultEndpointsProtocol=<protocol>;AccountName=<storage_name>;AccountKey=<secret_key>;EndpointSuffix=core.windows.net"

List all the blob files in a container

az storage blob list --container-name <container_name> --connection-string "DefaultEndpointsProtocol=<protocol>;AccountName=<storage_name>;AccountKey=<secret_key>;EndpointSuffix=core.windows.net"

Download a specific blob file

az storage blob download --container-name <container_name> --name <blob_name> --file <local_filename_folder> --connection-string "DefaultEndpointsProtocol=<protocol>;AccountName=<storage_name>;AccountKey=<secret_key>;EndpointSuffix=core.windows.net"

Download all the blob files in a container

az storage blob download-batch --source <container_name> --connection-string "DefaultEndpointsProtocol=<protocol>;AccountName=<storage_name>;AccountKey=<secret_key>;EndpointSuffix=core.windows.net"

Store the name of all the storage blobs in a CSV

param (
    [Parameter(Mandatory = $true)]
    [string]$ConnectionString
)

# Extract storage account name
if ($ConnectionString -match "AccountName=([^;]+)") {
    $storageAccountName = $Matches[1]
} else {
    throw "Could not extract AccountName from connection string"
}

$results = @()

# Get all containers
$containers = az storage container list `
    --connection-string $ConnectionString `
    --query "[].name" -o tsv

foreach ($container in $containers) {
    Write-Host "Listing blobs in container: $container"

    $blobs = az storage blob list `
        --container-name $container `
        --connection-string $ConnectionString `
        --query "[].name" -o tsv

    foreach ($blob in $blobs) {
        $results += [PSCustomObject]@{
            StorageAccount = $storageAccountName
            ContainerName  = $container
            BlobName       = $blob
        }
    }
}

# Export to CSV
$csvFile = "$storageAccountName-blobs.csv"
$results | Export-Csv -Path $csvFile -NoTypeInformation -Encoding UTF8

Write-Host "CSV generated: $csvFile"

Get all the storage blob files

• List all the storage containers

• Create a folder for each container under

• Download all the files for each container

param (
    [Parameter(Mandatory = $true)]
    [string]$ConnectionString
)

# Extract AccountName from the connection string
if ($ConnectionString -match "AccountName=([^;]+)") {
    $storageAccountName = $Matches[1]
} else {
    throw "Could not extract AccountName from connection string"
}

$containers = az storage container list `
    --connection-string $ConnectionString `
    --query "[].name" -o tsv

foreach ($container in $containers) {
    Write-Host "Downloading container: $container"

    New-Item -ItemType Directory -Force -Path "$storageAccountName\$container" | Out-Null

    az storage blob download-batch `
        --source $container `
        --destination "$storageAccountName\$container" `
        --connection-string $ConnectionString
}

.\get_all_storage_content.ps1 -ConnectionString "DefaultEndpointsProtocol=https;AccountName=<storage_name>;AccountKey=...;EndpointSuffix=core.windows.net"