Skip to content

A Python tool to efficiently check the existence of files in Azure Blob Storage using a CSV input file.

Notifications You must be signed in to change notification settings

dannotes/azure-blob-existence-checker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Azure Blob Existence Checker

Overview

A Python tool to efficiently check the existence of files in Azure Blob Storage using a CSV input file.

Prerequisites

  • Python 3.7+
  • Azure Storage account connection string
  • CSV file with a 'FILENAME' column

Installation

Option 1: Install from GitHub (Recommended)

# Clone the repository
git clone https://github.com/dannotes/azure-blob-existence-checker.git

# Navigate to the project directory
cd azure-blob-existence-checker

# Create a virtual environment (optional but recommended)
python3 -m venv venv
source venv/bin/activate  # On Windows, use `venv\Scripts\activate`

# Install the package
pip install -r requirements.txt

Option 2: Direct pip install

pip install git+https://github.com/dannotes/azure-blob-existence-checker.git

Usage

Basic Usage

blob_checker.py "YOUR_CONNECTION_STRING" "CONTAINER_NAME" "path/to/input.csv"

Export Results to CSV

blob_checker.py "YOUR_CONNECTION_STRING" "CONTAINER_NAME" "path/to/input.csv" -export csv

Input CSV Format

Your input CSV must have a column named 'FILENAME' containing the blob names to check.

Example:

FILENAME,OtherColumn1,OtherColumn2
file1.txt,Data1,Value1
file2.jpg,Data2,Value2

Results

Features

  • Concurrent blob existence checking
  • Colorful terminal output
  • Detailed summary of existing and non-existing blobs
  • Optional CSV export of results
  • Progress tracking

Requirements

  • azure-storage-blob
  • tabulate
  • colorama

Troubleshooting

  • Ensure your connection string is correct
  • Verify container name matches exactly
  • Check that the CSV file is properly formatted

About

A Python tool to efficiently check the existence of files in Azure Blob Storage using a CSV input file.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages