azure-storage-blob

Stable release of preview features

• Added ContainerClient.exists() method
• Added container SAS support for blob batch operations

Fixes

• Fixed delete_blob() method signature (#15891)
• Fixed Content-MD5 throwing when passed (#15919)

New Features

• Added ContainerClient.exists() method
• Added container SAS support for blob batch operations

Fixes

• Fixed msrest dependency issue (#16250)

Code | Docs

Text Analytics

azure-ai-textanalytics

New features

• Added upload_blob_from_url api on BlobClient
• Added support for leasing blob when get/set tags, listing all tags when find blobs by tags.

Stable release of preview features

• Preview feature ArrowDialect as output format of query_blob
• Preview feature undelete_container on BlobServiceClient.
• Preview feature Last Access Time.

Fixes

• Fixed the expired Authorization token problem during retry (#14701, #14067)
• Catch exceptions thrown by async download (#14319)

Notes

• Updated dependency azure-core from azure-core<2.0.0,>=1.6.0 to azure-core<2.0.0,>=1.9.0 to get continuation_token attr on AzureError.

New features

• Added support for Arrow format (ArrowType) output serialization using quick_query().
• Added support for undeleting a container.
• Added support for LastAccessTime property on a blob, which could be the last time a blob was written or read.

New features

• Added support for checking if a blob exists using the exists method (#13221).

Fixes

• Fixed source URLs special characters issue. Users can now have special characters in their source URLs for copy_blob_from_url, upload_blob_from_url etc (#13275).
• Fixed authorization header on asyncio requests containing url-encoded-able characters (#11028).
• Fixed SAS credentials URL malformation when using local Azurite container (#11941).
• Fixed issue with permission string causing an authentication failure (#13099).
• Support for returning snapshot value in get_blob_properties response (#13287).

New features

• Added support for Object Replication Service on list_blobs and get_blob_properties.
• Added more support for blob tags. Added if_tags_match_condition that allow a user to specify a SQL statement for the blob's tags to satisfy.
• Added support for setting and getting the default_index_document_path of StaticWebsite property on the service client.
• Added rehydrate_priority to BlobProperties.
• Added support to seal an append blob. Added test_seal_append_blob. Added ability to specify seal_destination_blob on start_copy_from_url. is_append_blob_sealed property returned on get_blob_properties/download_blob/list_blobs.
• Added support to set tier on a snapshot or version.

Fixes

• Fixed the bug when parsing blob url with '/' in blob name (#12563, #12568).
• Support batch delete empty blob list (#12778, #12779).
• Fixed blob_samples_query bug.
• Fixed empty etag in acquire_blob response (#8490).

New features

• Added query_blob API to enable users to select/project on block blob or block blob snapshot data by providing simple query expressions.
• Added blob versioning feature, so that every time there is a blob override the version_id will be updated automatically and returned in the response, the version_id could be used later to refer to the overwritten blob.
• Added set_blob_tags,get_blob_tags and find_blobs_by_tags so that user can get blobs based on blob tags.
• Block size is increased to 4GB at maximum, max single put size is increased to 5GB.
• For replication enabled account, users can get replication policies when get blob properties.

Fixes

• Fixed issue where batch requests could not be combined with SAS (#9534)
• Batch requests now support applying parameters to individual blobs within the request via passing in a dictionary.
• Metadata cannot have leading space (#11457)
• Improve the performance of upload when using max_concurrency

Notes

• Updated dependency from azure-core<2.0.0,>=1.2.2 to azure-core<2.0.0,>=1.6.0

Fixes

• Fixed issue where batch requests could not be combined with token credentials (#9534)
• Skip '/' in url encoding.

New features

• stage_block now propagates the response from the service.

Fixes

• Fixed a bug where a new transport is being passed in the get_blob_client method instead of using the existing one in the ContainerClient.

Notes

• The StorageUserAgentPolicy is now replaced with the UserAgentPolicy from azure-core. With this, the custom user agents are now added as a prefix instead of being appended.

New features

• Added support for the 2019-07-07 service version, and added api_version parameter to clients.
• Added support for encryption scopes that that could be used to encrypt blob content.
• Added get_page_range_diff_for_managed_disk API which returns the list of valid page ranges diff between a snapshot and managed disk or another snapshot.

Fixes

• Responses are always decoded as UTF8

New features

• Added download_blob method to the container_client.
• All the clients now have a close() method to close the sockets opened by the client when using without a context manager.

Fixes and improvements

• Fixes a bug where determining length breaks while uploading a blob when provided with an invalid fileno.
• Fix metadata not being included in commit_block_list operation.

Code | Docs

Support: Active

Breaking changes

• Permission models.
  • AccountPermissions, BlobPermissions and ContainerPermissions have been renamed to AccountSasPermissions, BlobSasPermissions and ContainerSasPermissions respectively.
  • enum-like list parameters have been removed from all three of them.
  • __add__ and __or__ methods are removed.
• max_connections is now renamed to max_concurrency.
• ContainerClient now accepts only account_url with a mandatory string param container_name. To use a container_url, the method from_container_url must be used.
• BlobClient now accepts only account_url with mandatory string params container_name and blob_name. To use a blob_url, the method from_blob_url must be used.
• Some parameters have become keyword only, rather than positional. Some examples include:
  • loop
  • max_concurrency
  • validate_content
  • timeout etc.
• APIs now take in offset and length instead of range_start and range_end consistently. length is the number of bytes to take in starting from the offset. The APIs that have been changed include:
  • get_page_ranges
  • upload_page
  • upload_pages_from_url
  • clear_page
  • append_block_from_url
• block_id is not optional in BlobBlock model.

New features

• Add support for delete_blobs API to ContainerClient (Python 3 only)
• Add support for set_standard_blob_tier_blobs to ContainerClient (Python 3 only)
• Add support for set_premium_page_blob_tier_blobs to ContainerClient (Python 3 only)
• Added support to set rehydrate blob priority for Block Blob, including Set Standard Blob Tier/Copy Blob APIs
• Added blob tier support for Block Blob, including Upload Blob/Commit Block List/Copy Blob APIs.
• AccountSasPermissions, BlobSasPermissions, ContainerSasPermissions now have method from_string which takes parameters as a string.

Fixes and improvements

• Downloading page blobs now take advantage of their sparseness.
• The length param in download_blob now takes the number of bytes to take in starting from the offset instead of a harde set end value.

Dependency updates

• Adopted azure-core 1.0.0b4

  • If you later want to revert to previous versions of azure-storage-blob, or another Azure SDK library requiring azure-core 1.0.0b1 or azure-core 1.0.0b2, you must explicitly install the specific version of azure-core as well. For example:

  pip install azure-core==1.0.0b2 azure-storage-blob==12.0.0b2

New features

• Added SAS support for snapshot and identity.
• Distributed tracing framework OpenCensus is now supported.
• Added support for append_block_from_url API for append blobs.
• Added support for upload_pages_from_url API for page blobs.
• Added support for client provided encryption key to numerous APIs.

Dependency updates

• Adopted azure-core 1.0.0b3

  • If you later want to revert to previous versions of azure-storage-blob, or another Azure SDK library requiring azure-core 1.0.0b1 or azure-core 1.0.0b2, you must explicitly install the specific version of azure-core as well. For example:

  pip install azure-core==1.0.0b2 azure-storage-blob==12.0.0b2

Fixes and improvements

• Fix where content-type was being added in the request when not mentioned explicitly.

Breaking changes

• Renamed copy_blob_from_url to start_copy_from_url and changed behaviour to return a dictionary of copy properties rather than a polling object. Status of the copy operation can be retrieved with the get_blob_properties operation.
• Added abort_copy operation to the BlobClient class. This replaces the previous abort operation on the copy status polling operation.
• The behavior of listing operations has been modified:
  • The previous marker parameter has been removed.
  • The iterable response object now supports a by_page function that will return a secondary iterator of batches of results. This function supports a continuation_token parameter to replace the previous marker parameter.
• Some parameters have become keyword only, rather than positional. Some examples include:
  • timeout
  • lease
  • encoding
  • Modification conditions, e.g. if_modified_since, if_match , maxsize_condition, etc

New features

• Added async APIs to subnamespace azure.storage.blob.aio.
• Distributed tracing framework OpenCensus is now supported.

Dependency updates

• Adopted azure-core 1.0.0b2

  • If you later want to revert to azure-storage-blob 12.0.0b1, or another Azure SDK library requiring azure-core 1.0.0b1, you must explicitly install azure-core 1.0.0b1 as well. For example:

  pip install azure-core==1.0.0b1 azure-storage-blob==12.0.0b1

Fixes and improvements

• Fix for SAS URL encoding (#6500)
• General refactor of duplicate and shared code.

Version 12.0.0b1 is the first preview of our efforts to create a user-friendly and Pythonic client library for Azure Storage Blobs. For more information about this, and preview releases of other Azure SDK libraries, please visit https://aka.ms/azure-sdk-preview1-python.

Breaking changes: New API design

• Operations are now scoped to a particular client:

  • BlobServiceClient: This client handles account-level operations. This includes managing service properties and listing the containers within an account.
  • ContainerClient: The client handles operations for a particular container. This includes creating or deleting that container, as well as listing the blobs within that container and managing properties and metadata.
  • BlobClient: The client handles operations for a particular blob. This includes creating or deleting that blob, as well as upload and download data and managing properties. This BlobClient handles all blob types (block, page and append). Where operations can behave differently according to type (i.e. upload_blob) the default behaviour will be block blobs unless otherwise specified.
  • LeaseClient: Handles all lease operations for both containers and blobs.

  These clients can be accessed by navigating down the client hierarchy, or instantiated directly using URLs to the resource (account, container or blob). For full details on the new API, please see the reference documentation.

• Copy blob operations now return a polling object that can be used to check the status of the operation, as well as abort the operation.

• New module level operations for simple upload and download using a blob URL.

• Download operations now return a streaming object that can download data in multiple ways:

  • Iteration: The streamer is an iterable object that will download and yield the content in chunks. Only supports single threaded download.
  • content_as_bytes: Return the entire blob content as bytes. Blocking operation that supports multi-threaded download.
  • content_as_text: Return the entire blob content as decoded text. Blocking operation that supports multi-threaded download.
  • download_to_stream: Download the entire content to an open stream handle (e.g. an open file). Supports multi-threaded download.

• New underlying REST pipeline implementation, based on the new azure-core library.

• Client and pipeline configuration is now available via keyword arguments at both the client level, and per-operation. See reference documentation for a full list of optional configuration arguments.

• Authentication using azure-identity credentials

  • see the Azure Identity documentation for more information

• New error hierarchy:

  • All service errors will now use the base type: azure.core.exceptions.HttpResponseError
  • The are a couple of specific exception types derived from this base type for common error scenarios:
    • ResourceNotFoundError: The resource (e.g. queue, message) could not be found. Commonly a 404 status code.
    • ResourceExistsError: A resource conflict - commonly caused when attempting to create a resource that already exists.
    • ResourceModifiedError: The resource has been modified (e.g. overwritten) and therefore the current operation is in conflict. Alternatively this may be raised if a condition on the operation is not met.
    • ClientAuthenticationError: Authentication failed.

• Operation set_blob_properties has been renamed to set_http_headers.

• Operations get_blob_to_<output> have been replaced with download_blob. See above for download output options.

• Operations create_blob_from_<input> have been replace with upload_blob.

• Operation create_blob has been renamed to separate create_page_blob and create_append_blob.

• Operations get_container_acl and set_container_acl have been renamed to get_container_access_policy and set_container_access_policy.

• Operation snapshot_blob has been renamed to create_snapshot.

• Operation copy_blob has been renamed to copy_blob_from_url.

• Operations put_block and put_block_from_url have been renamed to stage_block and stage_block_from_url.

• Operation put_block_list has been renamed to commit_block_list.

• No longer have specific operations for get_metadata - use get_properties instead.

• No longer have specific operations for exists - use get_properties instead.

• Operation incremental_copy_blob has been replaced by an optional boolean flag in the copy_blob_from_url operation.

• Operation update_page has been renamed to upload_page.

• Operation get_page_ranges_diff has been replaced by an optional str flag in the get_page_ranges operation.

Code | Docs

• Updated dependency on azure-storage-common.

Code | Docs

Event Grid

azure-eventgrid

Code | Docs

Communication JobRouter

azure-communication-jobrouter

Code | Docs

Communication Rooms

azure-communication-rooms

• Fixed design flaw where get_blob_to_* methods buffer entire blob when max_connections is set to 1.
• Added support for access conditions on append_blob_from_* methods.

Code | Docs

Communication Email

azure-communication-email

• Support for 2017-11-09 REST version. Please see our REST API documentation and blog for information about the related added features.
• Support for write-once read-many containers.
• Added support for OAuth authentication for HTTPS requests(Please note that this feature is available in preview).

Code | Docs

Code | Docs

Azure AI Search

azure-search-documents

• Enabling MD5 validation no longer uses the memory-efficient algorithm for large block blobs, since computing the MD5 hash requires reading the entire block into memory.
• Fixed a bug in the _SubStream class which was at risk of causing data corruption when using the memory-efficient algorithm for large block blobs.
• Support for AccessTierChangeTime to get the last time a tier was modified on an individual blob.