azure

DISCLAIMER

This is an alpha release. Future releases may introduce some breaking changes. Some of the new generated libraries have not yet been tested extensively, and some have known issues (such as azure-mgmt-web). Our goal is to release a stable version by the end of March 2016. Please send us your feedback!

WHAT'S NEW

• New ARM generated code based on Swagger specification of the Azure REST APIs

• New libraries

  • Azure Active Directory Graph API

  • Authorization: permissions, subscriptions, roles and more

  • CDN: profiles, endpoints creation and more

  • Apps:

    • Logic Apps: Workflow and job management
    • Web Apps: App Service Plan, web sites, certificate, domains and more

  • Notification Hubs: Namespaces, hub creation/deletion and more

  • Redis: create cache and more

  • Scheduler: create job collections, create job and more

• Enhanced libraries compared to 1.0.0 preview

  • Storage: create storage accounts, list keys, and more

  • Resource:

    • resources : create resource groups, register providers and more
    • features : manage features of provider and more
    • authorization : manage resource group lock and more
    • subscriptions : manage subscriptions and more

  • Network: create virtual networks, network interfaces, public ips and more

  • Compute: create virtual machines and more

BREAKING CHANGES

We made our possible to document the breaking from ARM 1.0.0 version to 2.0.0 here. The previously-linked documentation is no longer available.

Dependencies

azure-storage 0.30.0

• Major version. Check the ChangeLog on storage github account for details.

Bugfixes

azure-mgmt-compute 0.20.1

• #510 Missing "statuses" property in VirtualMachineInstanceView

azure-servicemanagement-legacy 0.20.2

• #487 #488 Add StaticVirtualNetworkIPAddress to network configuration
• #497 Add replicate_vm_image, unreplicate_vm_image, share_vm_image
• #501 #511 Add update_os_image_from_image_reference

Misc

• #491 #502 #422 Update documentation
• Update azure-storage dependency to 0.20.3
• Update azure-mgmt dependency to 0.20.2

Thank you to bear454, ekesken, kingliantop, mamoo, schaefi for their contributions.

azure-mgmt-network 0.20.1

• Fix retry timeout default value for long running operations

azure-mgmt-resource 0.20.1

• Add missing model class ResourceIdentity
• Add documentation examples for generic resource creation and deployment using JSON templates

azure-storage 0.20.2

• Fix SAS encoding to work with premium storage

Thank you to aarsan, trondhindenes for their contributions.

• Use requests library by default in all libraries
  • Exception is azure-servicemanagement-legacy which can use requests or winhttp
  • Proxies that are automatically detected by requests don't require set_proxy call anymore
• Fix dependencies for azure-storage by using separate 2.x and 3.x wheels

UPGRADE

If you are upgrading from v0.11.x or earlier, make sure to uninstall that version before installing the latest release.

WHAT'S NEW

• Preliminary Azure Resource Manager (ARM) support. Manage your Azure compute, network and storage resources. This is a preview and is subject to changes in future releases.

• Azure Storage File support.

• Azure library is now more modular. You can choose to install bundles or install only the packages you need. Packages now available on PyPI::

  azure (bundle) azure-mgmt (bundle) azure-mgmt-compute azure-mgmt-network azure-mgmt-resource azure-mgmt-storage azure-servicebus azure-servicemanagement-legacy azure-storage

• Azure Storage has moved. https://github.com/Azure/azure-storage-python

Bugfixes

• #437 Make delete_storage_account return async request id
• #435 Add complete flag to delete_role
• #448 Cast authorization code from unicode to string
• #395 Azure.Storage Python 2.6 compatibility

BREAKING CHANGES

The following were renamed and moved from 'azure' to 'azure.common':: WindowsAzureError -> AzureException and AzureHttpError WindowsAzureConflictError -> AzureConflictHttpError WindowsAzureMissingResourceError -> AzureMissingResourceHttpError

The following were renamed and moved from 'azure' to 'azure.servicemanagement':: WindowsAzureAsyncOperationError -> AzureAsyncOperationHttpError

The following were renamed and moved from 'azure' to 'azure.storage':: WindowsAzureBatchOperationError -> AzureBatchOperationError

The following have moved from 'azure' to 'azure.servicemanagement':: DEFAULT_HTTP_TIMEOUT MANAGEMENT_HOST

The following have moved from 'azure' to 'azure.servicebus':: DEFAULT_HTTP_TIMEOUT SERVICE_BUS_HOST_BASE

The following have moved from 'azure' to 'azure.storage':: DEFAULT_HTTP_TIMEOUT DEV_ACCOUNT_NAME DEV_ACCOUNT_KEY

The following have moved from 'azure.storage' to 'azure.storage.blob':: BLOB_SERVICE_HOST_BASE DEV_BLOB_HOST BlobService ContainerEnumResults Container Properties BlobEnumResults BlobResult Blob BlobProperties BlobPrefix BlobBlock BlobBlockList PageRange PageList ContainerSharedAccessPermissions BlobSharedAccessPermissions

The following have moved from 'azure.storage' to 'azure.storage.queue':: QUEUE_SERVICE_HOST_BASE DEV_QUEUE_HOST QueueService QueueEnumResults Queue QueueMessagesList QueueMessage QueueSharedAccessPermissions

The following have moved from 'azure.storage' to 'azure.storage.table':: TABLE_SERVICE_HOST_BASE DEV_TABLE_HOST TableService Entity EntityProperty Table TableSharedAccessPermissions

Thank you to Sabbasth, schaefi, feoff3, JamieCressey for their contributions.

• Azure storage connection string support
• Add a request_session parameter to storage and service bus classes
• Fixes for bugs: #370 Fix table service authentication for non-english locale #380 Make protocol string case insensitive #376 Make pyopenssl dependency optional #360 Installing azure on Python 3 should not install futures

Thank you to rchamorro, drdarshan, hosungs, h_yamaki for their contributions.

IMPORTANT CHANGE THAT AFFECTS STORAGE

The API for creating shared access signatures has changed. The new API enables easy production AND consumption of SAS for blob, queue and table storage.

• To produce a SAS, use generate_shared_access_signature on BlobService/QueueService/TableService
• To consume a SAS, init BlobService/QueueService/TableService with account_name & sas_token (no account_key)
• For blob storage, you can now pass a sas_token to make_blob_url
• For blob storage, you can now consume public containers/blobs, init BlobService/QueueService/TableService with account_name only (no account_key or sas_token)

Other changes

• Create/list/delete job functionality added to SchedulerManagementService

• update_site added to WebsiteManagementService to start/stop web sites

• Target x-ms-version 2014-10-01 for service management

• Add virtual IP fields in Deployment

• Make cloud service create/delete async

• Delete cloud service now supports deleting blobs from storage

• Support for specifying SourceMediaLink for DataVirtualHardDisks

• Fixes for bugs: #350 wait_for_operation needs to flush as it prints

Thank you to lmazuel, antonydenyer, zlike-msft, melor and amegianeg for their contributions.

Bugfixes

#338 Version 0.10.0 fails with 'SocketReader' object has no attribute 'tell'

IMPORTANT CHANGE THAT AFFECTS STORAGE USERS (BLOB, QUEUE, TABLE)

The library now targets x-ms-version '2014-02-14' of the storage REST API. Previous version of the library targeted '2012-02-12'.

The upgrade to this new version causes some breaking changes for Python SDK users:

• Metrics for blob, queue, table service properties, which used to be accessed with the 'metrics' field are now accessed via 'hour_metrics' and 'minute_metrics'. Note that a backwards compatible 'metrics' property was added to redirect access to 'hour_metrics'.
• Url is no longer returned from list_containers, list_blobs, list_queues. For blob, you can use the utility function make_blob_url as an alternate way to get a URL.

See MSDN documentation for details on REST API changes:

• in '2013-08-15': https://msdn.microsoft.com/library/azure/dn592124.aspx
• in '2014-02-14': https://msdn.microsoft.com/library/azure/dd894041.aspx

The other changes in this release are:

• Performance improvements in xml deserialization of storage and service bus Table storage query_entities is ~25X faster for the maximum of 1000 entities
• Ability to upload and download blobs using multiple connections, along with retries when a chunk upload/download failure occurs Controlled via the max_connections, max_retries, retry_wait parameters
• Use get_certificate_from_publish_settings to get a .pem certificate from your azure publish settings file
• Ability to adjust the global http timeout
• Service bus event hub support (create/update/delete hubs + send events)

Bugfixes

• #237 Ability to use multiple connections to upload blob chunks in parallel
• #254 Improve performance of table storage (and more?)
• #258 Support authenticating with azureProfile like in CLI tools
• #259 Unicode error is raised instead of actual error
• #263 Change description name
• #268 delete_deployment does not pass comp=media to delete disks
• #271 Update current_name so that multiple parameters with the same name...
• #270 Documentation for capture_vm_image is incorrect
• #273 Unicode error with utf-8 encoding value
• #276 Service Mgmt - Reserved IP create/delete are async
• #280 add support for setting IdleTimeoutInMinutes on load balanced endpoint
• #288 InvalidHeaderValue on BlobService example
• #294 Upload of large files is too slow
• #304 Unable to upload large size files to Azure Page Blob

Thank you to lmazuel, rhaps0dy, timfpark, gaellbn, moutai, edevil, rjschwei and okaram for their contributions.

IMPORTANT CHANGE IN BEHAVIOR THAT AFFECTS TABLE STORAGE USERS

The library now converts any datetime object in an entity to UTC before writing the value to Azure, and it sets the timezone (tzinfo) to UTC on the entities it reads from Azure. On a related note, python-dateutil is now an external dependency.

The other changes in this release are:

• Ability to pass in to management APIs a Session object from the requests library (or any compatible). This allows more flexibility for authentication, including oauth.

• New service management APIs

  • list_role_sizes
  • list_subscriptions (oauth only)
  • rebuild_role_instance
  • delete_role_instances
  • create_reserved_ip_address
  • delete_reserved_ip_address
  • get_reserved_ip_address
  • list_reserved_ip_addresses
  • add_dns_server
  • update_dns_server
  • delete_dns_server
  • list_resource_extensions
  • list_resource_extension_versions
  • capture_vm_image
  • delete_vm_image
  • list_vm_images
  • create_vm_image
  • update_vm_image

• Enhanced service management APIs

  • create_virtual_machine_deployment / add_role

    • custom data
    • additional windows unattend content
    • create from a vm image
    • public ips
    • resource extensions
    • create from remote os image
    • provision guest agent
    • dns servers
    • reserved ip

  • update_role

    • resource extensions
    • provision guest agent

  • create_storage_service

    • account_type replaces geo_replication_enabled (preserved for backwards compat)

• Preliminary Scheduler management API

• Add metrics to Service Bus management API

• Delete Blob - support for x-ms-delete-snapshots header

Bugfixes

• #221 Topic names containing slash
• #234 AttributeError on Timestamp property
• #212 Storage: Timstamp's microseconds value out of range
• #116 def _from_entity_datetime(value) in init.py returns 7 for seconds
• #114 Timezone information 'Z' is ignored during parsing of datetime of table entity

Thank you to Costeijn, lmazuel, pneumee, nicbon, bndw, troyanov for their contributions.

• Add ability to get website publish data as an object (thanks lmazuel)

Bugfixes

• #216 Daylight saving problem in ServiceBusSASAuthentication
• #218 Content type incorrect on blob

• Add Shared Access Signature support to Service Bus

• Add functionality to Service Bus Management API

  • list queues/topics/notification hubs/relays

• Add CreationTime to StorageAccountProperties

• Preliminary SQL Database Management API

• Preliminary Website Management API

  • list/get webspaces
  • list/get/create/delete/restart website
  • get historical usage metrics and metric definitions
  • get publish profile xml

Bugfixes

• #192 Fix deserialization of broker properties for service bus.
• #173 Fix some incompatibilities with Python 2.6

Thank you to lmazuel for the contributions to SQL Database, Service Bus and Website management.

Bugfixes

• #149 Table storage batch client doesn't validate etag
• #129 Inconsistent WindowsAzure Errors

Thank you to kaptajnen, matlockx for their fixes for the redirection issue (#129).

• Existing service management API now targets x-ms-version 2013-06-01

Bugfixes

• #145 Missing DataVirtualHardDisks in Cloud Service Properties
• #144 Added configuration sets for role and added list virtual network function
• #139 How to start "Deallocated" role
• #127 Add WinRM options to create_virtual_machine_deployment()
• #131 Missing role instance endpoint in get_deployment_by_X
• #128 Update init.py for missing host_name attribute on RoleInstance
• #140 Table Service deletes empty strings
• #40 Edm.Binary and null support in table storage entities

Bugfixes

• #118 Proxy doesn't support specifying credentials
• #117 Service bus authorization code doesn't go through the proxy server
• #108 Create VM, Administrator Password Base-64 Encoding
• #106 Why isn't setup.py in the root of the project?
• #96 Change default connection protocol to https

• Added service bus management API
• Added support for list blobs delimiter (for easier hierarchical listings)
• Cleanup of imports
• Renamed some private functions that weren't starting with an underscore
• Removed code generator (it's now obsolete, we make changes directly in the Python sources)

Bugfixes

• #90 get_blob_metadata returns more than the metadata (also get_container_metadata and get_queue_metadata)
• #87 Proxy support for *NIX systems
• #86 Fix capitalization in the 'Fingerprint' tag for XML of serialization of SSH keys configuration
• #83 Fixed an issue that prevented the creation of endpoints for a VM
• #80 Error deserializing datetime value from Table Store
• #79 Specify VirtualNetworkName when creating Virtual Machine

Thank you to timanovsky, sebhomengo, pneumee, ogrisel, 0xc0decafe and apatard for their bug reports and fixes.

Bugfixes

• #75 crash on python 2.7 x64 windows
• #73 _convert_query_string return a wrong query string parameter

Bugfixes

• #69 _get_readable_id doesn't support queues with slashes in their names
• #68 Service bus cache of tokens doesn't support multiple creds in same app
• #66 Need to change the default timeout for httprequest on windows
• Improved support for unicode data

• Migrate to using httplib on Windows. This is now the default, unless a Windows Certificate Store management certificate is used. Make sure to use CPython 2.7.4 or later when using OpenSSL .pem certificates on Windows.
• Added high-level functions to upload/download blobs with chunking and progress notifications
• Added support for Python 3.3
• Updated storage API to 2012-02-12
  • Adds more lease functionality
  • Adds cross-storage account copy
  • Adds a helper function make_blob_url to pass to copy_blob for x_ms_copy_source
• Fixes WindowsAzureConflictError and WindowsAzureMissingResourceError to properly set the error message, and use the additional info returned by the server
• Fixes for bugs: #125 Label for VM Deployment should not be b64 encoded (thanks to jeffmendoza). #121 In blob storage, put_page, x-ms-if-sequence-number-lte header should be x-ms-if-sequence-number-le