azure-batch

Other Changes

• Minor parameter renaming: read_io_gi_b to read_io_gib, write_io_gi_b to write_io_gib, and v_tpm_enabled to vtpm_enabled.

Features Added

• Job level FIFO

  • Added BatchJobDefaultOrder types.
  • Extended BatchTaskSchedulingPolicy with a new jobDefaultOrder property to support job-level FIFO scheduling.

• CMK support on Pools

  • Added DiskCustomerManagedKey and DiskEncryptionSetParameters for customer-managed key (CMK) support on pools.
  • Extended DiskEncryptionConfiguration with a new customerManagedKey property.
  • Extended ManagedDisk with a new diskEncryptionSet property.
  • Added BatchPoolIdentityReference for referencing managed identities in disk encryption scenarios.

• IPv6 support on Pools

  • Added ipv6Address to BatchNode.
  • Added ipv6RemoteLoginIPAddress and ipv6RemoteLoginPort to BatchNodeRemoteLoginSettings.

• Metadata Security Protocol Support on Pools

  • Added HostEndpointSettings and HostEndpointSettingsModeTypes.
  • Added ProxyAgentSettings.
  • Extended SecurityProfile with a new proxyAgentSettings property for metadata security protocol support.

• IP Tag Support

  • Added IPFamily and IPTag types.
  • Extended BatchPublicIpAddressConfiguration with new ipFamilies and ipTags properties for IP tag support.

Breaking Changes

• Removed all Certifcate API's

  • Removed create_certificate
  • Removed get_certificate
  • Removed list_certificates
  • Removed cancel_certificate_deletion
  • Removed begin_delete_certificate

• Removed Models:

  • Removed BatchCertificate
  • Removed BatchCertificateDeleteError
  • Removed BatchCertificateFormat
  • Removed BatchCertificateReference
  • Removed BatchCertificateState
  • Removed BatchCertificateStoreLocation
  • Removed BatchCertificateVisibility
  • Removed BatchNodeCommunicationMode

• Removed Properties:

  • Removed CertificateReferences from BatchNode
  • Removed ResourceTags and CertificateReferences from BatchPool
  • Removed CertificateReferences, ResourceTags, and TargetNodeCommunicationMode from BatchPoolCreateOptions
  • Removed CertificateReferences and TargetNodeCommunicationMode from BatchPoolReplaceOptions
  • Removed CertificateReferences, ResourceTags, and TargetNodeCommunicationMode from BatchPoolSpecifications
  • Removed CertificateReferences, ResourceTags, and TargetNodeCommunicationMode from BatchPoolUpdateOptions
  • Removed CertificateReferences, ResourceTags, and TargetNodeCommunicationMode from ComputeBatchModelFactory

Features Added

• Added Long Running Operation (LRO) support for the following operation methods:
  • delete_job -> begin_delete_job
  • disable_job -> begin_disable_job
  • enable_job -> begin_enable_job
  • delete_job_schedule -> begin_delete_job_schedule
  • delete_pool -> begin_delete_pool
  • delete_certificate -> begin_delete_certificate
  • deallocate_node -> begin_deallocate_node
  • reboot_node -> begin_reboot_node
  • reimage_node -> begin_reimage_node
  • remove_nodes -> begin_remove_nodes
  • resize_pool -> begin_resize_pool
  • start_node -> begin_start_node
  • stop_pool_resize -> begin_stop_pool_resize
  • terminate_job -> begin_terminate_job
  • terminate_job_schedule -> begin_terminate_job_schedule

Breaking Changes

• Renamed the following models. These name changes include several models with the suffix Content being renamed to have the suffix Options.

  • AccessScope -> BatchAccessScope
  • AffinityInfo -> BatchAffinityInfo
  • BatchJobAction -> BatchJobActionKind
  • BatchJobCreateContent -> BatchJobCreateOptions
  • BatchJobDisableContent -> BatchJobDisableOptions
  • BatchJobScheduleCreateContent -> BatchJobScheduleCreateOptions
  • BatchJobScheduleUpdateContent -> BatchJobScheduleUpdateOptions
  • BatchJobTerminateContent -> BatchJobTerminateOptions
  • BatchJobUpdateContent -> BatchJobUpdateOptions
  • BatchNodeDeallocateContent -> BatchNodeDeallocateOptions
  • BatchNodeDisableSchedulingContent -> BatchNodeDisableSchedulingOptions
  • BatchNodeRebootContent -> BatchNodeRebootOptions
  • BatchNodeRebootOption -> BatchNodeRebootKind
  • BatchNodeReimageContent -> BatchNodeReimageOptions
  • BatchNodeRemoveContent -> BatchNodeRemoveOptions
  • BatchNodeUserCreateContent -> BatchNodeUserCreateOptions
  • BatchNodeUserUpdateContent -> BatchNodeUserUpdateOptions
  • BatchPoolCreateContent -> BatchPoolCreateOptions
  • BatchPoolEnableAutoScaleContent -> BatchPoolEnableAutoScaleOptions
  • BatchPoolEvaluateAutoScaleContent -> BatchPoolEvaluateAutoScaleOptions
  • BatchPoolReplaceContent -> BatchPoolReplaceOptions
  • BatchPoolResizeContent -> BatchPoolResizeOptions
  • BatchPoolUpdateContent -> BatchPoolUpdateOptions
  • BatchTaskCreateContent -> BatchTaskCreateOptions
  • ContainerConfiguration -> BatchContainerConfiguration
  • ContainerConfigurationUpdate -> BatchContainerConfigurationUpdate
  • DeleteBatchCertificateError -> BatchCertificateDeleteError
  • DiffDiskSettings -> BatchDiffDiskSettings
  • ErrorCategory -> BatchErrorSourceCategory
  • HttpHeader -> OutputFileUploadHeader
  • ImageReference -> BatchVmImageReference
  • OSDisk -> BatchOsDisk
  • OnAllBatchTasksComplete -> BatchAllTasksCompleteMode
  • OnBatchTaskFailure -> BatchAllTasksCompleteMode
  • PublicIpAddressConfiguration -> BatchPublicIpAddressConfiguration
  • UefiSettings -> BatchUefiSettings
  • UploadBatchServiceLogsContent -> UploadBatchServiceLogsOptions
  • VMDiskSecurityProfile -> BatchVMDiskSecurityProfile

• Renamed parameters in the following operation methods:

  • begin_disable_job changed content parameter to disable_options
  • begin_deallocate_node changed parameters parameter to options
  • begin_remove_nodes changed content parameter to remove_options.
  • begin_resize_pool changed content parameter to resize_options.
  • begin_terminate_job changed parameters parameter to options.
  • begin_reboot_node changed parameters parameter to options.
  • begin_reimage_node changed parameters parameter to options.
  • disable_node_scheduling changed parameters parameter to options.
  • enable_pool_auto_scale changed content parameter to enable_auto_scale_options.
  • evaluate_pool_auto_scale changed content parameter to evaluate_auto_scale_options.
  • upload_node_logs changed content parameter to upload_options.
  • replace_node_user changed content parameter to update_options.

Features Added

• Force delete/terminate job or job schedule:

  • Added force parameter of type Boolean to delete_job, terminate_job, delete_job_schedule, and terminate_job_schedule

• Support for compute node start/deallocate operations:

  • Added start_node, deallocate_node methods to BatchClient and AsyncBatchClient

• Container task data mount isolation:

  • Added containerHostBatchBindMounts of type List<ContainerHostBatchBindMountEntry> to BatchTaskContainerSettings

• Patch improvements for pool and job:

  • Added displayName, vmSize, taskSlotsPerNode, taskSchedulingPolicy, enableInterNodeCommunication, virtualMachineConfiguration, networkConfiguration, userAccounts, mountConfiguration, upgradePolicy, and resourceTags to BatchPoolUpdateContent
  • Added networkConfiguration to BatchJobUpdateContent

• Confidential VM support:

  • Added confidentialVM to SecurityTypes.
  • Added securityProfile of type VMDiskSecurityProfile to ManagedDisk

• Support for shared and community gallery images:

  • Added sharedGalleryImageId and communityGalleryImageId to ImageReference

• Re-add support for BatchCertificate (temporary since this feature is deprecated):

  • Added create_certificate, list_certificates, cancel_certificate_deletion, delete_certificate, andget_certificate methods to BatchClient and AsyncBatchClient

Breaking Changes

• Removed get_remote_desktop method from BatchClient. Use get_node_remote_login_settings instead to remotely login to a compute node
• Removed CloudServiceConfiguration from pool models and operations. Use VirtualMachineConfiguration when creating pools
• Removed ApplicationLicenses from pool models and operations

• Version (15.0.0b1) is the first preview of our efforts to create a user-friendly and Pythonic client library for Azure Batch. For more information about this, and preview releases of other Azure SDK libraries, please visit https://azure.github.io/azure-sdk/releases/latest/python.html.

Breaking Changes

• Remove certificates
• Remove render licenses
• Remove CloudServiceConfiguration for pool models and operations. VirtualMachineConfiguration is supported for pool configurations moving forward.

Features Added

• Added UpgradePolicy to CloudPool definition for pool creation
  • Added AutomaticOSUpgradePolicy to include configuration parameters for automatic OS upgrades
  • Added RollingUpgradePolicy to include configuration parameters for rolling upgrades

Features Added

• Added ResourceTags support to Pool Creation so users are able to specify resource tags for a pool. This feature is currently only supported for pool creation but will be updatable in the future.

  • Added resourceTags property to PoolSpecification definition
  • Added resourceTags property to CloudPool definition

• Added SecurityProfile support to Pool Creation. Trusted Launch provides advanced security to Guest OS preventing boot-kits/rootkits (like un-signed driver or kernel modification) to be introduced into boot-chain.

  • Added serviceArtifactReference and securityProfile property to VirtualMachineConfiguration definition

• Added ServiceArtifactReference and OSDisk support to Pool Creation

  • Added standardssd_lrs value to StorageAccountType enum
  • Added caching, managedDisk, diskSizeGB, and writeAcceleratorEnabled property to NodePlacementPolicyType definition
  • Added scaleSetVmResourceID property to VirtualMachineInfo definition

Features Added

• Added boolean property enableAcceleratedNetworking to NetworkConfiguration.
  • This property determines whether this pool should enable accelerated networking, with default value as False.
  • Whether this feature can be enabled is also related to whether an operating system/VM instance is supported, which should align with AcceleratedNetworking Policy (AcceleratedNetworking Limitations and constraints).
• Added boolean property enableAutomaticUpgrade to VMExtension.
  • This property determines whether the extension should be automatically upgraded by the platform if there is a newer version of the extension available.
• Added a new property type to ContainerConfiguration. Possible values include: dockerCompatible and criCompatible.

Breaking Changes

• Removed lifetime statistics API. This API is no longer supported.
  • Removed job.get_all_lifetime_statistics API.
  • Removed pool.get_all_lifetime_statistics API.

Other Changes

• Deprecating CertificateOperations related methods.
  • This operation is deprecating and will be removed after February 2024. Please use Azure KeyVault Extension instead.

Features Added

• Added new custom enum type NodeCommunicationMode.
  • This property determines how a pool communicates with the Batch service.
  • Possible values: Default, Classic, Simplified.
• Added properties current_node_communication_mode and target_node_communication_mode of type NodeCommunicationMode to CloudPool.
• Added property target_node_communication_mode of type NodeCommunicationMode to PoolSpecification, PoolAddParameter, PoolPatchParameter, and PoolUpdatePropertiesParameter.

Features

• Added property uploadHeaders to OutputFileBlobContainerDestination.
  • Allows users to set custom HTTP headers on resource file uploads.
  • Array of type HttpHeader (also being added).
• Added boolean property allow_task_preemption to JobSpecification, CloudJob, JobAddParameter, JobPatchParameter, JobUpdateParameter
  • Mark Tasks as preemptible for higher priority Tasks (requires Comms-Enabled or Single Tenant Pool).
• Replaced comment (title, description, etc.) references of "low-priority" with "Spot/Low-Priority", to reflect new service behavior.
  • No API change required.
  • Low-Priority Compute Nodes (VMs) will continue to be used for User Subscription pools (and only User Subscription pools), as before.
  • Spot Compute Nodes (VMs) will now be used for Batch Managed (and only Batch Managed pools) pools.
  • Relevant docs:
    • https://docs.microsoft.com/azure/batch/nodes-and-pools
    • https://docs.microsoft.com/azure/batch/batch-spot-vms

Features

• Add ability to assign user-assigned managed identities to CloudPool. These identities will be made available on each node in the pool, and can be used to access various resources.
• Added identity_reference property to the following models to support accessing resources via managed identity:
  • AzureBlobFileSystemConfiguration
  • OutputFileBlobContainerDestination
  • ContainerRegistry
  • ResourceFile
  • UploadBatchServiceLogsConfiguration
• Added new compute_node_extension operations to BatchServiceClient for getting/listing VM extensions on a node
• Added new extensions property to VirtualMachineConfiguration on CloudPool to specify virtual machine extensions for nodes
• Added the ability to specify availability zones using a new property node_placement_configuration on VirtualMachineConfiguration
• Added new os_disk property to VirtualMachineConfiguration, which contains settings for the operating system disk of the Virtual Machine.
  • The placement property on DiffDiskSettings specifies the ephemeral disk placement for operating system disks for all VMs in the pool. Setting it to "CacheDisk" will store the ephemeral OS disk on the VM cache.
• Added max_parallel_tasks property on CloudJob to control the maximum allowed tasks per job (defaults to -1, meaning unlimited).
• Added virtual_machine_info property on ComputeNode which contains information about the current state of the virtual machine, including the exact version of the marketplace image the VM is using.

Features

• [Breaking] Replaced property maxTasksPerNode with taskSlotsPerNode on the pool. Using this property tasks in a job can consume a dynamic amount of slots allowing for more fine-grained control over resource consumption.
• [Breaking] Changed the response type of GetTaskCounts to return TaskCountsResult, which is a complex object containing the previous TaskCounts object and a new TaskSlotCounts object providing similar information in the context of slots being used.
• Added property requiredSlots to the task allowing user to specify how many slots on a node it should take up.

Features

• Added ability to encrypt ComputeNode disk drives using the new disk_encryption_configuration property of VirtualMachineConfiguration.
• [Breaking] The virtual_machine_id property of ImageReference can now only refer to a Shared Image Gallery image.
• [Breaking] Pools can now be provisioned without a public IP using the new public_ip_address_configuration property of NetworkConfiguration.
  • The public_ips property of NetworkConfiguration has moved in to public_ip_address_configuration as well. This property can only be specified if ip_provisioning_type is UserManaged.

REST API version

This version of the Batch .NET client library targets version 2020-03-01.11.0 of the Azure Batch REST API.

• Using REST API version 2019-08-01.10.0.
  • Added ability to specify a collection of public IPs on NetworkConfiguration via the new public_ips property. This guarantees nodes in the Pool will have an IP from the list user provided IPs.
  • Added ability to mount remote file-systems on each node of a pool via the mount_configuration property on CloudPool.
  • Shared Image Gallery images can now be specified on the virtual_machine_image_id property of ImageReference by referencing the image via its ARM ID.
  • Breaking When not specified, the default value for wait_for_success on StartTask is now True (was False).
  • Breaking When not specified, the default value for scope on AutoUserSpecification is now always Pool (was Task on Windows nodes, Pool on Linux nodes).

• Using REST API version 2019-06-01.9.0.
  • Breaking Replaced AccountOperations.list_node_agent_skus with AccountOperations.list_supported_images. list_supported_images contains all of the same information originally available in list_node_agent_skus but in a clearer format. New non-verified images are also now returned. Additional information about capabilities and batch_support_end_of_life is accessible on the ImageInformation object returned by list_supported_images.
  • Now support network security rules blocking network access to a CloudPool based on the source port of the traffic. This is done via the source_port_ranges property on network_security_group_rules.
  • When running a container, Batch now supports executing the task in the container working directory or in the Batch task working directory. This is controlled by the working_directory property on TaskContainerSettings.

• Fix bug in TaskOperations.add_collection methods exception handling

• Using REST API version 2018-12-01.8.0.
  • Breaking Removed support for the upgrade_os API on CloudServiceConfiguration pools.
    • Removed PoolOperations.upgrade_os API.
    • Renamed target_os_version to os_version and removed current_os_version on CloudServiceConfiguration.
    • Removed upgrading state from PoolState enum.
  • Breaking Removed data_egress_gi_b and data_ingress_gi_b from PoolUsageMetrics. These properties are no longer supported.
  • Breaking ResourceFile improvements
    • Added the ability specify an entire Azure Storage container in ResourceFile. There are now three supported modes for ResourceFile:
      • http_url creates a ResourceFile pointing to a single HTTP URL.
      • storage_container_url creates a ResourceFile pointing to the blobs under an Azure Blob Storage container.
      • auto_storage_container_name creates a ResourceFile pointing to the blobs under an Azure Blob Storage container in the Batch registered auto-storage account.
    • URLs provided to ResourceFile via the http_url property can now be any HTTP URL. Previously, these had to be an Azure Blob Storage URL.
    • The blobs under the Azure Blob Storage container can be filtered by blob_prefix property.
  • Breaking Removed os_disk property from VirtualMachineConfiguration. This property is no longer supported.
  • Pools which set the dynamic_vnet_assignment_scope on NetworkConfiguration to be DynamicVNetAssignmentScope.job can now dynamically assign a Virtual Network to each node the job's tasks run on. The specific Virtual Network to join the nodes to is specified in the new network_configuration property on CloudJob and JobSpecification.
    • Note: This feature is in public preview. It is disabled for all Batch accounts except for those which have contacted us and requested to be in the pilot.
  • The maximum lifetime of a task is now 180 days (previously it was 7).
  • Added support on Windows pools for creating users with a specific login mode (either batch or interactive) via WindowsUserConfiguration.login_mode.
  • The default task retention time for all tasks is now 7 days, previously it was infinite.
• Breaking Renamed the base_url parameter to batch_url on BatchServiceClient class, and it is required now.

Bugfixes

• Fix authentication class to allow HTTP session to be re-used

Note

• azure-nspkg is not installed anymore on Python 3 (PEP420-based namespace package)

• Update operation TaskOperations.add_collection with the following added functionality:
  • Retry server side errors.
  • Automatically chunk lists of more than 100 tasks to multiple requests.
  • If tasks are too large to be submitted in chunks of 100, reduces number of tasks per request.
  • Add a parameter to specify number of threads to use when submitting tasks.

• Using REST API version 2018-08-01.7.0.
  • Added node_agent_info in ComputeNode to return the node agent information
  • Breaking Removed the validation_status property from TaskCounts.
  • Breaking The default caching type for DataDisk and OSDisk is now read_write instead of none.
• BatchServiceClient can be used as a context manager to keep the underlying HTTP session open for performance.
• Breaking Model signatures are now using only keywords-arguments syntax. Each positional argument must be rewritten as a keyword argument.
• Breaking The following operations signatures are changed:
  • Operation PoolOperations.enable_auto_scale
  • Operation TaskOperations.update
  • Operation ComputeNodeOperations.reimage
  • Operation ComputeNodeOperations.disable_scheduling
  • Operation ComputeNodeOperations.reboot
  • Operation JobOperations.terminate
• Enum types now use the "str" mixin (class AzureEnum(str, Enum)) to improve the behavior when unrecognized enum values are encountered.

• Update some APIs' comments
• New property leaving_pool in node_counts type.

Bugfixes

• Compatibility of the sdist with wheel 0.31.0
• Compatibility with msrestazure 0.4.28

• Fix regression on method enable_auto_scale.

• Using REST API version 2018-03-01.6.1.
• Added the ability to query pool node counts by state, via the new list_pool_node_counts method.
• Added the ability to upload Azure Batch node agent logs from a particular node, via the upload_batch_service_logs method.
  • This is intended for use in debugging by Microsoft support when there are problems on a node.

• Using REST API version 2017-09-01.6.0.
• Added the ability to get a discount on Windows VM pricing if you have on-premises licenses for the OS SKUs you are deploying, via license_type on VirtualMachineConfiguration.
• Added support for attaching empty data drives to VirtualMachineConfiguration based pools, via the new data_disks attribute on VirtualMachineConfiguration.
• Breaking Custom images must now be deployed using a reference to an ARM Image, instead of pointing to .vhd files in blobs directly.
  • The new virtual_machine_image_id property on ImageReference contains the reference to the ARM Image, and OSDisk.image_uris no longer exists.
  • Because of this, image_reference is now a required attribute of VirtualMachineConfiguration.
• Breaking Multi-instance tasks (created using MultiInstanceSettings) must now specify a coordination_commandLine, and number_of_instances is now optional and defaults to 1.
• Added support for tasks run using Docker containers. To run a task using a Docker container you must specify a container_configuration on the VirtualMachineConfiguration for a pool, and then add container_settings on the Task.

• Added a new operation job.get_task_counts to retrieve the number of tasks in each state.
• Added suuport for inbound endpoint configuration on a pool - there is a new pool_endpoint_configuration attribute on NetworkConfiguration. This property is only supported on pools that use virtual_machine_configuration.
• A ComputeNode now also has an endpoint_configuration attribute with the details of the applied endpoint configuration for that node.

• Added support for the new low-priority node type; AddPoolParameter and PoolSpecification now have an additional property target_low_priority_nodes.
• target_dedicated and current_dedicated on CloudPool, AddPoolParameter and PoolSpecification have been renamed to target_dedicated_nodes and current_dedicated_nodes.
• resize_error on CloudPool is now a collection called resize_errors.
• Added a new is_dedicated property on ComputeNode, which is false for low-priority nodes.
• Added a new allow_low_priority_node property to JobManagerTask, which if true allows the JobManagerTask to run on a low-priority compute node.
• PoolResizeParameter now takes two optional parameters, target_dedicated_nodes and target_low_priority_nodes, instead of one required parameter target_dedicated. At least one of these two parameters must be specified.
• Added support for uploading task output files to persistent storage, via the OutputFiles property on CloudTask and JobManagerTask.
• Added support for specifying actions to take based on a task's output file upload status, via the file_upload_error property on ExitConditions.
• Added support for determining if a task was a success or a failure via the new result property on all task execution information objects.
• Renamed scheduling_error on all task execution information objects to failure_information. TaskFailureInformation replaces TaskSchedulingError and is returned any time there is a task failure. This includes all previous scheduling error cases, as well as nonzero task exit codes, and file upload failures from the new output files feature.
• Renamed SchedulingErrorCategory enum to ErrorCategory.
• Renamed scheduling_error on ExitConditions to pre_processing_error to more clearly clarify when the error took place in the task life-cycle.
• Added support for provisioning application licenses to your pool, via a new application_licenses property on PoolAddParameter, CloudPool and PoolSpecification. Please note that this feature is in gated public preview, and you must request access to it via a support ticket.
• The ssh_private_key attribute of a UserAccount object has been replaced with an expanded LinuxUserConfiguration object with additional settings for a user ID and group ID of the user account.
• Removed unmapped enum state from AddTaskStatus, CertificateFormat, CertificateVisibility, CertStoreLocation, ComputeNodeFillType, OSType, and PoolLifetimeOption as they were not ever used.
• Improved and clarified documentation.

• This wheel package is now built with the azure wheel extension

• AAD token authentication now supported.
• Some operation names have changed (along with their associated parameter model classes):
  • pool.list_pool_usage_metrics -> pool.list_usage_metrics
  • pool.get_all_pools_lifetime_statistics -> pool.get_all_lifetime_statistics
  • job.get_all_jobs_lifetime_statistics -> job.get_all_lifetime_statistics
  • file.get_node_file_properties_from_task -> file.get_properties_from_task
  • file.get_node_file_properties_from_compute_node -> file.get_properties_from_compute_node
• The attribute 'file_name' in relation to file operations has been renamed to 'file_path'.
• Change in naming convention for enum values to use underscores: e.g. StartTaskState.waitingforstarttask -> StartTaskState.waiting_for_start_task.
• Support for running tasks under a predefined or automatic user account. This includes tasks, job manager tasks, job preparation and release tasks and pool start tasks. This feature replaces the previous 'run_elevated' option on a task.
• Tasks now have an optional scoped authentication token (only applies to tasks and job manager tasks).
• Support for creating pools with a list of user accounts.
• Support for creating pools using a custom VM image (only supported on accounts created with a "User Subscription" pool allocation mode).

• Added support for task reactivation

• Added support for joining a CloudPool to a virtual network on using the network_configuration property.
• Added support for application package references on CloudTask and JobManagerTask.
• Added support for automatically terminating jobs when all tasks complete or when a task fails, via the on_all_tasks_complete property and the CloudTask exit_conditions property.

• Initial Release