sagemaker

Features

• Enable default role for Spark processors
• SDK Defaults - S3 Params for Session
• Bump up images for DJL transformers Neuronx DLCs

Bug Fixes and Other Changes

• Relax local-mode PyPI requirements on urllib3

Documentation Changes

• Fix Tensorflow and PyTorch supported version in HuggingFaceProcessor
• Update doc for model_server_workers param in PyTorchModel

Features

• Handle use case where endpoint is created outside of python …

Bug Fixes and Other Changes

• Make type annotation of UploadedCode consistent
• Add SELinux label to local docker volumes

Features

• Partition support for DJLModel using SM Training job
• Update run-notebook-test to consider skips failures

Bug Fixes and Other Changes

• Update apache airflow and update test requirements
• Perform integrity checks for remote function execution
• Add p2 instances to integ tests
• Fix typo in logging message within ir mixin
• double Run create on load_run
• Update dtype logic for huggingface backend for new containers

Documentation Changes

• Update container version for SKLearn
• Add description for parameters in TransformInput

Features

• Add support for SageMaker Serverless inference Provisioned Concurrency feature

Bug Fixes and Other Changes

• Revert "fix: make RemoteExecutor context manager non-blocking on pend…
• Add BOM to no No P2 Availability region list

Features

• Add integ tests for remote_function, auto_capture functionality
• jumpstart model estimator classes

Bug Fixes and Other Changes

• integs - pytorch transformer deps and add test retry
• adding .lower() so new Pandas dtypes will match the type lookup.
• Pass KMS value to create processing job

Features

• Support npz archives in NumpyDeserializer
• Add FasterTransformer DJL support
• support for Sample Weights for SageMaker Autopilot

Bug Fixes and Other Changes

• retry is_run assertion
• Avoid 'AttributeError' for endpoint_name, if deploy() is not yet called
• Fix LambdaStep Creation
• Fix error when instance_count>1 in remote_function
• Remove deprecated update_endpoint from deploy() args in TensorFlowModel
• Update DJL deepspeed and fastertransformer DLC image uris
• remote_function python version mismatch issue

Features

• add support for lineage visualization using pyvis
• Expose Experiment class publicly
• PyTorch 1.13 release

Bug Fixes and Other Changes

• Change data_type argument to dtype to keep consistent with D…
• Skip edge test
• make RemoteExecutor context manager non-blocking on pending futures
• Add inferentia2 DLC images for djl framework
• Fix typo in using_pytorch.rst
• Unable to attach estimator to training job when KeepAlivePeriodInSeconds specified
• update LMI container image
• Update Clarify SHAPConfig baseline to allow JSON structures

Documentation Changes

• Fix broken link in DJL SageMaker docs
• currency update for the SageMaker data parallelism lib
• SM model parallel library v1.15.0 release note

Features

• Update Transformers 4.26 - TensorFlow 2.11.0 Image URI
• Add Extra Parameters to Lambda Function Wrapper

Bug Fixes and Other Changes

• Add kms key support for Model registration
• Enable inference recommender slow tests
• Pass sagemaker session to downstream s3 calls
• Add ap-south-1 to no p3 regions
• skip test for p2 instance for TF2.12 and above

Documentation Changes

• Fix minor misses from the remote function doc release

Features

• Introduce TensorBoard app class

Bug Fixes and Other Changes

• Update data wrangler images

Features

• Support TF2.12 SageMaker DLC

Bug Fixes and Other Changes

• update the doc for Join function
• change s3UploadMode of sagemaker clarify processing output for computer vision jobs.

Documentation Changes

• Add Remote Function updates

Features

• [huggingface] Add torch.distributed support for Trainium and torchrun
• Add PyTorch 2.0 to SDK

Bug Fixes and Other Changes

• updating batch transform job in monitoring schedule

Features

• support different types of deletion mode

Bug Fixes and Other Changes

• skip failing tests temporarily
• Added ml.p4d and ml.p4de as supported instances for DeepSpeed

Documentation Changes

• Add Model Registry Model Collection

Features

• Add support for JSON model inputs for Clarify Processor

Bug Fixes and Other Changes

• Feature/list collection
• improve reliability of Run integration test
• Add a comment that smdataparallel lib excludes tf 2.12 support

Documentation Changes

• Update reference to load run method in documentation

Features

• add support for async inline error notifications
• Add methods for feature group to list feature metadata parameters and tags
• Support huggingface hub model_id for DJL Models

Bug Fixes and Other Changes

• load_sagemaker_config should lazy initialize a default S3 resource

Features

• support create Clarify explainer enabled endpoint for Clarify Online Explainability
• Combined inference and training script artifact
• jumpstart instance types
• Deprecation warning for framework profiling for TF 2.12 and on, PT 2.0 and on

Bug Fixes and Other Changes

• always delete temporary directory even during exception
• Fixes the completion_criteria_config dict in the to_input_req method
• Update CHANGELOG.md

Documentation Changes

• Update SageMaker Debugger doc

Features

• Support for SageMaker SDK Defaults

Bug Fixes and Other Changes

• update feature store offline s3 path used in tests

Features

• combined model + script artifact

Features

• AutoGluon 0.7.0 image_uris update
• Add DJL FasterTransformer image uris
• EMR step runtime role support
• locations for EMR configuration and Spark dependencies
• Adding support for 1P Algorithms in ZAZ, ZRH, HYD, MEL

Documentation Changes

• Update FeatureGroup kms key id documentation

Bug Fixes and Other Changes

• Fix cross account register model
• Handle instance support for Hugging Face tests
• Upgrade apache-airflow-providers-amazon version
• build(deps): bump apache-airflow from 2.4.1 to 2.5.1
• Mark test_create_model_package test for xfail
• Disable module-not-measured warnings to avoid clutter in build logs

Features

• SDK changes for TRCOMP support

Bug Fixes and Other Changes

• [Feature - Hugging Face] Update Transformers 4.26 - PyTorch 1.13.1 Image uri

Features

• Add XGBoost framework 1.7-1 version

Bug Fixes and Other Changes

• Fix image_uris.retrieve() function to return ValueError when framework is not allowed for an instance_type

Features

• Jumpstart training metrics

Bug Fixes and Other Changes

• Add new region support for MX, PT, TF on SM Training

Features

• support JSON for input dataset and model output

Bug Fixes and Other Changes

• Wait on describe for tag propagation
• Extracted profile_name directly from sagemaker.Session if None
• Avoid double encoding to JSON in InferenceRecommenderMixin
• RepackStep must use the same KMS key as the Model

Features

• with_feature_group [feature_store]
• Djl Large Model Support
• Decouple model.right_size() from model registry

Bug Fixes and Other Changes

• Fix integration test error in test_default_right_size_and_deploy_unregistered_base_model
• Add djl 0.21.0 dlc images

Documentation Changes

• Torchrun gpu support documentation change

Documentation Changes

• update feature store dataset builder docs

Bug Fixes and Other Changes

• Revert back to stable apache-airflow-providers-amazon from 7.2.1 to 4.0.0.
• Typo in graviton algos
• build(deps): bump apache-airflow-providers-amazon from 4.0.0 to 7.2.1 in /requirements/extras
• Support cloning private repo using ssh key
• Create a default SageMaker Session inside FeatureGroup class

Documentation Changes

• fix typo in README

Features

• Add DLC accounts for MEL Region
• allow use of short lived creds for local container

Bug Fixes and Other Changes

• update lambda function when function arn is provided

Bug Fixes and Other Changes

• local mode deletion of temp files on job end
• Cron expression resetting on update monitor
• added support to update arguments in create_monitoring_schedule

Features

• Add python 3.9 and spark 3.2 support for spark processor
• Adding support for Multi Worker Mirrored Strategy in TF estimator

Bug Fixes and Other Changes

• tag permission issue - remove describe before create

Features

• feature store with_feature_group functionality changes
• Adding support for SageMaker Training Compiler PyTorch 1.13
• support of the intelligent stopping in the tuner
• AutoGluon 0.6.2 image_uris update
• Support for flexible instance types in the HPO
• Add business details and hyper parameters fields and update test_model_card.py

Bug Fixes and Other Changes

• disable the tuner test
• Skip test_run_from_transform_job integ test to unblock python-sdk code pipeline
• Revert "feature: feature store with_feature_group functionality changes"
• advanced inference recommendation jobs parameters check
• make model_config optional when predicted labels are provided for bias detection

Features

• support cluster lifecycle management for Sagemaker EMR step
• Inference recommendation id deployment support

Bug Fixes and Other Changes

• test dub gpu integs with p3
• fix(experiments/run.py): Stop duplication of RUN_TC_TAG on Consecutive Experiment Runs
• Enable load_run without name args in Transform env
• Remove confusing log line emitted during feature group ingestion
• Enable Experiment integ test on beta clients
• Make test_processor_with_role_as_pipeline_parameter more concrete

Documentation Changes

• add security note for the estimator hyperparameter arg
• SageMaker distributed - model parallism library release note
• Add a deprecation note for DetailedProfileConfig

Features

• Display file diff on black-check
• Support for environment variables in the HPO
• Support role as PipelineParameter in Processor class
• Add TrainingImageConfig support for SageMaker training jobs

Bug Fixes and Other Changes

• use FeatureGroup's Session in nonconcurrency ingestion
• Update feature_group.py ingest() description
• Do not use print function. User logger instead
• Add batch_get_record and search API for FeatureStore
• hashing problem for framework processors with identical source dirs

Features

• Add PyTorch 1.13.1 to SDK
• Adding image_uri config for DJL containers
• Support specifying env-vars when creating model from model package
• local download dir for Model and Estimator classes

Bug Fixes and Other Changes

• increase creation time slack minutes
• Enable load_run auto pass in experiment config
• Add us-isob-east-1 accounts and configs
• Clean up Pipeline unit tests

Features

• add p2 deprecation for PT>=1.13
• TF2.11 Update to PySDK

Bug Fixes and Other Changes

• Improve Pipeline integ tests and fix resource leak
• Update TF version to 2.8.4

Features

• right_size() for inference recommender

Bug Fixes and Other Changes

• tf 2.9.3 release images
• Retry ValueError for airflow tests

Features

• tensorflow inference 2.10.1 release

Features

• AutoGluon 0.6.1 image_uris

Bug Fixes and Other Changes

• Fix broken link in doc
• Do not specify S3 path for disabled profiler

Documentation Changes

• fix the incorrect property reference

Features

• add RandomSeed to support reproducible HPO

Bug Fixes and Other Changes

• Correct SageMaker Clarify API docstrings by changing JSONPath to JMESPath

Features

• Doc update for TableFormatEnum
• Add p4de to smddp supported instance types
• Add disable_profiler field in config and propagate changes
• Added doc update for dataset builder

Bug Fixes and Other Changes

• Use Async Inference Config when available for endpoint update

Documentation Changes

• smdistributed libraries release notes

Features

• Add support for TF2.9.2 training images
• Add SageMaker Experiment

Features

• Feature Store dataset builder, delete_record, get_record, list_feature_group
• Add OSU region to frameworks for DLC

Bug Fixes and Other Changes

• the Hyperband support fix for the HPO
• unpin packaging version
• Remove content type image/jpg from analysis configuration schema

Bug Fixes and Other Changes

• Update for Tensorflow Serving 2.11 inference DLCs
• Revert "fix: type hint of PySparkProcessor init"
• Skip Bad Transform Test

Bug Fixes and Other Changes

• Pop out ModelPackageName from pipeline definition
• Fix failing jumpstart cache unit tests

Features

• Algorithms Region Expansion OSU/DXB

Bug Fixes and Other Changes

• FrameworkProcessor S3 uploads
• Add constraints file for apache-airflow

Features

• Add Neo image uri config for Pytorch 1.12
• Adding support for SageMaker Training Compiler in PyTorch estimator starting 1.12
• Update registries with new region account number mappings.
• Add DXB region to frameworks by DLC

Bug Fixes and Other Changes

• support idempotency for framework and spark processors

Features

• Add Code Owners file
• Added transform with monitoring pipeline step in transformer
• Update TF 2.9 and TF 2.10 inference DLCs
• make estimator accept json file as modelparallel config
• SageMaker Training Compiler does not support p4de instances
• Add support for SparkML v3.3

Bug Fixes and Other Changes

• Fix bug forcing uploaded tar to be named sourcedir
• Update local_requirements.txt PyYAML version
• refactoring : using with statement
• Allow Py 3.7 for MMS Test Docker env
• fix PySparkProcessor init params type
• type hint of PySparkProcessor init
• Return ARM XGB/SKLearn tags if image_scope is inference_graviton
• Update scipy to 1.7.3 to support M1 development envs
• Fixing type hints for Spark processor that has instance type/count params in reverse order
• Add DeepAR ap-northeast-3 repository.
• Fix AsyncInferenceConfig documentation typo
• fix ml_inf to ml_inf1 in Neo multi-version support
• Fix type annotations
• add neo mvp region accounts

Features

• Update boto3 version to 1.26.20
• support table format option for create feature group.
• Support Amazon SageMaker Model Cards
• support monitoring alerts api
• Support Amazon SageMaker AutoMLStep

Bug Fixes and Other Changes

• integration test in anticipate of ProfilerConfig API changes
• Add more integ test logic for AutoMLStep
• update get_execution_role_arn to use role from DefaultSpaceSettings
• bug on AutoMLInput to allow PipelineVariable
• FinalMetricDataList is missing from the training job search resu…
• add integration tests for Model Card
• update AutoMLStep with cache improvement

Documentation Changes

• automlstep doc update

Features

• add support for PT1.12.1

Features

• support customized timeout for model data download and inference container startup health check for Hosting Endpoints
• Trainium Neuron support for PyTorch
• Pipelines cache keys update
• Caching Improvements for SM Pipeline Workflows

Features

• Add support for TF 2.10 training
• Disable profiler for Trainium instance type
• support the Hyperband strategy with the StrategyConfig
• support the GridSearch strategy for hyperparameter optimization

Bug Fixes and Other Changes

• Update Graviton supported instance families

Features

• Graviton support for XGB and SKLearn frameworks
• Graviton support for PyTorch and Tensorflow frameworks
• do not expand estimator role when it is pipeline parameter
• added support for batch transform with model monitoring

Bug Fixes and Other Changes

• regex in tuning integs
• remove debugger environment var set up
• adjacent slash in s3 key
• Fix Repack step auto install behavior
• Add retry for airflow ParsingError

Documentation Changes

• doc fix

Features

• support torch_distributed distribution for Trainium instances

Bug Fixes and Other Changes

• bump apache-airflow from 2.4.0 to 2.4.1 in /requirements/extras

Documentation Changes

• fix kwargs and descriptions of the smdmp checkpoint function
• add the doc for the MonitorBatchTransformStep

Bug Fixes and Other Changes

• Update Neo-TF2.x versions to TF2.9(.2)

Documentation Changes

• fix typo in PR template

Bug Fixes and Other Changes

• fix(local-mode): loosen docker requirement to allow 6.0.0
• CreateModelPackage API error for Scikit-learn and XGBoost frameworkss