adlfs

What's Changed

• Breaking: Removed ADLS Gen1 Support by @anjaliratnam-msft in #545
• Normalize Etag format by @wonwuakpa-msft in #544

Full Changelog: 2026.4.0...2026.5.0

What's Changed

• Breaking: Updated value of anon to be False by @anjaliratnam-msft in #540
• Avoid awaiting close() when using sync credentials by @nateprewitt in #537
• Add **kwargs to exists() by @anjaliratnam-msft in #536
• Extended type hint of credential field by @wonwuakpa-msft in #534
• Capture version_id after upload by @shcheklein in #524
• Update changelog for 2026.4.0 release by @kyleknap in #542

New Contributors

• @wonwuakpa-msft made their first contribution in #534

Full Changelog: 2026.2.0...2026.4.0

What's Changed

• Respect protocol tuple in removal from full URIs by @kyleknap in #512
• Revise README for Azure Blob and Data Lake Storage by @tjvishnu in #514
• Set rm_files to be a synchronous method by @anjaliratnam-msft in #503
• Fix missing kwargs injection on put calls by @rodrigoberriel in #456
• Updated supported python versions by @anjaliratnam-msft in #521
• Move metadata evaluation to a lazy property by @nateprewitt in #528
• Update ADLS Gen 1 deprecation warning by @kyleknap in #529
• added aiohttp comment by @anjaliratnam-msft in #531
• linked API reference in README by @anjaliratnam-msft in #532
• Added deprecation warning for anonymous access by @anjaliratnam-msft in #530
• Update changelog for 2026.2.0 release by @kyleknap in #535

New Contributors

• @tjvishnu made their first contribution in #514
• @rodrigoberriel made their first contribution in #456

Full Changelog: 2025.8.0...2026.2.0

• Added "adlfs" to library's default user agent
• Fix issue where AzureBlobFile did not respect location_mode parameter from parent AzureBlobFileSystem when using SAS credentials and connecting to new SDK clients.
• The block size is now used for partitioned uploads. Previously, 1 GiB was used for each uploaded block irrespective of the block size
• Updated default block size to be 50 MiB. Set blocksize for AzureBlobFileSystem or block_size when opening AzureBlobFile to revert back to 5 MiB default.
• AzureBlobFile now inherits the block size from AzureBlobFileSystem when fs.open() is called and a block_size is not passed in.
• Introduce concurrent uploads for large AzureBlobFileSystem.write() calls. Maximum concurrency can be set using max_concurrency for AzureBlobFileSystem.

• Add "exclusive" more to put, pipe and open, as in upstream fsspec
• Allow concurrency in fetch_ranges
• update versions
• signed URLs from connection string; and add content type
• CI cleanups
• better error messages
• honor anon parameter better
• deterministic blob IDs on upload
• AzureBlobFileSystem and AzureBlobFile support pickling.
• Handle mixed casing for hdi_isfolder metadata when determining whether a blob should be treated as a folder.
• _put_file: overwrite now defaults to True.

What's Changed

• Fix account host by @dorbaker in #480
• Allow blobs and file systems to pickle by @ghidalgo3 in #479
• support signed urls via connection string alone by @shcheklein in #478

New Contributors

• @dorbaker made their first contribution in #480
• @ghidalgo3 made their first contribution in #479
• @shcheklein made their first contribution in #478

Full Changelog: 2024.4.1...2024.7.0

What's Changed

• Honor the anon parameter if set by @adam-roughton in #468

New Contributors

• @adam-roughton made their first contribution in #468

Full Changelog: 2024.4.0...2024.4.1

What's Changed

• add missing await on delete_blob call per issue 459 by @johnmacnamararseg in #460
• format via black and add installation of dev deps to contributing docs by @johnmacnamararseg in #464
• Make AzureBlobFileSystem anon behaviour configurable via env var. by @microft in #437
• document that credential needs to be from azure.identity.aio by @temporaer in #463

New Contributors

• @johnmacnamararseg made their first contribution in #460
• @microft made their first contribution in #437
• @temporaer made their first contribution in #463

Full Changelog: 2024.2.0...2024.4.0

What's Changed

• fs.url(): expose response content headers for pre-signed URLs by @pmrowla in #451

Full Changelog: 2024.1.0...2024.2.0

What's Changed

• adlfs: fix version typo by @efiop in https://github.com/fsspec/adlfs/pull/449
• Check for Hdi_isfolder with a capital by @basnijholt in https://github.com/fsspec/adlfs/pull/418
• put_file: default to overwrite=True by @pmrowla in https://github.com/fsspec/adlfs/pull/419
• Fix recursive delete on hierarchical namespace accounts by @Tom-Newton in https://github.com/fsspec/adlfs/pull/454

New Contributors

• @Tom-Newton made their first contribution in https://github.com/fsspec/adlfs/pull/454

Full Changelog: https://github.com/fsspec/adlfs/compare/2023.12.0...2024.1.0

What's Changed

• gha: run tests on schedule by @efiop in https://github.com/fsspec/adlfs/pull/445
• adlfs: get rid of versioneer and cleanup building by @efiop in https://github.com/fsspec/adlfs/pull/446
• improve exception message by @dtrifiro in https://github.com/fsspec/adlfs/pull/442
• adlfs: raise nicer FileNotFoundError's by @efiop in https://github.com/fsspec/adlfs/pull/444
• tests: pin pytest-asyncio to 0.21.1 by @efiop in https://github.com/fsspec/adlfs/pull/447
• adlfs: don't append / to dirs in find() and fix glob() by @efiop in https://github.com/fsspec/adlfs/pull/448
• callback: guard against invalid values by @skshetry in https://github.com/fsspec/adlfs/pull/441

Full Changelog: https://github.com/fsspec/adlfs/compare/2023.10.0...2023.12.0

What's Changed

• adlfs: add support for timeout/connection_timeout/read_timeout by @efiop in https://github.com/fsspec/adlfs/pull/430

Full Changelog: https://github.com/fsspec/adlfs/compare/2023.9.0...2023.10.0

• Compatability with new glob behavior in fsspec 2023.9.0
• Compatability with azure.storage.blob 12.18.1

• Reorder fs.info() to search the parent directory only after searching for the specified item directly
• Removed pin on upper bound for azure-storage-blob
• Moved AzureDatalakeFileSystem to a separate module, in acknowledgement of Microsoft End of Life notice
• Added DeprecationWarning to AzureDatalakeFilesystem

• Fixed missing dependency on aiohttp in package metadata.

• Add support to AzureBlobFileSystem for versioning
• Assure full uri's are left stripped to remove ""
• Set Python requires >=3.8 in setup.cfg
• _strip_protocol handle lists

• Fix overflow error when uploading files > 2GB

• Added support for Python 3.10 and pinned Python 3.8
• Skip test_url due to bug in Azurite
• Added isort and update pre-commit

• Updated requirements to fsspec >= 2021.10.1 to fix #280
• Fixed deprecation warning in pytest_asyncio by setting asycio_mode = True

• Fixed isdir() bug causing some directories to be labeled incorrectly as files
• Added flexible url handling to improve compatibility with other applications using Spark and fsspec

• Fixed call to isdir(), to run direct call to Azure container, instead of calling .ls on the directory
• Fixed call to isfile() to directly evaluate the file, insteading of calling ls on the directory
• Updated unit test for isdir
• Added DefaultAzureCredential as an authentication method. Activated if anon is False, and no explicit credentials are passed. See authentication methods enabled here.
• Updated initiate_upload() method to allow overwriting a blob if the credentials do not have delete priveleges.

• Fixed bug in fetch_range that caused attempted reads beyond end of file
• Added check to mkdir when creating a container to confirm container_name conforms to Azure requirements

• Compatability with fsspec 2021.6.0
• exists() calls now also checks whether a directory with that name exists or not. Previously this was only checked from the cache
• Fixed bug in find not returning exact matches
• Added AzureDatalakeFileSystem.rm_file and AzureDatalakeFileSystem.rmdir
• Fixed bug in filter_blobs when target path contained a special character

• Added the location_mode parameter to AzureBlobFileSystem object, and set default to "primary" to enable Access Control Lists and RA-GRS access. Valid values are "primary" and "secondary"

• Now can create / destroy containers with mkdir()/rmdir() without needing to have the privilige of listing all containers.
• When called with only container name, exists() now returns the proper result (about the existence of the container) instead of a hard-coded True
• Removed version constraints on azure-storage-blob, pytest, and docker
• Updated conftest script to start Azurite docker container

• fsspec version updated to 0.9.0

• Updated path structure, so virtual folders in Azure blobs are created with a trailing "/", to fix #137
• Converted all references to blob_clients to occur inside a context manager
• Added metadata to blob reads and writes, with {"is_directory": "<true or false>"} to help resolve ambiguous folder and file discrepancies
• Minor update to assure compatibility with fsspec==0.8.7
• Added error handling to AzureBlobFile finalizer
• Updated AzureBlobFile.close method to execute threadsafe with asyncio
• Added check for leading "?" in sas_token parameter
• Fix for setting loop attribute on newer version of fsspec #197
• Converted self.mkdir() to a no-op to align to fsspec issue #562
• Fixed errors with pyarrow write_dataset method related to pseudo-directories in *171.
• Fixed race conditions with finalizer on AzureBlobFile object
• Pinned fsspec to 0.8.7 to respect this change in async

• Added ability to connect with only connection_string.
• connection_string now pre-empts other credentials.

• Added ability to fetch multiple AZURE_STORAGE_XYZ credentials as environmental variables

• Removed weakref and added close method to fix memory leak
• Added **kwargs reference to _cp_file

• Implemented asynchronous uploads and downloads of AzureBlobFile objects
• Aligned on policy for asynchronous context managers to be preferred with blob_client.
• Added abfs.makedir() method and aligned exist_ok parameter to fsspec api
• Updated abfs.mkdir() method to align to fsspec api.
• Pinned azure-storage-blob >= 12.5.0,<12.7.0 -- version 12.7.0 breaks compatability with azurite for unit testing

• Fixed expception raised when commiting writes of large blobs
• Improved performance when checking for the existance of a key in a container with .exists()
• Improved performance of .find()
• Improved documentation for Azure SDK
• Fixed failed authentication when passing a credential

• Updated azure-storage-blob dependency to >=v12
• Addede azure-core as dependency for exception handling
• Updated code for compatibility with fsspec > 0.6