NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
crates.io, #2441 most downloaded on crates.io
Apache OpenDAL™: One Layer, All Storage.
Latest stable
0.59.5
Last release 1 months ago
18 Oct 2026
Release timing varies
gaps range from 1 weeks to 5 months
Nearly every release is documented
notes for 60 of the last 60 stable releases
3 versions withdrawn
withdrawn after publishing
5 years old
161 releases · first in 2022
Drag across the ruler to compare, or tap a release to open it.
OpenDAL add the Write::sink API to enable streaming writing. This is a breaking change for users who depend on the raw API.
There are no public API changes.
OpenDAL add the Write::sink API to enable streaming writing. This is a breaking change for users who depend on the raw API.
For a quick fix, users who have implemented opendal::raw::oio::Write can return an Unsupported error for Write::sink().
More detailes could be found at RFC: Writer sink API.
<!-- Release notes generated using configuration in .github/release.yml at v0.38.0 -->
is_exist create_dir copy rename delete by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2475Monad wrapper by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2482std feature for futures to allow futures::AsyncRead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2450vercel artifacts for FromStr by @cijiugechu in https://github.com/apache/incubator-opendal/pull/2519create with new by @NiwakaDev in https://github.com/apache/incubator-opendal/pull/2427Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.37.0...v0.38.0
Your coding agent can read these notes before it upgrades. Set up the MCP server →
<!-- Release notes generated using configuration in .github/release.yml at v0.37.0 -->
<!-- Release notes generated using configuration in .github/release.yml at v0.37.0 -->
In v0.37.0, OpenDAL bump the version of reqsign to v0.13.0.
There are no public API and raw API changes.
Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.36.0...v0.37.0
Nothing published for this version
ci: Fix Node.js 12 actions deprecated warning
In v0.36, OpenDAL improving the xxx_with API by allow it to be called in chain:
After this change, all xxx_with alike call will be changed from
let bs = op.read_with(
"path/to/file",
OpRead::new()
.with_range(0..=1024)
.with_if_match("<etag>")
.with_if_none_match("<etag>")
.with_override_cache_control("<cache_control>")
.with_override_content_disposition("<content_disposition>")
).await?;
to
let bs = op.read_with("path/to/file")
.range(0..=1024)
.if_match("<etag>")
.if_none_match("<etag>")
.override_cache_control("<cache_control>")
.override_content_disposition("<content_disposition>")
.await?;
For blocking API calls, we will need a call() at the end:
let bs = bop.read_with("path/to/file")
.range(0..=1024)
.if_match("<etag>")
.if_none_match("<etag>")
.override_cache_control("<cache_control>")
.override_content_disposition("<content_disposition>")
.call()?;
Along with this change, users don't need to call OpXxx anymore so we moved it to raw API.
More detailes could be found at [RFC: Chain Based Operator API][https://opendal.apache.org/docs/rust/opendal/docs/rfcs/rfc_2299_chain_based_operator_api/index.html].
Migrated opendal::ops to opendal::raw::ops.
ops to raw::ops (#2325)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.35.0...v0.36.0
NOTE: This release is not yet an official ASF release.
NOTE: This release is not yet an official ASF release.
Operator::from_env and Operator::from_iter APIs
Operator::via_map instead.append support with could break existing layers. Please make sure append requests have been forward correctly.scan and list, OpenDAL removes the scan from raw API. Please use list_without_delimiter instead.list, create_dir, stat and upload
ing large files (#2231)abi3 to avoid building on different python
version (#2255)append (#2260)scan from raw API (#2262)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.34.0...v0.35.0
NOTE: This release is not yet an official ASF release. We are waiting for the vote.
NOTE: This release is not yet an official ASF release. We are waiting for the vote.
" (#2226)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.3...v0.34.0
NOTE: This release is not yet an official ASF release. We are waiting for the vote.
NOTE: This release is not yet an official ASF release. We are waiting for the vote.
read_with_override_cache_control (#2155)Contributing and add Developing (#2169)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.2...v0.33.3
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
stat_with_if_none_match (#2122)cache-control to Metadata (#2136)write_with_cache_control (#2131)write_with_content_type (#2140)read_with_if_none_match (#2141)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.1...v0.33.2
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
PreconditionFailed to ConditionNotMatch (#2104)start-after support for list (#2096)content length=0 for gcs initiate_resumable_upload (#2110)package.json repository info (#2078)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.0...v0.33.1
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
OpenDAL 0.33 has redesigned the Writer API, replacing all instances of writer.append() with writer.write(). For more information, please refer to Writer.
In addition to the redesign of the Writer API, we have removed append from oio::Write. Therefore, users who implement services and layers should also remove it.
After v0.33 landing, services should handle OpWrite::content_length correctly by following these guidelines:
NotSupported if content length is None.close or abort has been called.Furthermore, OpenDAL 0.33 introduces a new concept called Capability which replaces AccessorCapability. Services must adapt to this change.
start-after support for list (#2071)--provenance (#2046)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.32.0...v0.33.0
OpenDAL 0.32 doesn't have much breaking changes.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
OpenDAL 0.32 doesn't have much breaking changes.
We changed Accessor::create into Accessor::create_dir. Only users who implement Layer need to change.
Create to CreateDir for its behavior changed (#2019)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.31.1...v0.32.0
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.31.0...v0.31.1
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
In version v0.31 of OpenDAL, we made some internal refactoring to improve its compatibility with the ecosystem.
We increased the MSRV to 1.64 from v0.31 onwards. Although it is still possible to build OpenDAL under older rustc versions, we cannot guarantee that any issues related to them will be fixed.
std::time::Duration insteadPreviously, OpenDAL accepted time::Duration as input for presign_xxx. However, since v0.31, we have changed this to accept std::time::Duration so that users do not need to depend on time. Internally, we migrated from time to chrono for better integration with other parts of the ecosystem.
disable_ec2_metadata for services s3We have added a new configuration option called disable_ec2_metadata for the S3 service in response to a mistake where it was mixed up with another option called disable_config_load. Users who want to disable loading credentials from EC2 metadata should set this option instead.
Starting from v0.31, all services in OpenDAL are split into different feature flags. To enable only S3 support, use the following TOML configuration:
opendal = {
version = "0.31",
default-features = false,
features = ["services-s3"]
}
copy and rename (#1866)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.5...v0.31.0
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
oli rm (#1774)oli stat (#1778)oli cp -r (#1787)Operator::scan and Operator::remove_all (#1779)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.4...v0.30.5
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.3...v0.30.4
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.
index.d.ts (#1664)__repr__ to Operator and AsyncOperator (#1683)pyo3/entension-module feature when building with maturin (#1680)Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.2...v0.30.3
ci(bindings/nodejs): Fix nodejs package can't uploaded by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1564
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.30.1...v0.30.2
chore(bindings/nodejs): update license in package.json by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1556
Operator::create() has been removed by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1560Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.30.0...v0.30.1
In version 0.30, we made significant breaking changes by removing objects. Our goal in doing so was to provide our users with APIs that are easier to…
In version 0.30, we made significant breaking changes by removing objects. Our goal in doing so was to provide our users with APIs that are easier to understand and maintain.
More detailes could be found at [RFC: Remove Object Concept][crate::docs::rfcs::rfc_1477_remove_object_concept].
To upgrade to OpenDAL v0.30, users need to make the following changes:
object\((.*)\).reader\(\) to reader($1)
ObjectMetakey => MetakeyObjectMode => EntryModeErrorKind::ObjectXxx to ErrorKind::XxxAccessorMetadata => AccessorInfoObjectMetadata => Metadataoperator.metadata() => operator.info()create to create_dir by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1512Operator.writer until we are ready by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1528Operator.create_dir by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1529create_dir by @messense in https://github.com/datafuselabs/opendal/pull/1534delete and export more metadata fields by @messense in https://github.com/datafuselabs/opendal/pull/1539list and scan by @messense in https://github.com/datafuselabs/opendal/pull/1541EntryMode to Entry by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1543Operator.scanSync & Operator.listSync by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1546Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.29.1...v0.30.0
docs: Add convert from m*n to m+n by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1454
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.29.0...v0.29.1
In v0.29, we introduced [Object Writer][crate::rfcs::rfc_1420_object_writer] to replace existing Multipart related APIs.
In v0.29, we introduced [Object Writer][crate::docs::rfcs::rfc_1420_object_writer] to replace existing Multipart related APIs.
Users can now append multiparts bytes into object via:
let mut w = o.writer().await?;
w.write(bs1).await?;
w.write(bs2).await?;
w.close()
Along with this change, we cleaned up a lot of internal structs and traits. Users who used to depend on opendal::raw::io::{input,output} should use opendal::raw::oio instead.
Also, decompress related feature also removed. Users can use async-compression with ObjectReader directly.
io::input and Rename io::output to oio by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1446Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.28.0...v0.29.0
io::input and Rename io::output to oio (#1446)In v0.28, we introduced Query Based Metadata. Users can query cached metadata with `ObjectMetakey` to make sure that OpenDAL always makes the best dec
In v0.28, we introduced Query Based Metadata. Users can query cached metadata with ObjectMetakey to make sure that OpenDAL always makes the best decision.
- pub async fn metadata(&self) -> Result<ObjectMetadata>;
+ pub async fn metadata(
+ &self,
+ flags: impl Into<FlagSet<ObjectMetakey>>,
+ ) -> Result<Arc<ObjectMetadata>>;
Please visit Object::metadata()'s example for more details.
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.27.2...v0.28.0
feat: Add batch API for Accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1339
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.27.1...v0.27.2
feat: Add username and password support for WebDAV by @Young-Flash in https://github.com/datafuselabs/opendal/pull/1323
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.27.0...v0.27.1
In v0.27, we refactored our list related logic and added scan support. So make Pager and BlockingPager associated types in Accessor too!
In v0.27, we refactored our list related logic and added scan support. So make Pager and BlockingPager associated types in Accessor too!
pub trait Accessor: Send + Sync + Debug + Unpin + 'static {
type Reader: output::Read;
type BlockingReader: output::BlockingRead;
+ type Pager: output::Page;
+ type BlockingPager: output::BlockingPage;
}
Due to this change, all layers implementation should be changed. If there is not changed over pager, they can by changed like the following:
impl<A: Accessor> LayeredAccessor for MyAccessor<A> {
type Inner = A;
type Reader = MyReader<A::Reader>;
type BlockingReader = MyReader<A::BlockingReader>;
+ type Pager = A::Pager;
+ type BlockingPager = A::BlockingPager;
+ async fn list(&self, path: &str, args: OpList) -> Result<(RpList, Self::Pager)> {
+ self.inner.list(path, args).await
+ }
+ async fn scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::Pager)> {
+ self.inner.scan(path, args).await
+ }
+ fn blocking_list(&self, path: &str, args: OpList) -> Result<(RpList, Self::BlockingPager)> {
+ self.inner.blocking_list(path, args)
+ }
+ fn blocking_scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::BlockingPager)> {
+ self.inner.blocking_scan(path, args)
+ }
}
To reduce the understanding overhead, we move all OpXxx into opendal::ops now. User may need to change:
- use opendal::OpWrite;
+ use opendal::ops::OpWrite;
backon is the implementation detail of our RetryLayer, so we hide it from our public API. Users of RetryLayer need to change the code like:
- RetryLayer::new(backon::ExponentialBackoff::default())
+ RetryLayer::new()
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.26.2...v0.27.0
docs: fix typo by @hezhizhen in https://github.com/datafuselabs/opendal/pull/1285
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.26.1...v0.26.2
refactor: Remove not used layer subdir
In v0.26 we have replaced all internal dynamic dispatch usage with static dispatch. With this change, we can ensure that all operations performed insi
In v0.26 we have replaced all internal dynamic dispatch usage with static dispatch. With this change, we can ensure that all operations performed inside OpenDAL are zero cost.
Due to this change, we have to refactor the logic of Operator's init logic. In v0.26, we added opendal::Builder trait and opendal::OperatorBuilder. For the first glance, the only change to existing code will be like:
- let op = Operator::new(builder.build()?);
+ let op = Operator::new(builder.build()?).finish();
By adding a finish() call, we will erase all generic types so that Operator can still be easily to used everywhere as before.
In v0.26, Accessor has been changed into trait with associated types.
All services need to decalare the types returned as Reader or BlockingReader:
pub trait Accessor: Send + Sync + Debug + Unpin + 'static {
type Reader: output::Read;
type BlockingReader: output::BlockingRead;
}
If your service doesn't support read or blocking_read, we can use () to represent an dummy reader:
impl Accessor for MyDummyAccessor {
type Reader = ();
type BlockingReader = ();
}
As described before, OpenDAL prefer to use static dispatch. Layers are required to implement the new Layer and LayeredAccessor trait:
pub trait Layer<A: Accessor> {
type LayeredAccessor: Accessor;
fn layer(&self, inner: A) -> Self::LayeredAccessor;
}
#[async_trait]
pub trait LayeredAccessor: Send + Sync + Debug + Unpin + 'static {
type Inner: Accessor;
type Reader: output::Read;
type BlockingReader: output::BlockingRead;
}
LayeredAccessor is a wrapper of Accessor with the typed Innder. All methods that not implemented will be forward to inner instead.
Since v0.26, we implement opendal::Builder for all services, and services' mod will not be exported.
- use opendal::services::s3::Builder;
+ use opendal::services::S3;
Sorry again for the big changes in this release. It's a big step for OpenDAL to work in more critical systems.
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.25.2...v0.26.0
fix(services/ghac): Fix log message for ghac_upload in write by @rajivshah3 in https://github.com/datafuselabs/opendal/pull/1239
ghac_upload in write by @rajivshah3 in https://github.com/datafuselabs/opendal/pull/1239Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.25.1...v0.25.2
ci: Setup benchmark workflow by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1200
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.25.0...v0.25.1
chore(deps): replace dotenv with dotenvy by @Nugine in https://github.com/datafuselabs/opendal/pull/1187
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.6...v0.25.0
feat: implement tokio::{AsyncRead, AsyncSeek} for ObjectReader by @e1ijah1 in https://github.com/datafuselabs/opendal/pull/1175
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.5...v0.24.6
fix(services/memcached): TcpStream should only accept host:port by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1170
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.4...v0.24.5
feat: Add presign endpoint option for OSS by @flaneur2020 in https://github.com/datafuselabs/opendal/pull/1135
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.3...v0.24.4
feat: Implement memcached service support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1161
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.2...v0.24.3
refactor: Use dep: to make our features more clean by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1153
dep: to make our features more clean by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1153Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.1...v0.24.2
fix: Allow range_read to be retired by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1149
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.0...v0.24.1
In v0.24, we made a big refactor on our internal IO-related traits. In this version, we split our IO traits into input and output versions:
In v0.24, we made a big refactor on our internal IO-related traits. In this version, we split our IO traits into input and output versions:
Take Reader as an example:
input::Reader is the user input reader, which only requires futures::AsyncRead + Send.
output::Reader is the reader returned by OpenDAL, which implements futures::AsyncRead, futures::AsyncSeek, and futures::Stream<Item=io::Result<Bytes>>. Besides, output::Reader also implements Send + Sync, which makes it useful for users.
Due to this change, all code that depends on BytesReader should be refactored.
BytesReader => input::ReaderOutputBytesReader => output::ReaderThanks to the change of IO trait split, we make ObjectReader implements all needed traits:
futures::AsyncReadfutures::AsyncSeekfutures::Stream<Item=io::Result<Bytes>>Thus, we removed the seekable_reader API. They can be replaced by range_reader:
o.seekable_reader => o.range_readerMost changes only happen inside. Users not using opendal::raw::* will not be affected.
Sorry for the inconvenience. I think those changes are required and make OpenDAL better! Welcome any comments at Discussion.
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.23.0...v0.24.0
feat: Implement object handler so that we can do seek on file by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1091
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.6...v0.23.0
feat(io): make BlockingBytesRead Send + Sync by @sundy-li in https://github.com/datafuselabs/opendal/pull/1083
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.5...v0.22.6
feat: Add service account support for gcs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1076
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.4...v0.22.5
chore(deps): update base64 requirement from 0.13 to 0.20 by @dependabot in https://github.com/datafuselabs/opendal/pull/1067
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.3...v0.22.4
fix(services/moka): Don't print all content in cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1057
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.2...v0.22.3
feat(presign): support presign head method for s3 and oss by @ZhiHanZ in https://github.com/datafuselabs/opendal/pull/1049
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.1...v0.22.2
fix(services/s3): Allow disable loading from imds_v2 and assume_role by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1044
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.0...v0.22.1
chore(deps): update env_logger requirement from 0.9 to 0.10 by @dependabot in https://github.com/datafuselabs/opendal/pull/1015
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.2...v0.22.0
feat: Add azdfs support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1009
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.1...v0.21.2
deps: Remove not used thiserror and num-trait by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1005
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.0...v0.21.1
Sorry for introducing too much breaking change in a single version. This version can be a solid version for preparing OpenDAL v1.0.
v0.21 is an internal refactor version of OpenDAL. In this version, we refactored our error handling and our Accessor APIs. Thanks to those internal changes, we added an object-level metadata cache, making it nearly zero cost to reuse existing metadata continuously.
Let's start with our errors.
As described in RFC-0977: Refactor Error, we refactor opendal error by a new error
called opendal::Error.
This change will affect all APIs that are used to return io::Error.
To migrate this, please replace std::io::Error with opendal::Error:
- use std::io::Result;
+ use opendal::Result;
And the following error kinds should be updated:
std::io::ErrorKind::NotFound => opendal::ErrorKind::ObjectNotFoundstd::io::ErrorKind::PermissionDenied => opendal::ErrorKind::ObjectPermissionDeniedAnd since v0.21, we will return errors ObjectIsADirectory and ObjectNotADirectory instead of anyhow::Error.
In v0.21, we refactor the whole Accessor's API:
- async fn write(&self, path: &str, args: OpWrite, r: BytesReader) -> Result<u64>
+ async fn write(&self, path: &str, args: OpWrite, r: BytesReader) -> Result<RpWrite>
Since v0.21, we will return a reply struct for different operations called RpWrite instead of an exact type. We can split OpenDAL's public API and raw API with this change.
Since v0.21, Accessor will return ObjectPager for List:
- async fn list(&self, path: &str, args: OpList) -> Result<ObjectStreamer>
+ async fn list(&self, path: &str, args: OpList) -> Result<(RpList, ObjectPager)>
And Object will return an ObjectLister which is built upon ObjectPage:
pub async fn list(&self) -> Result<ObjectLister> { ... }
ObjectLister can be used as an object stream as before. It also provides the function next_page to get the underlying pages directly:
impl ObjectLister {
pub async fn next_page(&mut self) -> Result<Option<Vec<Object>>>;
}
Since v0.21, we have categorized all APIs into public and raw.
Public APIs are exposed under opendal::Xxx; they are user-face APIs that are easy to use and understand.
Raw APIs are exposed under opendal::raw::Xxx; they are implementation details for underlying services and layers.
Please replace all usage of opendal::io_util::* and opendal::http_util::* to opendal::raw::* instead.
With this change, new users of OpenDAL maybe be it easier to get started.
Sorry for introducing too much breaking change in a single version. This version can be a solid version for preparing OpenDAL v1.0.
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.20.1...v0.21.0
Arc<dyn Accessor> (#1001)fix: Use std Duration as args instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/966
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.20.0...v0.20.1
v0.20 is a big release that we introduce a lot of performance related changes.
v0.20 is a big release that we introduce a lot of performance related changes.
To make the best of information from read operation, we propose and implemented RFC-0926: Object Reader. By this RFC, we can fetch content length from ObjectReader now!
pub struct ObjectReader {
inner: BytesReader
meta: ObjectMetadata,
}
impl ObjectReader {
pub fn content_length(&self) -> u64 {}
pub fn last_modified(&self) -> Option<OffsetDateTime> {}
pub fn etag(&self) -> Option<String> {}
}
To make this happen, we changed our Accessor API:
- async fn read(&self, path: &str, args: OpRead) -> Result<BytesReader> {}
+ async fn read(&self, path: &str, args: OpRead) -> Result<ObjectReader> {}
All layers should be updated to meet this change. Also, it's required to return content_length while building ObjectReader. Please make sure the returning ObjectMetadata is used correctly.
patch.crates-io from Cargo.toml by @messense in https://github.com/datafuselabs/opendal/pull/944Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.8...v0.20.0
Cargo.tomlrefactor: Remove deprecated features by @Xuanwo in https://github.com/datafuselabs/opendal/pull/920
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.7...v0.19.8
feat: Implement content type support for stat by @Xuanwo in https://github.com/datafuselabs/opendal/pull/891
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.6...v0.19.7
fix: Metrics blocking reader doesn't handle operation correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/887
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.5...v0.19.6
chore(deps): update redis requirement from 0.21 to 0.22 by @dependabot in https://github.com/datafuselabs/opendal/pull/876
content-type configuration by @ClSlaid in https://github.com/datafuselabs/opendal/pull/878Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.4...v0.19.5
content-type configuration (#878)refactor: replace md5 with md-5 by @PsiACE in https://github.com/datafuselabs/opendal/pull/862
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.3...v0.19.4
fix: Retry for wirte is not implemented correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/860
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.2...v0.19.3
feat(experiment): Allow user to config http connection pool by @Xuanwo in https://github.com/datafuselabs/opendal/pull/843
Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.1...v0.19.2
feat: Allow retry read and write by @Xuanwo in https://github.com/datafuselabs/opendal/pull/826
test_list_rich_dir by @ClSlaid in https://github.com/datafuselabs/opendal/pull/828Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.0...v0.19.1
test_list_rich_dir (#828)OpenDAL deprecate some features:
OpenDAL deprecate some features:
serde: We will enable it by default.layers-retry: We will enable retry support by default.layers-metadata-cache: We will enable it by default.Deprecated types like DirEntry has been removed.
true by @ClSlaid in https://github.com/datafuselabs/opendal/pull/818Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.2...v0.19.0
true (#818)One column per quarter.