opendal

Added

• feat: derive Deserialize/Serialize for ObjectMetaData (#420)
• RFC-0423: Command Line Interface (#423)
• feat: optimize range read (#425)
• feat(oli): Add basic layout for oli (#426)
• RFC-0429: Init From Iter (#429)
• feat: Implement RFC-0429 Init From Iter (#432)
• feat(oli): Add cp command layout (#428)

Docs

• docs: Update description of OpenDAL (#434)

Added

• RFC-0409: Accessor Capabilities (#409)
• feat: Implement RFC-0409 Accessor Capabilities (#411)
• RFC-0413: Presign (#413)
• feat: Implement presign support for s3 (#414)

Docs

• docs: Add new RFCs in list (#415)

Dependencies

• chore(deps): Update reqsign requirement from 0.1.1 to 0.2.0 (#412)

Added

• feat(object): Add ETag support (#381)
• feat: Convert retryable hyper errors into Interrupted (#396)

Changed

• build: Exclude docs from publish (#383)
• ci: Don't run CI on not needed push (#395)
• refactor: Use list for check instead of stat (#399)

Dependencies

• chore(deps): Update size requirement from 0.1.2 to 0.2.0 (#385)
• Upgrade dev-dependency size to 0.4 (#392)

Fixed

• fix: Special chars not handled correctly (#398)

Added

• feat: Implement http service support (#368)
• feat: Add http_header to handle HTTP header parse (#369)
• feat(services/s3): Add virtual host API style support (#374)

Changed

• refactor: Use the same http client across project (#364)
• refactor(services/{s3,azblob}): Make sure error response parsed correctly and safely (#375)

Docs

• docs: Add concepts for Accessor, Operator and Object (#354)
• docs: Aad docs for batch operations (#363)

Added

• RFC-0337: Dir Entry (#337)
• feat: Implement RFC-0337: Dir Entry (#342)
• feat: Add batch operation support (#346)

Changed

• refactor: Rename Metadata to ObjectMetadata for clarify (#339)

Others

• chore(deps): Bump actions/setup-python from 3 to 4 (#343)
• chore(deps): Bump amondnet/vercel-action from 20 to 25 (#344)

Fixed

• fix(services/s3,hdfs): List empty dir should not return itself (#327)
• fix(services/hdfs): Root path not cleaned correctly (#330)

Added

• feat(io_util): Improve debug logging for compress (#310)
• feat(services/s3): Add disable_credential_loader support (#317)
• feat: Allow check user input (#318)
• docs: Add services and features docs (#319)
• feat: Add name to object metadata (#304)
• fix(io_util/compress): Fix decoder's buf not all consumed (#323)

Changed

• chore(deps): Update metrics requirement from 0.18.1 to 0.19.0 (#314)
• docs: Update README to reflect current status (#321)
• refactor(object): Make Metadata::name() return &str (#322)

Fixed

• docs: Fix typo in examples (#320)
• fix(services): Don't throw error message for stat operation (#324)

Fixed

• publish: Fix git version not allowed (#306)
• fix(io_util/compress): Decompress read exit too early (#308)

Added

• feat: Add support for blocking decompress_read (#289)
• feat: Add check for operator (#290)
• docs: Use mdbook to generate documentation (#291)
• proposal: Object ID (#293)
• feat: Implement operator metadata support (#296)
• feat: Implement RFC-0293 Object ID (#298)

Changed

• chore(deps): Update quick-xml requirement from 0.22.0 to 0.23.0 (#286)
• feat(io_util): Refactor decompress decoder (#302)
• ci: Adopt amondnet/vercel-action (#303)

Fixed

• fix(services/aws): Increase retry times for AWS STS (#299)

Added

• ci: Add all issues into databend-storage project (#277)
• feat(services/s3): Add retry in load_credential (#281)
• feat(services): Allow endpoint has trailing slash (#282)
• feat(services): Attach more context in error messages (#283)

Fixed

• fix(azblob): Request URL not construct correctly (#270)

Added

• feat: Add hdfs scheme (#266)

Added

• docs: Improve docs to 100% coverage (#246)
• RFC-0247: Retryable Error (#247)
• feat: Implement retry layers (#249)
• feat: Implement retryable errors for azblob and s3 (#254)
• feat: Implement hdfs service support (#255)
• docs: Add docs for hdfs services (#262)

Changed

• docs: Make sure code examples are formatted (#251)
• chore(deps): Update uuid requirement from 0.8.2 to 1.0.0 (#252)
• refactor: Remove deprecated modules (#259)

Fixed

• ci: Fix docs build (#260)
• fix: HDFS jar not load (#261)

Changed

• chore: Build all features for docs.rs (#238)
• ci: Enable auto dependence upgrade (#239)
• chore(deps): Bump actions/checkout from 2 to 3 (#240)
• docs: Refactor examples (#241)

Fixed

• fix(services/s3): Endpoint without scheme should also supported (#242)

Added

• docs: Add behavior docs for create operation (#235)

Fixed

• fix(services/fs): Create on existing dir should succeed (#234)

Added

• feat: Improve error message (#220)
• RFC-0221: Create Dir (#221)
• feat: Simplify create API (#225)
• feat: Implement decompress read support (#227)
• ci: Enable behavior test for azblob (#229)
• docs: Add docs for azblob's public structs (#230)

Changed

• refactor: Move op.objects() to o.list() (#224)
• refactor: Improve behavior_tests so that cargo test works without --all-features (#231)

Fixed

• fix: Azblob should pass all behavior tests now (#228)

Added

• feat: Add seekable_reader on Object (#215)

Fixed

• fix: Object last_modified should carry timezone (#217)

Added

• feat: Export SeekableReader (#212)

Refer to Upgrade From v0.3 to v0.4 section for more upgrade details.

Added

• feat(services/azblob): Implement list support (#193)
• feat: Implement io_util like into_sink and into_stream (#197)
• docs: Add docs for all newly added public functions (#199)
• feat(io_util): Implement observer for sink and stream (#198)
• docs: Add docs for public types (#206)

Changed

• refactor: Make read return BytesStream instead (#192)
• RFC-0191: Async Streaming IO (#191)
• refactor: New public API design (#201)
• refactor: Adopt io::Result instead (#204)
• refactor: Rollback changes around async streaming io (#205)
• refactor: Refactor behavior tests with macro_rules (#207)

Fixed

• deps: Bump to reqsign to fix s3 url encode issue (#202)

Removed

• RFC-0203: Remove Credential (#203)

Added

• feat: Add azure blob support (#165)
• feat: Add tracing support via minitrace (#175)
• feat(service/s3): Implement server side encryption support (#182)

Changed

• chore: Level down some log entry to debug (#181)

Fixed

• fix(service/s3): Endpoint template should be applied if region exists (#180)

Added

• feat: Adopt quick_xml to parse xml (#164)
• test: Add behavior test for not exist object (#166)
• feat: Allow user input region (#168)

Changed

• feat: Improve error handle for s3 service (#169)
• feat: Read error response for better debugging (#170)
• examples: Improve examples for s3 (#171)

Added

• feat: Add content_md5 and last_modified in metadata (#158)

Changed

• refactor: Say goodbye to aws-s3-sdk (#152)

Added

• feat: Export BoxedObjectStream so that users can implement Layer (#147)

Fixed

• services/fs: Refactor via tokio::fs (#142)
• fix: Stat root should return a dir object (#143)

Added

• *: Implement logging support (#122)
• feat(service): Add service memory read support (#121)
• services: Add basic metrics (#127)
• services: Add full memory support (#134)

Changed

• benches: Refactor to support more read pattern (#126)
• services: Refactor into directories (#131)

Docs

• docs: Cover all public types and functions (#128)
• docs: Update README (#129)
• ci: Generate main docs to <opendal.apache.org> (#132)
• docs: Enrich README (#133)
• Add examples for object (#135)

Added

• RFC-112: Path Normalization (#112)
• examples: Add more examples for services and operations (#113)

Changed

• benches: Refactor to make code more readable (#104)
• object: Refactor ObjectMode into enum (#114)

Added

• services/s3: Implement anonymous read support (#97)
• bench: Add parallel_read bench (#100)
• services/s3: Add test for anonymous support (#99)

Added

• RFC and implementations for limited reader (#90)
• readers: Implement observe reader support (#92)

Changed

• deps: Bump s3 sdk to 0.8 (#87)
• bench: Improve logic (#89)

New RFCs

• limited_reader

Changed

• object: Polish API for Metadata (#80)

Added

• RFC and implementation of feature Object Stream (#69)
• services/s3: Implement List support (#76)
• credential: Add Plain variant to allow more input (#78)

Changed

• backend/s3: Change from lazy_static to once_cell (#62)
• backend/s3: Enable test on AWS S3 (#64)

Added

• docs: Add README for behavior test and ops benchmarks (#53)
• RFC-0057: Auto Region (#57)
• backend/s3: Implement RFC-57 Auto Region (#59)

Changed

• io: Rename BoxedAsyncRead to BoxedAsyncReader (#55)
• *: Refactor tests (#60)

Fixed

• io: Remove not used debug print (#48)

Added

• readers: Allow config prefetch size (#31)
• RFC-0041: Object Native API (#41)
• *: Implement RFC-0041 Object Native API (#35)
• RFC-0044: Error Handle (#44)
• error: Implement RFC-0044 Error Handle (#43)

Changed

• services/fs: Use separate dedicated thread pool instead (#42)

Added

• benches: Implement benches for ops (#26)

Changed

• services/s3: Don't load_from_env if users already inputs (#23)
• readers: Improve seekable performance (#25)

Added

• tests: Implement behavior tests (#13)
• services/s3: Add support for endpoints without scheme (#15)
• tests: Implement integration tests for s3 (#18)

Fixed

• services/s3: Allow set endpoint and region while input value is valid (#17)

Added

Hello, OpenDAL!