dvc

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• loader: don't forget to set meta.isdir (#8302) @efiop

Thanks again to @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• index: use tree obj if using inline files (#8301) @efiop
• try to split testsuites into two (#8297) @skshetry

🐛 Bug Fixes

• dvcfs: add fsspec-compliance tests (#8296) @skshetry

Thanks again to @efiop and @skshetry for the contributions! 🎉

What's Changed

• expose dvcfs in dvc.api and add to fsspec's registry by @skshetry in https://github.com/iterative/dvc/pull/8287
• import-url: pass fs_config down from imp_url to get_cloud_fs by @dtrifiro in https://github.com/iterative/dvc/pull/8286
• deps: remove unused mock dep by @dtrifiro in https://github.com/iterative/dvc/pull/8290
• dvcfs: default open to binary mode by @skshetry in https://github.com/iterative/dvc/pull/8295
• worktree push/fetch: support dirs by @pmrowla in https://github.com/iterative/dvc/pull/8273
• schema: add strict schema validation for top-level plots by @skshetry in https://github.com/iterative/dvc/pull/8289

Full Changelog: https://github.com/iterative/dvc/compare/2.25.0...2.26.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• dvc: cloud versioning POC (#8264) @efiop
• typo in setup config causing versioning errors in poetry (#8229) @jlhbaseball15
• tests: set celery ping_task_timeout 3x the default (#8221) @skshetry

🚀 New Features and Enhancements

• exp run: Support hydra basic sweeper. (#8187) @daavoo
• data ls: new command to show metadata with outputs (#8252) @skshetry
• dvcfs: remove config (#8276) @skshetry
• add metadata support to dvc.yaml (#8251) @skshetry
• Add support for custom metadata (#8250) @skshetry
• add metadata fields: label, type to data (#8232) @skshetry
• add support for foreach target (#8210) @skshetry
• output: support version ID (#8223) @pmrowla
• add support for git credentials helpers (#6586, scmrepo#138) @dtrifiro

🏇 Optimizations

• Optimise dvc ls -R (#8241) @rlamy

🐛 Bug Fixes

• dvc.yaml: preserve outputs' desc on rewrites/updates to the stage (#8247) @skshetry
• import: fix broken auth https://github.com/iterative/dvc/issues/7898

🔨 Maintenance

• build(deps-dev): Bump pylint from 2.15.0 to 2.15.2 (#8268) @dependabot
• build(deps): Bump scmrepo from 0.1.0 to 0.1.1 (#8269) @dependabot
• build(deps): Bump dvc-render from 0.0.9 to 0.0.10 (#8254) @dependabot
• build(deps): Bump dvc-data from 0.4.0 to 0.5.3 (#8237) @dependabot
• build(deps-dev): Bump pytest from 7.1.2 to 7.1.3 (#8239) @dependabot
• build(deps-dev): Bump dvc-azure from 2.20.0 to 2.20.2 (#8240) @dependabot
• deps: bump dvc-data to 0.7.1 (#8266) @efiop
• deps: bump dvc-data to 0.6.3 (#8257) @efiop
• deps: bump dvc-azure and dvc-s3 to 2.20.0 (#8224) @efiop

Thanks again to @daavoo, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @jlhbaseball15, @pmrowla, @rlamy and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-data to 0.4.0 by @efiop in https://github.com/iterative/dvc/pull/8219 and https://github.com/iterative/dvc/pull/8213

🚀 New Features and Enhancements

• exp run: Support composing and dumping Hydra config. by @daavoo in https://github.com/iterative/dvc/pull/8093

🐛 Bug Fixes

• data status: fix path for committed changes in Windows by @skshetry in https://github.com/iterative/dvc/pull/8220

Full Changelog: https://github.com/iterative/dvc/compare/2.23.0...2.24.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• output.get_obj: catch ObjectCorruptedError (#8212) @skshetry
• data status: fix quoting on command hints for untracked files (#8211) @skshetry
• fetch: do not checkout partial imports (#8205) @dtrifiro
• data status: update hints to include fetch and checkout (#8209) @dberenbaum
• test on 3.11 (#8196) @skshetry
• plots: support dirs in top level definitions (#8159) @pared
• repo: Handle no commits for exp show and plots diff. (#8177) @daavoo
• plots templates: change ui to not dump to file (#8129) @dberenbaum

🚀 New Features and Enhancements

• info: Include subprojects. (#8201) @daavoo
• data status: remove --withdirs, show unknowns in CLI (#8189) @skshetry
• api: Add details forparams_show stages syntax. (#8167) @daavoo
• Better error message when specifying file as target for remove (#8044) @alexmojaki

Thanks again to @alexmojaki, @daavoo, @dberenbaum, @dtrifiro, @pared, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-http and dvc-gs

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• pyinstaller: don't forget dvc_* plugins (#8197) @efiop

🔨 Maintenance

• build(deps): Bump dvc-data from 0.1.23 to 0.2.0 (#8190) @dependabot

Thanks again to @dependabot, @dependabot[bot] and @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• api: Fix params_show for untracked targets. (#8166) @daavoo

Thanks again to @daavoo for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• data status: make untracked files to be relative paths (#8184) @skshetry

🔨 Maintenance

• tests: mark exp queue func tests xfail (#8186) @pmrowla

Thanks again to @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-* plugins to 2.19.0 (#8183) @efiop
• data status: fix not-in-cache bugs (#8170) @skshetry
• data status: fix not-in-cache hint (#8181) @skshetry

🐛 Bug Fixes

• metrics: show: Fix show from subdir. (#8152) @daavoo

Thanks again to @daavoo, @efiop and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• pyinstaller: add fsspec hook

What's Changed

• build: skip install fpm and ruby on Windows by @skshetry in https://github.com/iterative/dvc/pull/8169
• import-url/update: add --no-download flag by @dtrifiro in https://github.com/iterative/dvc/pull/8024
• fs: optimize dvc list --recursive by @rlamy in https://github.com/iterative/dvc/pull/8150

New Contributors

• @rlamy made their first contribution in https://github.com/iterative/dvc/pull/8150

Full Changelog: https://github.com/iterative/dvc/compare/2.19.0...2.20.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-data to 0.1.21 (#8147) @skshetry
• doctor: ignore missing plugins (#8148) @efiop
• plots: show-vega: adjust renderers before show vega (#8114) @pared
• deps: bump dvc-data to 0.1.19 (#8140) @efiop
• fs: don't import SSHFileSystem (#8139) @efiop
• deps: bump dvc-data to 0.1.18 (#8138) @efiop

🔨 Maintenance

• ci: drop token, it's the default (#8157) @skshetry
• pyinstaller: Restrict to 5.0 (#8142) @daavoo

Thanks again to @daavoo, @efiop, @pared and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-http to 0.0.2 (#8136) @efiop
• gs: add endpointurl (#8133) @efiop
• deps: bump dvc-data to 0.1.16 (#8131) @efiop

Thanks again to @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-data (#8128) @efiop
• Guard rwlock file to prevent not locked repo edits (#8118) @shcheklein

🚀 New Features and Enhancements

• queue status: show final experiment name (#8104) @karajan1001
• exp run: Use hydra for parsing --set-param. (#8067) @daavoo

🐛 Bug Fixes

• exp run: account for repo root when staging git-deps (#8119) @pmrowla
• data status: handle path joining properly for tree leaves/items (#8107) @skshetry
• queue status: ERROR: Invalid experiment (#8099) @karajan1001
• fix logic for unlock on unlocked lock calls (#8105) @shcheklein

🔨 Maintenance

• exp run: ui tweak (#8124) @dberenbaum
• build(deps-dev): Bump filelock from 3.7.1 to 3.8.0 (#8125) @dependabot
• build(deps): Bump dvc-data from 0.1.13 to 0.1.14 (#8117) @dependabot
• Add flaky to a queue related test. (#8108) @karajan1001
• refactor: extract load_path function from common code using LOADERS (#7983) @alexmojaki
• stage add: fix hint message consistency (#8112) @shcheklein
• Lock test name fix (#8111) @shcheklein

Thanks again to @alexmojaki, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @efiop, @karajan1001, @pmrowla, @shcheklein and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• Upgrade from toml to tomlkit library (#7468) @syntapy
• output: resolve relative to stage.wdir only on the same fs (#8095) @efiop
• repo: support basic workflow on s3fs/adlfs/etc (#8091) @efiop
• Revert to lazy formatting introduced in #8073 (#8081) @ykasimov
• deps: bump dvc-data to 0.1.9 (#8084) @efiop
• datafs: use dvc-data's datafs (#8077) @efiop

🚀 New Features and Enhancements

• exp remove: support removing failed tasks and associated successful tasks (#8078) @karajan1001

🐛 Bug Fixes

• api: Fix params_show when stage has no params (#8069) @daavoo

🔨 Maintenance

• build(deps): Bump dvc-data from 0.1.12 to 0.1.13 (#8094) @dependabot
• build(deps): Bump dvc-data from 0.1.11 to 0.1.12 (#8092) @dependabot
• dvc-task: update to 0.1.2 (#8086) @pmrowla
• plots: remove legacy code from verify_metrics (#8073) @ykasimov

Thanks again to @daavoo, @dependabot, @dependabot[bot], @efiop, @karajan1001, @pmrowla, @syntapy, @ykasimov and Yury for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• cmd: plots: update messaging (#7972) @pared
• readme: add exps to quickstart (#8035) @dberenbaum
• plots: account for wdir in stage plots (#8004) @pared
• project: update dvc render and dvclive test dependencies (#8055) @pared
• exp run: workspace status wrong (#8054) @karajan1001
• cli/log: handle SIGPIPE errors (#8048) @skshetry

🚀 New Features and Enhancements

• queue: missing f format for the error message. (#8063) @karajan1001
• data status: add spinners during diff (#8050) @skshetry
• exp branch: update -h stdout (#8032) @jorgeorpinel

🏇 Optimizations

• data status: optimize printing status list (#8049) @skshetry

🐛 Bug Fixes

• build: add pyinstaller hooks for dvc-task and celery (#8075) @pmrowla
• Add GDrive remote profile field to config (#8060) @shcheklein
• queue: clean local EXEC_HEAD & EXEC_BASELINE after we use temp dir to run experiment. (#8043) @karajan1001

🔨 Maintenance

• build: add pyinstaller hooks for dvc-task and celery (#8075) @pmrowla

Thanks again to @daavoo, @dberenbaum, @jorgeorpinel, @karajan1001, @pared, @pmrowla, @pre-commit-ci[bot], @shcheklein and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• introduce new data:status command (#7943) @skshetry

Thanks again to @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• Update setup.cfg: typo in webhdfs_kerberos extras (#8017) @aguschin

🚀 New Features and Enhancements

• fs: gdrive: add gdrive_acknowledge_abuse (#8040) @efiop
• exp: init: Use persist: true if checkpoint. (#8000) @daavoo
• gc: Add support for --rev and --num. (#7971) @daavoo
• dvc queue: merge dev-task dev branch (#7976) @pmrowla
• Add --time to dvc gc and dvc exp gc (#7970) @karajan1001

🔨 Maintenance

• deps: bump dvc-data to 0.1.4 (#8039) @efiop
• build(deps): Bump pyinstaller from 5.0 to 5.2 (#7996) @dependabot
• build(deps-dev): Bump pylint from 2.14.4 to 2.14.5 (#8022) @dependabot
• build(deps-dev): bump mypy from 0.961 to 0.971 (#8028) @dependabot

Thanks again to @aguschin, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @efiop, @jorgeorpinel, @karajan1001, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-data, install dvc-data cli deps in dev mode (#7994) @skshetry
• deps: bump dvc-data to 0.0.20 (#7992) @efiop
• checkout: use dvcignore (#7963) @alexmojaki

🚀 New Features and Enhancements

• metrics: support TOML files (#7965) @alexmojaki

🔨 Maintenance

• build(deps-dev): Bump pytest-mock from 3.8.1 to 3.8.2 (#7982) @dependabot

Thanks again to @alexmojaki, @dependabot, @dependabot[bot], @efiop and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• api: params_show: Raise exception if no params found. (#7938) @daavoo
• parsing: Support dict unpacking in cmd. (#7907) @daavoo
• Help text for dvc update (#7958) @dberenbaum
• Initial support for flexible plots (#7477) @pared

🐛 Bug Fixes

• dvc: normalize targets before entering brancher (#7966) @efiop

🔨 Maintenance

• deps: bump dvc-data to 0.0.19 (#7979) @efiop
• build(deps): Bump dvc-data from 0.0.16 to 0.0.18 (#7968) @dependabot
• deps: remove setuptools_scm_git_archive (#7952) @skshetry

Thanks again to @alexmojaki, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @efiop, @pared, @pre-commit-ci, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-data to 0.0.16 (#7948) @skshetry
• setup: bump dvc-data (#7935) @efiop
• dvc: use dvc-data 0.0.8 (#7912) @efiop
• readme: mention vs code extension (#7859) @dberenbaum

🚀 New Features and Enhancements

• s3fs: Adds support for SSE client keys (#7671) @ap-kulkarni
• api: Add params_show. (#7613) @daavoo
• dvc plots: allow for setting output directory via config (#7911) @ykasimov
• api: open: Raise ValueError if rev is used in wrong mode. (#7823) @daavoo

🐛 Bug Fixes

• render: image_converter: Support slash in revision. (#7937) @daavoo
• exp apply: preserve untracked files (#7910) @pmrowla
• run-cache: http: restrict uploads/downloads (#7874) @skshetry
• run-cache: fix push from Windows to remote filesystems (#7873) @skshetry

🔨 Maintenance

• build(deps-dev): Bump pytest-mock from 3.7.0 to 3.8.1 (#7936) @dependabot
• build(deps-dev): Bump pylint from 2.14.3 to 2.14.4 (#7950) @dependabot
• build(deps): Bump styfle/cancel-workflow-action from 0.9.1 to 0.10.0 (#7941) @dependabot
• config: remove core.jobs dead code (#7908) @dberenbaum
• setup: bump dvc-data to 0.0.12 (#7928) @efiop
• readme: more VS Code Extension info. (#7916) @jorgeorpinel
• build(deps-dev): Bump pylint from 2.14.2 to 2.14.3 (#7921) @dependabot
• setup: bump dvc-data to 0.0.10 (#7919) @efiop
• readme: consolidate intro (#7906) @dberenbaum
• build(deps-dev): Bump pylint from 2.14.1 to 2.14.2 (#7902) @dependabot
• build(deps): Unpin networkx; quote node names for pydot output (#7899) @dependabot
• deps: bump dvc-data to 0.0.6; fix imports (#7895) @skshetry
• build(deps): Bump dvc-render from 0.0.5 to 0.0.6 (#7893) @dependabot
• [pre-commit.ci] pre-commit autoupdate (#7892) @pre-commit-ci
• build(deps-dev): Bump pylint from 2.13.9 to 2.14.1 (#7853) @dependabot
• build(deps-dev): Bump mypy from 0.942 to 0.961 (#7852) @dependabot
• build(deps-dev): Bump filelock from 3.7.0 to 3.7.1 (#7834) @dependabot
• build(deps): Bump actions/setup-python from 3 to 4 (#7870) @dependabot
• dvc: upgrade to dvc-data 0.0.5 (#7887) @efiop
• readme: remove donate requests (#7862) @dberenbaum

Thanks again to @ap-kulkarni, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @jorgeorpinel, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot], @skshetry, @ykasimov and Yury for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• scm: fix clone (#7674) @dtrifiro
• exp init: create output dirs (#7752) @dberenbaum
• checkout: --relink show helpful message on completion (#7709) @ykasimov
• setup: set upper bound on networkx (#7849) @efiop
• docs: update the package installation guide (#7839) @huang06
• setup: bump scmrepo to 0.0.24 (#7837) @efiop
• bump scmrepo to 0.0.23 (#7831) @dtrifiro
• Revert "dvc ls: not raise PathMissingError on empty dir." (#7728) @karajan1001
• dvcfile: preserve 'remote' on add and commit (#7618) @SamKnightGit
• plots: image converter return absolute paths (#7664) @pared

🚀 New Features and Enhancements

• exp: output troubleshooting link on shallow merge failure (#7791) @pmrowla
• exp: show: Include additional info in --json. (#7690) @daavoo
• exp list: fix git_remote metavar (#7808) @dberenbaum
• fs.callbacks: simplify, ensure None does not break them, lazy richcallbacks (#7722) @skshetry
• exp init: fixes #7534; simplifies/updates exp init --live (#7703) @dberenbaum
• run/repro/stage add: regroup options/flags (#7524) @jorgeorpinel

🏇 Optimizations

• plots: grouping: stop using dpath.util.search (#7811) @pared
• fs: path: use flavour.basename (#7764) @dtrifiro
• dvc.data: save and try loading raw dir objects (#7597) @dtrifiro
• repofs: only use dvcfs when --dvc-only is specified (#7659) @skshetry
• exp: speed up repro execution with untracked directories in workspace (#7786) @dtrifiro

🐛 Bug Fixes

• sshfs: bump min ver to 2022.6.0 (#7856) @pmrowla
• brancher: use scm.root_dir to determine relative cwd (#7845) @efiop
• plots: Pass templates_dir to match_renderers. (#7820) @daavoo
• dag: mermaid: Use quotation marks to escape node name. (#7803) @daavoo
• dvc.stage.cache: fix typo, was using src filesystem to transfer (#7739) @skshetry
• Catch correct exception class in params.show() (#7750) @Suor
• dag: fix dot file rendering order. (#7725) @tirkarthi
• Fail on sync when there is no match for glob. (#7687) @tirkarthi
• dvc ls: not raise PathMissingError on empty dir. (#7729) @karajan1001
• dvc ls: not raise PathMissingError on empty dir. (#6120) @karajan1001
• FileSystem: handle encoding via kwargs. (#7694) @daavoo

🔨 Maintenance

• build(deps): Bump pre-commit/action from 2.0.3 to 3.0.0 (#7846) @dependabot
• dvc: drop python 3.7 (#7826) @efiop
• fix linter issue (#7797) @skshetry
• build(deps): Bump dvc-data from 0.0.1 to 0.0.2 (#7796) @dependabot
• dvc.data: use own internal error instead of DvcException (#7772) @skshetry
• build(deps): Bump pyinstaller from 5.0 to 5.1 (#7769) @dependabot
• objects.fs: do not use format_link, DvcException and fix_env from DVC (#7766) @skshetry
• build(deps-dev): Bump pylint from 2.13.8 to 2.13.9 (#7746) @dependabot
• build(deps-dev): Bump filelock from 3.6.0 to 3.7.0 (#7745) @dependabot
• fs.callbacks: simplify, ensure None does not break them, lazy richcallbacks (#7722) @skshetry
• build(deps-dev): Bump pytest from 7.1.1 to 7.1.2 (#7621) @dependabot
• build(deps-dev): Bump pylint from 2.13.7 to 2.13.8 (#7677) @dependabot
• deps: bump s3fs to >=2022.02.0 (#7672) @skshetry

Thanks again to @SamKnightGit, @Suor, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @huang06, @jorgeorpinel, @karajan1001, @pared, @pmrowla, @pre-commit-ci[bot], @skshetry, @tirkarthi, @ykasimov, Samuel Knight and Yury for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• dag: Add --mermaid and --md option. (#7383) @daavoo
• stage/exp list: alias --names-only to --name-only (#7598) @skshetry
• Add log statement to collect repo (#7393) @Erotemic
• exp init: Replace live section with metrics and plots. (#7603) @daavoo

🐛 Bug Fixes

• exp pull/push: better result handling in exp sharing(#7448) (#7596) @karajan1001
• Raise informative missing s3 extra (#7501) @nsorros
• plots: json: show even if no results (#7550) @pared
• exp show: prefer exp names for experiments (#7572) @pmrowla
• completion: fix dvc exp completion on zsh/bash (#7595) @skshetry
• scm: fix progress bar, show progress and repo being cloned (#7632) @skshetry
• plots: Fix repo with removed plots (#7643) @daavoo
• fsspec wrapper: remove can handle dirs (#7604) @pared
• render.match: Skip errored revisions in get_files (#7606) @daavoo
• exp show: lockless behavior (#7574) @pmrowla
• hdfs: Fix _strip_protocol and _checksum (#7563) @daavoo
• parsing: use relative paths; force absolute paths to relative (#7579) @skshetry
• exp show: prefer exp names for experiments (#7572) @pmrowla
• erepo: include exp refs in clones (#7554) @pmrowla
• fs.gdrive: Fix GDRIVE_CREDENTIALS_DATA for service accounts (#7213) @RCdeWit

🔨 Maintenance

• dvclive: bump 0.7.3 (#7644) @daavoo
• live: Remove html generation. (#7514) @daavoo
• bump pydrive: improves and fixes thread safety (#7600) @shcheklein
• repofs: base on fsspec (#7581) @efiop
• build(deps): Bump pyinstaller from 4.10 to 5.0 (#7582) @dependabot
• build(deps): Bump scmrepo from 0.0.16 to 0.0.19 (#7559, #7596) @dependabot
• build(deps): Bump codecov/codecov-action from 2.1.0 to 3 (#7551) @dependabot

Thanks again to @Erotemic, @PythonFZ, @RCdeWit, @daavoo, @dependabot, @dependabot[bot], @efiop, @karajan1001, @nsorros, @pared, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot], @shcheklein, @skshetry, RCdeWit and Rob de Wit for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• exp show: pcp: Allow to --drop Experiment (#7536) @daavoo

🐛 Bug Fixes

• build: workaround pyinstaller inspect.getmodule issue (#7545) @pmrowla
• plots: image: fix image to_json structure (#7533) @pared

🔨 Maintenance

• build: workaround pyinstaller inspect.getmodule issue (#7545) @pmrowla
• dvcfs: base on fsspec (#7521) @efiop

Thanks again to @daavoo, @efiop, @jorgeorpinel, @pared, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• render: Extract to dvc_render (#7409) @daavoo
• s3: add aiobotocore as dependency explicitly (#7513) @skshetry
• fs.http: prevent hangs under some network conditions (#7460) @dtrifiro
• Revert "build: pin setuptools to <61" (#7504) @skshetry
• UI problem in dvc exp push (#7485) @karajan1001
• exp: remove mentions of resume (#7482) @dberenbaum
• exp show/pull/push/list: help text for -n (#7444) (#7450) @karajan1001
• exp remove: rename --all-commits flag add a new rev flag and unify the collection of revs (#7155) (#7275) @karajan1001
• fix: hooks install alongside pre-commit tool (#7443) @lcc
• diff: fix missing key bug (#6720) (#7406) @dberenbaum
• Fix dvc add -o issue #7357 (#7362) @eggqq007
• plots: json: add datapoints to vega plots (#7367) @pared

🚀 New Features and Enhancements

• ui: add revision info on dvc.yaml/dvc.lock/.dvc syntax and schema errors (#7517) @skshetry
• exp init: change ui prompts structure and output (#7497) @skshetry
• exp remove: show removed experiments #7449 (#7479) @karajan1001
• exp init: create params file by default (#7413) @skshetry
• params: allow tracking file (#7432) @skshetry
• exp push/pull: make all the flags in exp show and exp list support pull/push (#7154) (#7255) @karajan1001
• exp list: add the new flags (including -A/--all-commits) (#7153) (#7245) @karajan1001
• exp run: remove unsupported (repro only) arguments (#7441) @pmrowla
• exp init: refactor and simplify interactive mode (#7396) @skshetry

🐛 Bug Fixes

• deps: bump tqdm (#7503) @casperdcl
• odb: set fs_path to be "" (root) for webdav (#7488) @skshetry

🔨 Maintenance

• scmrepo: update to 0.0.16 (#7520) @pmrowla
• build(deps): Bump scmrepo from 0.0.13 to 0.0.14 (#7519) @dependabot
• build(deps-dev): Bump hdfs from 2.6.0 to 2.7.0 (#7516) @dependabot
• build(deps): Bump dvc-render from 0.0.3 to 0.0.4 (#7515) @dependabot
• build(deps-dev): Bump mypy from 0.931 to 0.942 (#7500) @dependabot
• build(deps-dev): Bump pytest from 6.2.5 to 7.1.1 (#7512) @dependabot
• build(deps-dev): Bump types-requests from 2.27.14 to 2.27.15 (#7507) @dependabot
• build(deps-dev): Bump types-requests from 2.27.13 to 2.27.14 (#7478) @dependabot
• build(deps): Bump actions/cache from 2.1.7 to 3 (#7483) @dependabot
• scmrepo: update to 0.0.13 (#7469) @pmrowla
• build(deps-dev): Bump types-tabulate from 0.8.5 to 0.8.6 (#7474) @dependabot
• build(deps-dev): Bump types-requests from 2.27.12 to 2.27.13 (#7473) @dependabot
• build(deps-dev): Bump google-cloud-storage from 2.2.0 to 2.2.1 (#7467) @dependabot
• build(deps-dev): Bump google-cloud-storage from 2.1.0 to 2.2.0 (#7464) @dependabot
• build(deps-dev): Bump types-requests from 2.27.11 to 2.27.12 (#7457) @dependabot
• build(deps-dev): Bump dvclive[image] from 0.5.1 to 0.6.0 (#7437) @dependabot
• build(deps): Bump pyinstaller from 4.9 to 4.10 (#7439) @dependabot
• build(deps): Bump scmrepo from 0.0.7 to 0.0.10 (#7440) @dependabot
• build(deps): Bump actions/checkout from 2.4.0 to 3 (#7431) @dependabot
• build(deps): Bump actions/setup-python from 2 to 3 (#7426) @dependabot
• build(deps-dev): Bump filelock from 3.5.1 to 3.6.0 (#7400) @dependabot
• build(deps-dev): Bump types-requests from 2.27.10 to 2.27.11 (#7416) @dependabot
• exp init: refactor and simplify interactive mode (#7396) @skshetry

Thanks again to @casperdcl, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @eggqq007, @karajan1001, @lcc, @pared, @pmrowla, @skshetry and Zhenyu Gao for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• exp init: create workspace structure by default, show workspace tree (#7331) @skshetry

🐛 Bug Fixes

• dvcfs: handle repo root (#7408) @efiop
• fix ignored job count (#7373) @dtrifiro

🔨 Maintenance

• build(deps-dev): Bump filelock from 3.4.2 to 3.5.1 (#7394) @dependabot

Thanks again to @dependabot, @dependabot[bot], @dtrifiro, @efiop and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

🚀 New Features and Enhancements

• plots: make templates generation explicit (#7108) @pared
• exp show: Include deps and outs. (#7089) @daavoo
• utils: add decorator to wrap diskcache pickle errors (#7300) @pmrowla
• exp init: handle exception properly on missing parameters file (#7277) @skshetry
• Fix 3 README links so that they render in GitHub (#7302) @discdiver
• exp show: Add --drop and --keep args (#7141) @daavoo
• repro/exp run: display stage name instead of filepath on failure (#7282) @skshetry
• plots: update linear template so colors can be externally overwritten (#7280) @mattseddon
• exp pull/push: add multi exp name arg support (#7206) @karajan1001
• exp run: support naive remote execution via --machine (#7173) @pmrowla
• exp show: add --rev flag (#7152) (#7204) @karajan1001
• rich-table: fix add_column args/kwargs (#7252) @skshetry
• Add config option plots.auto_open (#7159) @daavoo

🏇 Optimizations

• cli: improve startup speed (#7293) @skshetry

🐛 Bug Fixes

• exp show: show exp when checkpoint is running(#7329) (#7349) @karajan1001
• remove .dvcignore on destroy (#7360) @dtrifiro
• exp show: handle extending/renaming of metrics/params. (#7264) @daavoo
• Doc URL correction for GitAuthError (#7321) @tapadipti
• ignore: move debug statement to the proper location (#7311) @dtrifiro
• exp run: do not log message twice on workspace executor (#7306) @skshetry
• find_root: unify error message (#7283) @efiop
• plots: Fix --json requiring -o. (#7256) @daavoo
• rich-table: fix add_column args/kwargs (#7252) @skshetry
• fs: test_links: create destination directory first (#7239) @gh2o
• handle paths ending with sep in dvc.fs.path.Path.parts (#7234) @jonburdo
• ls: handle broken symlink (#7226) @pared
• odb: pin index pickle protocol version (#7222) @pmrowla
• Fix memory leak in Index.build_graph() (#7198) @Suor
• exp: raise InvalidExpRefError properly (#7218) @skshetry
• plots: dir: handle no data in cache/remote (#7163) @pared

🔨 Maintenance

• build(deps-dev): Bump types-requests from 2.27.9 to 2.27.10 (#7388) @dependabot
• build(deps-dev): Bump types-toml from 0.10.3 to 0.10.4 (#7368) @dependabot
• build(deps-dev): Bump dvclive[image] from 0.5.0 to 0.5.1 (#7365) @dependabot
• build(deps-dev): Bump types-requests from 2.27.8 to 2.27.9 (#7364) @dependabot
• tests: several tests migrated unittest to pytest (#7273) @nik123
• build(deps): Bump pyinstaller from 4.8 to 4.9 (#7351) @dependabot
• build(deps-dev): Bump pytest-mock from 3.6.1 to 3.7.0 (#7320) @dependabot
• build(deps-dev): Bump types-requests from 2.27.7 to 2.27.8 (#7327) @dependabot
• build(deps-dev): Bump dvclive[image] from 0.4.6 to 0.5.0 (#7328) @dependabot
• build(deps-dev): Bump google-cloud-storage from 2.0.0 to 2.1.0 (#7294) @dependabot
• Fix 3 README links so that they render in GitHub (#7302) @discdiver
• cli: refactor into a module (#7287) @skshetry
• build(deps-dev): Bump pytest-timeout from 2.0.2 to 2.1.0 (#7286) @dependabot
• build(deps-dev): Bump wsgidav from 3.1.1 to 4.0.1 (#7258) @dependabot
• build(deps-dev): Bump google-cloud-storage from 1.43.0 to 2.0.0 (#7262) @dependabot
• build(deps-dev): Bump types-requests from 2.27.5 to 2.27.7 (#7266) @dependabot
• build(deps): Bump pyinstaller from 4.7 to 4.8 (#7261) @dependabot
• exp show: add --rev flag (#7152) (#7204) @karajan1001
• build(deps-dev): Bump types-tabulate from 0.8.4 to 0.8.5 (#7251) @dependabot
• build(deps-dev): Bump types-toml from 0.10.1 to 0.10.3 (#7250) @dependabot
• build(deps-dev): Bump mypy from 0.930 to 0.931 (#7242) @dependabot
• build(deps-dev): Bump types-requests from 2.26.3 to 2.27.5 (#7249) @dependabot
• exp remove: refactor exp utils (#7205) @karajan1001
• build(deps-dev): Bump filelock from 3.4.0 to 3.4.2 (#7200) @dependabot
• build(deps-dev): Bump pylint-plugin-utils from 0.6 to 0.7 (#7210) @dependabot
• build(deps-dev): Bump types-tabulate from 0.8.3 to 0.8.4 (#7208) @dependabot
• build(deps-dev): Bump pygments from 2.10.0 to 2.11.1 (#7217) @dependabot
• build(deps-dev): Bump types-requests from 2.26.2 to 2.26.3 (#7209) @dependabot
• build(deps-dev): Bump mypy from 0.921 to 0.930 (#7192) @dependabot
• build(deps-dev): Bump wheel from 0.37.0 to 0.37.1 (#7193) @dependabot

Thanks again to @Suor, @amritghimire, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @discdiver, @dtrifiro, @efiop, @gh2o, @jonburdo, @karajan1001, @mattseddon, @nik123, @pared, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot], @skshetry, @tapadipti and Daniele Trifirò for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• diff: use relpaths (#7158) @efiop
• fs.hdfs: skip port if not available (#7189) @skshetry
• fs: repo: raise proper FileNotFoundError in metadata (#7156) @pared

🚀 New Features and Enhancements

• exp show: Add parallel coordinates plot. (#6933) @daavoo
• exp show: Alternate row background color (#7142) @daavoo

🔨 Maintenance

• deps: remove requests-kerberos from webdhfs; provide it via webdhfs_kerberos. (#7178) @skshetry
• build(deps): Bump scmrepo from 0.0.4 to 0.0.7 (#7150, #7187) @dependabot
• deps: explicitly specify pyarrow for hdfs (#7179) @skshetry
• build(deps-dev): Bump mypy from 0.920 to 0.921 (#7185) @dependabot
• build(deps-dev): Bump types-requests from 2.26.1 to 2.26.2 (#7170) @dependabot
• build(deps-dev): Bump mypy from 0.910 to 0.920 (#7162) @dependabot
• build(deps-dev): Bump pytest-timeout from 2.0.1 to 2.0.2 (#7144) @dependabot
• build(deps-dev): Bump pytest-xdist from 2.4.0 to 2.5.0 (#7132) @dependabot

Thanks again to @daavoo, @dependabot, @dependabot[bot], @efiop, @karajan1001, @pared, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🔨 Maintenance

• setup: bump gcsfs (#7117) @pared
• install: fix archives (#7125) @pared
• build(deps-dev): Bump dvclive[image] from 0.4.5 to 0.4.6 (#7112) @dependabot
• build(deps): Bump scmrepo from 0.0.3 to 0.0.4 (#7113) @dependabot

Thanks again to @dependabot, @dependabot[bot], @efiop and @pared for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• webdav: fix unstrip_protocol

Refer to https://dvc.org/doc/install for installation instructions.

Changes

💣 Breaking Changes

• exp diff: Remove --old option. (#6888) @daavoo

🚀 New Features and Enhancements

• introduces exp init command @skshetry
• render: image: make html less ugly (#7075) @pared
• plots: collect: provide callable for data resolution (#6832) @pared
• live: Call webbrowser.open (#6913) @daavoo
• scm: hint to autostage (#6985) @dberenbaum
• exp show: Add --only-changed option (#6867) @daavoo

🐛 Bug Fixes

• exp: respect repo hardlink_lock config for the exp scm lock (#7030) @kwon-young
• dulwich: fallback to default SSH keys in asyncssh vendor (#6983) @pmrowla
• plots: special chars handling for vega plots paths (#6900) @pared
• params: Use ast.literal_eval for python params. (#6954) @daavoo
• push: fix http storage ignoring method setting (#6981) @ditod
• hardlink: fallback to other link methods if "Function not implemented" is raised (#6963) @skshetry
• argparse: dont override cmd (#6958) @pared

🔨 Maintenance

• build(deps): Bump scmrepo from 0.0.1 to 0.0.2 (#7055) @dependabot
• packages: build binary pkgs with Python 3.9 (#7016) @skshetry
• dvc.scm: refactor exceptions (#7017) @skshetry
• build(deps): Bump adlfs from 2021.9.1 to 2021.10.0 (#6734) @dependabot
• build: bump sshfs from 2021.8.1 to 2021.11.2 (#6999) @guludo
• build: bump pyinstaller from 4.6 to 4.7 (#6960) @dependabot
• dvc: get rid of path_info (#6946) @efiop

Thanks again to @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @ditod, @efiop, @guludo, @isidentical, @karajan1001, @kwon-young, @pared, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot], @skshetry and Dimitar Todorov for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• machine status: include two new field in the output (#6869) @karajan1001
• exp init: ask for command before paths (#6872) @skshetry
• LiveTask: write output path at start/end (#6815) @daavoo
• transfer: preserve workspace data (#6860) @efiop
• exp run: add experiment name check. (#6848) @karajan1001
• fs: transfer: try reflink (#6853) @efiop

🏇 Optimizations

• output: save: remove redundant changed() call (#6887) @efiop
• fs: transfer: try reflink (#6853) @efiop

🐛 Bug Fixes

• webhdfs: expose kerberos and https options (#6936) @gudmundur-heimisson
• plots: fix resolve template path bug (#6866) @pared
• plots: Use URI for --open. (#6845) @daavoo
• transfer: preserve workspace data (#6860) @efiop

🔨 Maintenance

• build(deps-dev): bump gcsfs from 2021.10.1 to 2021.11.0 (#6938) @dependabot
• deps: bump rich to >=10.13.0 (#6937) @skshetry
• build(deps): bump actions/checkout from 2.3.5 to 2.4.0 (#6921) @dependabot
• build: remove numpy restriction (#6906) @skshetry
• build(deps): bump pyinstaller from 4.5.1 to 4.6 (#6897) @dependabot
• dependencies: remove python 3.10 restriction for pyarrow (#6901) @skshetry
• build(deps): update pyparsing requirement from ==2.4.7 to >=2.4.7 (#6858) @dependabot

Thanks again to @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @efiop, @gudmundur-heimisson, @karajan1001, @pared, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• git: use asyncssh as dulwich SSH vendor (#6797) @pmrowla
• Dependabot/pip/pylint 2.11.1 (#6843) @karajan1001
• Revert "build(deps): Bump pylint from 2.9.6 to 2.11.1" (#6842) @karajan1001
• dvc machine: add a new command rename to it (#6633) @karajan1001
• Exp show md (#6799) @daavoo
• machine: Add a new command dvc machine status (#6649) @karajan1001
• exp/metrics/params diff: Replaced Old/New with a_rev/b_rev (#6814) @daavoo
• [pre-commit.ci] pre-commit autoupdate (#6829) @pre-commit-ci
• Added test_show_experiments_sort_by (#6798) @daavoo

🚀 New Features and Enhancements

• exp run: throw error if new parameters are added by --set-param (#6521) @mattlbeck
• plots: make generator out of collect (#6793) @pared
• plots: load templates from package (#6550) @pared

🐛 Bug Fixes

• dvcfs: handle new workspace subdirectories in walk (#6811) @eggqq007
• ui: write_json: don't forget json kwargs (#6810) @efiop
• dvc: add 'repos' list to pre-commit config if it does not exist (#6795) @mjlbach

🔨 Maintenance

• build(deps): Bump pylint from 2.9.6 to 2.11.1 (#6636) @dependabot
• move some configs to pyproject.toml (#6834) @skshetry
• setup: bump fsspec deps to 2021.10.1 (#6828) @efiop
• Revert "webdav: limit httpx to fix the CI" (#6827) @skshetry
• build(deps-dev): Bump filelock from 3.3.0 to 3.3.1 (#6825) @dependabot
• build(deps-dev): Bump types-requests from 2.25.9 to 2.25.11 (#6820) @dependabot
• build(deps): Bump actions/checkout from 2.3.4 to 2.3.5 (#6817) @dependabot
• build(deps-dev): Bump types-tabulate from 0.8.2 to 0.8.3 (#6790) @dependabot
• build(deps-dev): Bump types-toml from 0.10.0 to 0.10.1 (#6821) @dependabot
• build(deps-dev): Bump dvclive from 0.4.0 to 0.4.1 (#6786) @dependabot
• build(deps): Update flufl-lock requirement from <4,>=3.2 to >=5 (#6576) @dependabot
• pathspec 0.9.0 quickfix (#6689) @endremborza
• webdav: limit httpx to fix the CI (#6800) @isidentical
• dvc: drop 3.6 support (#6792) @efiop
• use setuptools_scm and build_requires (#6775) @skshetry

Thanks again to @daavoo, @dependabot, @dependabot[bot], @efiop, @eggqq007, @endremborza, @isidentical, @karajan1001, @mattlbeck, @mjlbach, @pared, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Maintenance

• setup.cfg: use text/x-rst instead of text/rst

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• Force sorted order in plots rendering (#6601) @daavoo

🐛 Bug Fixes

• gdrive: strip bucket (#6618) @skshetry
• ssh: ask password before setting it (#6615) @isidentical
• dvc cli: fixed error in 'dvc config --list' in non repo dir (#6587) @ap-kulkarni
• output: use remote kwarg instead of odb (#6600) @efiop

🔨 Maintenance

• build(deps): Bump codecov/codecov-action from 2.0.3 to 2.1.0 (#6606) @dependabot
• build(deps): Bump mock-ssh-server from 0.9.0 to 0.9.1 (#6607) @dependabot

Thanks again to @ap-kulkarni, @daavoo, @dependabot, @dependabot[bot], @efiop, @isidentical, @karajan1001, @nik123, @pared and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• Added GitAuthError (#6493) @daavoo
• diff: don't forget to use dvcignore and state (#6595) @efiop
• project: formalize extra dependencies (#6560) @isidentical

🏇 Optimizations

• diff: don't forget to use dvcignore and state (#6595) @efiop

🐛 Bug Fixes

• ssh: support passphrases for private keys (#6566) @isidentical

🔨 Maintenance

• build(deps): Bump adlfs from 2021.8.2 to 2021.9.1 (#6597) @dependabot
• objects.transfer: minor refactoring, move lazier taskset inside custom executor (#6591) @skshetry
• build(deps): Bump grandalf from 0.6 to 0.7 (#6575) @dependabot
• build(deps): Bump hdfs from 2.5.8 to 2.6.0 (#6577) @dependabot
• build(deps): Bump google-cloud-storage from 1.42.0 to 1.42.1 (#6568) @dependabot
• project: formalize extra dependencies (#6560) @isidentical

Thanks again to @daavoo, @dependabot, @dependabot[bot], @efiop, @isidentical, @pared and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• Show csv format of experiments (#6468) @karajan1001

🐛 Bug Fixes

• http: pass prepared filesystem arguments (#6565) @isidentical

🔨 Maintenance

• remove tpi.base dependency (#6554) @casperdcl
• bump webdav4 to 0.9.1 (#6557) @skshetry

Thanks again to @casperdcl, @efiop, @isidentical, @karajan1001 and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• http: migrate to fsspec & aiohttp (#6525) @isidentical

Thanks again to @efiop, @isidentical, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• Remove all of the experiments in the workspace (#6394) @karajan1001

🐛 Bug Fixes

• exp run: pass recursive args to checkout (#6458) @skshetry

🔨 Maintenance

• ruamel.yaml: adjust to new DuplicatedKeyError (#6464) @pared

Thanks again to @efiop, @karajan1001, @pared and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• analytics: introduce DVC_NO_ANALYTICS (#6453) @efiop
• Update dvc exp branch help (#6439) @daavoo

Thanks again to @daavoo, @efiop and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• fetched: correctly order mixed odbs (#6436) @isidentical

Thanks again to @efiop and @isidentical for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• Change ui message for the updater (#6437) @skshetry
• plots: upgrade to latest Vega library versions (#6371) @arjvik
• updater: only notify in dvc doctor (#6247) @efiop

🐛 Bug Fixes

• fs: find(..., detail=True) now casts values properly (#6432) @isidentical

🔨 Maintenance

• add support for Python 3.10 (#6422) @skshetry

Thanks again to @arjvik, @dependabot, @dependabot[bot], @efiop, @isidentical and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

🚀 New Features and Enhancements

• Remove a special queued experiments (#6393) @karajan1001
• Push running checkpoint to remote (#6332) @karajan1001
• cleanup index, and add test for used_objs (#6390) @skshetry
• Show name of experiments in the queue (#6382) @karajan1001
• fs: get_fs_config: raise RemoteNotFoundError (#6375) @efiop
• ssh: migrate to sshfs (#6295) @isidentical
• remote: add excludes for AzureDefaultCredentials (#6359) @meierale
• plots: cleanup data extraction (#6355) @pared
• setup: bump flatten-dict to 0.4.1 (#6357) @isidentical
• fsspec: implement callback mixins (#6322) @isidentical
• do not print in style by default for errors (#6344) @skshetry
• plots/metrics/params/experiments show: stop throwing exceptions (#5984) @pared
• oss: migrate to ossfs (#6307) @karajan1001
• azure: support directory imports with azure (#6245) @isidentical
• exp show: display running/queued state for experiments (#6174) @pmrowla
• add: ignore duplicated targets? (#6286) @skshetry

🏇 Optimizations

• repofs: use underlying fs.download to download files (#6401) @efiop
• ssh: migrate to sshfs (#6295) @isidentical
• odb: use regular upload() when the source filesystem is local (#6365) @isidentical
• output: cache loaded tree objects (#6301) @efiop
• fsspec: use rm_file() (#6358) @isidentical
• setup: bump flatten-dict to 0.4.1 (#6357) @isidentical

🐛 Bug Fixes

• Fix issue while sending analytics report (#6407) @skshetry
• pygit: account for locked dirs on windows during checkout (#6408) @pmrowla
• More granular read-write lock requests in the run() and reproduce() methods of the Stage class (#5815) @maximerischard
• benedict: cleanup code and add tests (#6380) @skshetry
• ssh: handle concurrency issues for raw command execution (#6370) @isidentical
• do not print in style by default for errors (#6344) @skshetry
• objects: fix gdrive CI issue (#6338) @pmrowla
• import-url: use the same chunk size for istextblock() calls (#6303) @isidentical
• plots/metrics/params/experiments show: stop throwing exceptions (#5984) @pared
• import-url: compute the stage hash in --to-remote (#6175) @isidentical
• fs: repo: handle directories with multiple artifacts (#6278) @efiop

🔨 Maintenance

• build(deps): bump google-cloud-storage from 1.41.1 to 1.42.0 (#6415) @dependabot
• build(deps): bump jaraco-windows from 5.5.0 to 5.6.0 (#6396) @dependabot
• gdrive: migrate to pydrive2.fs (#6399) @isidentical
• build(deps): bump wheel from 0.36.2 to 0.37.0 (#6404) @dependabot
• introduce index (#6300) @skshetry
• Unittest to pytest: moved few unittest tests to pytest (#6379) @nik123
• objects: use object IDs and references instead of naive objs in status/transfer (#6360) @pmrowla
• build(deps): bump pylint from 2.8.3 to 2.9.6 (#6369) @dependabot
• Fix merging of params when empty (#6378) @skshetry
• setup: relax aiobotocore requirements (#6367) @efiop
• build(deps): bump codecov/codecov-action from 2.0.1 to 2.0.2 (#6361) @dependabot
• setup: bump flatten-dict to 0.4.1 (#6357) @isidentical
• build(deps): bump google-cloud-storage from 1.41.0 to 1.41.1 (#6341) @dependabot
• update webdav4 to latest fsspec version (#6343) @skshetry
• build(deps): bump codecov/codecov-action from 1.5.2 to 2.0.1 (#6334) @dependabot
• objects: migrate remote push/pull to objects.transfer (#6308) @pmrowla
• setup: upgrade adlfs to 2021.7.1 (#6337) @isidentical
• build(deps): bump google-cloud-storage from 1.40.0 to 1.41.0 (#6311) @dependabot
• setup: pathspec <0.9.0 (#6331) @efiop
• azure: move to default fsspec loop (#6323) @isidentical
• setup: bump ossfs==2021.7.5 (#6326) @isidentical
• setup: upgrade fsspec/s3fs/gcsfs to 2021.7.0 (#6317) @isidentical
• fsspec: create directories on upload/upload_fobj (#6309) @isidentical
• build(deps): bump wsgidav from 3.1.0 to 3.1.1 (#6302) @dependabot
• objects: use separate staging ODB for staging trees (#6195) @pmrowla

Thanks again to @Sayanta66, @cclauss, @dependabot, @dependabot[bot], @efiop, @isidentical, @karajan1001, @maximerischard, @meierale, @nik123, @pared, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• setup: relax requirements for importlib-metadata

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• pkg: don't build universal wheels (#6299) @efiop

🔨 Maintenance

• pkg: don't build universal wheels (#6299) @efiop

Thanks again to @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• fs: s3: don't forget to pass verify option (#6298) @kareemjano

Thanks again to @efiop and @kareemjano for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• Fix #6205: Fixed diff summary to only show states with values. (#6229) @hadasarik
• add: reduce os.fspath calls on recursive add (#6287) @skshetry
• add: fix progress bar on single target (#6288) @skshetry
• ui: Prevent tqdm from breaking on output (#6280) @skshetry
• cleaning up add, progress bars and status (#6224) @skshetry

🏇 Optimizations

• staging: optimize the number of info() calls (#6281) @isidentical
• objects: hash_file: retrieve size from hash_info (#6284) @isidentical

🐛 Bug Fixes

• ui: Prevent tqdm from breaking on output (#6280) @skshetry

🔨 Maintenance

• Fix typos discovered by codespell (#6294) @cclauss
• add: reduce os.fspath calls on recursive add (#6287) @skshetry
• cleaning up add, progress bars and status (#6224) @skshetry

Thanks again to @cclauss, @efiop, @hadasarik, @isidentical and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• add: do not delete stage files before add (#6239) @skshetry
• separate validation and transformation of args from the add func (#6220) @skshetry
• import: error message when imported file does not exist (#6240) @mmeendez8

🏇 Optimizations

• add: do not delete stage files before add (#6239) @skshetry

🐛 Bug Fixes

• ssh: don't use path_info for connections (#6259) @efiop
• output: optimize obj collection (#6277) @efiop
• pygit: handle annotated tags in resolve_refish (#6274) @pmrowla
• fsspec: loosen the prefix check to cover both None and False (#6246) @isidentical
• push params in the experiments table to the right (#6254) @skshetry

🔨 Maintenance

• separate validation and transformation of args from the add func (#6220) @skshetry
• build(deps): bump google-cloud-storage from 1.39.0 to 1.40.0 (#6261) @dependabot

Thanks again to @dependabot, @dependabot[bot], @efiop, @isidentical, @kurianbenoy, @mmeendez8, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• [pre-commit.ci] pre-commit autoupdate (#6243) @pre-commit-ci
• Loosen versions for fsspec and pygtrie (#6242) @Erotemic

🐛 Bug Fixes

• git: Keep trailing slash when checking if directory is gitignored (#6232) @tpietruszka

Thanks again to @Erotemic, @efiop, @pre-commit-ci, @pre-commit-ci[bot] and @tpietruszka for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🏇 Optimizations

• obj: staging: remove redundant exists() call (#6217) @efiop

🐛 Bug Fixes

• output: don't lower the etag field on the schema when deserializing (#6238) @isidentical
• utils: normalize case in path_isin functions (#6236) @pmrowla

🔨 Maintenance

• build(deps): bump crc32c from 2.2 to 2.2.post0 (#6234) @dependabot
• build(deps): bump urllib3 from 1.26.5 to 1.26.6 (#6235) @dependabot
• setup: update fsspec to 2021.6.1 (#6219) @efiop
• build(deps): bump mypy from 0.902 to 0.910 (#6212) @dependabot
• build(deps): bump google-cloud-storage from 1.38.0 to 1.39.0 (#6211) @dependabot

Thanks again to @dependabot, @dependabot[bot], @efiop, @isidentical and @pmrowla for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• Bump fsspec version (#6214) @skshetry
• Create CODEOWNERS (#6213) @skshetry

Thanks again to @efiop and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• config, remote: Made S3 CA bundle customizable (#6018) @rgvanwesep
• fs: don't automatically create buckets (#6086) @efiop
• azure: better error messages / allow_anonymous_login option (#5833) @isidentical

🐛 Bug Fixes

• fs: temporarily disable prefix-based search for fsspec-implementations (#6096) @isidentical

🔨 Maintenance

• build(deps): bump pytest-cov from 2.12.0 to 2.12.1 (#6095) @dependabot
• pin networkx to 2.5 (#6085) @skshetry

Thanks again to @dependabot, @dependabot[bot], @efiop, @isidentical, @rgvanwesep and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• respect $PAGER env vars, make -FRSX default in less (#5906) @skshetry
• commit,completion: Add stages completion for dvc commit (#5963) @ciaochiaociao

🏇 Optimizations

• git: update dulwich to 0.20.22 (#6049) @pmrowla

🐛 Bug Fixes

• fix empty string parsing for the command (#6074) @skshetry
• git: update dulwich to 0.20.22 (#6049) @pmrowla
• dvcfs: open: raise FileNotFoundError on missing version info (#6017) @efiop
• azure: use selector event loop for windows (#5983) @isidentical
• plots: handle NoRemoteError for dirs (#5976) @efiop
• s3: respect credentialpath/configpath (#5973) @isidentical
• azure: use a custom event loop for authentication (#5958) @isidentical
• move: validate new stage before move (#5953) @pmrowla
• dvcfile/stage: check if dvcfile would be gitignored on stage creation (#5907) @pmrowla

🔨 Maintenance

• fix errors raised by pylint (#6081) @skshetry
• build(deps): bump actions/cache from 2.1.5 to 2.1.6 (#6073) @dependabot
• build(deps): bump urllib3 from 1.26.4 to 1.26.5 (#6069) @dependabot
• setup: bump fsspec/s3fs/gcsfs to 2021.5.0 (#6056) @isidentical
• build(deps): bump pydocstyle from 6.0.0 to 6.1.1 (#6027) @dependabot
• build(deps): bump pytest-cov from 2.11.1 to 2.12.0 (#6022) @dependabot
• build(deps): bump rtCamp/action-slack-notify from 2 to 2.1.3 (#5993) @dependabot
• build(deps): bump actions/setup-ruby from 1 to 1.1.3 (#5994) @dependabot
• Decoupling dvcignore and fs (#5812) @karajan1001
• setup: freeze aiobotocore/botocore/boto3 versions (#5987) @isidentical
• build(deps): bump pytest-mock from 3.6.0 to 3.6.1 (#5981) @dependabot
• run gdrive tests in a single job, run all on schedule (#5974) @skshetry
• build(deps): bump pytest from 6.2.3 to 6.2.4 (#5968) @dependabot
• s3: fsspec migration (#5683) @isidentical
• build(deps): bump moto from 2.0.5 to 2.0.6 (#5955) @dependabot
• build(deps): bump pygments from 2.8.1 to 2.9.0 (#5956) @dependabot
• build(deps): bump codecov/codecov-action from v1.4.1 to v1.5.0 (#5957) @dependabot
• tests: mark test_stash_pop as xfail on linux (#5952) @skshetry

Thanks again to @ciaochiaociao, @dependabot, @dependabot[bot], @dmpetrov, @efiop, @isidentical, @karajan1001, @pmrowla, @shcheklein and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• exp run: error out when trying to resume from intermediate checkpoint w/no modifications (#5829) @pmrowla
• exp show: separate ui representation of exp names and identifiers (#5885) @skshetry
• diff: use ui.table for --show-md (#5887) @skshetry
• refactor exp show: use new abstractions (#5880) @skshetry
• refactor diff and show to use new table ui and new data structure (#5872) @skshetry
• Add full stops in CLI help (#5867) @jankrepl
• exp run: dvc commit DVC-tracked data deps when stashing an experiment (#5859) @pmrowla
• html: enable providing custom html page templates (#5694) @pared
• exp: use exp baseline for DVC commands that compare to HEAD during exp run (#5818) @pmrowla
• Add support for kerberos token based auth (#5809) @naveen24691
• dvc: add -A flag for * --all-commits (#5783) @jorgeorpinel
• exp run: disallow --rev for workspace runs (#5831) @pmrowla
• exp run: suppress "finished run" output on --dry (#5830) @pmrowla
• list: add --show-json option (#5888) @pared

🏇 Optimizations

• fs: introduce fs.find() (#5879) @isidentical
• objects: don't recompute hash on odb.add() if verify is False (#5860) @isidentical
• update: only update the missing hashes with --to-remote (#5773) @isidentical

🐛 Bug Fixes

• pygit: force release of odb contexts after checkout/merge (#5849) @pmrowla
• output: relative paths outside of repo (#5893) @efiop
• metrics: pass --precision to _show_metrics (#5839) @isidentical

🔨 Maintenance

• dependabot: use "maintenance" label (#5898) @efiop
• fs: introduce fs.find() (#5879) @isidentical
• exp show: separate ui representation of exp names and identifiers (#5885) @skshetry
• build(deps): bump google-cloud-storage from 1.37.1 to 1.38.0 (#5883) @dependabot
• build(deps): bump pylint from 2.8.1 to 2.8.2 (#5884) @dependabot
• dagascii: remove unused pager (#5876) @skshetry
• build(deps): bump pre-commit/action from v2.0.2 to v2.0.3 (#5856) @dependabot
• build(deps): bump pylint-pytest from 1.0.3 to 1.1.2 (#5850) @dependabot
• build(deps): bump pytest-mock from 3.5.1 to 3.6.0 (#5874) @dependabot
• build(deps): bump pylint from 2.7.4 to 2.8.1 (#5873) @dependabot
• output: introduce BaseOutput.transfer (#5861) @isidentical
• build(deps): bump codecov/codecov-action from v1.3.2 to v1.4.0 (#5838) @dependabot
• build(deps): bump codecov/codecov-action from v1.4.0 to v1.4.1 (#5857) @dependabot

Thanks again to @bhagone, @dependabot, @dependabot[bot], @efiop, @isidentical, @jankrepl, @jorgeorpinel, @naveen24691, @pared, @pmrowla and @skshetry for the contributions! 🎉