PyPI · #2892 most downloaded on PyPI

dvc

3.67.12.6M downloads/motreeverse/dvc ↗New releases in your daily digest, changelog included.

Git for data scientists - manage your code and data together

Last release 6 months ago
31 Mar 2026
Ships fairly regularly
a new release about every 4 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
9 years old
555 releases · first in 2017

Release timeline

555 releases since 2017

2017201920212023

Releases

3.2.022 Jun 2023



What's Changed

🚀 New Features and Enhancements

checkout: friendlier UI when trying to remove uncached files by @efiop in https://github.com/iterative/dvc/pull/9635

Exp push/pull: update default to push/pull all from head rev by @dberenbaum in https://github.com/iterative/dvc/pull/9631

exp: push/pull --rev help text shows default val by @dberenbaum in https://github.com/iterative/dvc/pull/9636

🐛 Bug Fixes

output: preserve legacy hash_name on save() for unchanged data by @pmrowla in https://github.com/iterative/dvc/pull/9643

exp list: fix ui for tags/branches by @dberenbaum in https://github.com/iterative/dvc/pull/9620

checkout: delete output if we can't create it fully by @efiop in https://github.com/iterative/dvc/pull/9642

output: check legacy hash name in output.add() by @pmrowla in https://github.com/iterative/dvc/pull/9646

🔨 Maintenance

deps: bump scmrepo minver to 1.0.4 by @pmrowla in https://github.com/iterative/dvc/pull/9648

deps: bump dvc-data to >= 2.1.0 by @efiop in https://github.com/iterative/dvc/pull/9634

output: remove: catch FileNotFoundError by @dberenbaum in https://github.com/iterative/dvc/pull/9574

Other Changes

Revert "drop stage-level vars" by @skshetry in https://github.com/iterative/dvc/pull/9647

Bring back checkpoint to schema by @daavoo in https://github.com/iterative/dvc/pull/9649

Full Changelog: https://github.com/iterative/dvc/compare/3.1.0...3.2.0
Open source →

One column per quarter.

What's Changed

🚀 New Features and Enhancements

checkout/fetch: finer control over steps by @efiop in https://github.com/iterative/dvc/pull/9601
api: add config support for open/read by @efiop in https://github.com/iterative/dvc/pull/9611
api: show/exp: add config option by @efiop in https://github.com/iterative/dvc/pull/9617

🐛 Bug Fixes

diff: handle revisions pointing to the same sha by @efiop in https://github.com/iterative/dvc/pull/9605
outputs: is_in_repo: don't try to realpath fs_path by @efiop in https://github.com/iterative/dvc/pull/9626
exp show: quick fix for handling defaultdict in py<3.11.0 by @dberenbaum in https://github.com/iterative/dvc/pull/9619

Other Changes

benchmarks: update tests for dvc 3.x by @pmrowla in https://github.com/iterative/dvc/pull/9608
benchmarks: update min dvc version for test_exp_show by @pmrowla in https://github.com/iterative/dvc/pull/9609

Full Changelog: https://github.com/iterative/dvc/compare/3.0.0...3.1.0

Open source →

3.0.013 Jun 2023Deprecated

use of .dvc file as a pipeline stage has been removed, which has been deprecated in 1.0. This means that now it is forbidden to use params/cmd/metrics…

What's Changed

🛠 Breaking Changes

DVC used to identify a file by removing CRLF line endings (although it stored the original file contents in the cache).
However, in DVC 3.x, this behaviour has been dropped. Now, DVC hashes the file contents directly without removing CRLF line endings. All pre-existing DVC-tracked data from DVC 2.x can still be accessed and used in DVC 3.x. However, any new operations that result in a DVC committed change will generate a 3.x DVC output, which will be stored in a different location than 2.x DVC outputs. The files will be stored in cache at .dvc/cache/files/md5 and in the remote at <remote_dir>/files/md5.

You can read more about it in #4658 and #9538.
While strictly not required, dvc cache migrate command is introduced to migrate 2.x format of cache to 3.x format to make migrations easier (#9591).
Support for tracking (cached) external outputs has been removed (#9570).
checkpoints has been removed (#9271).
dvc run command has been removed, use stage add --run instead (#9508).
exp init, exp gc commands have been removed (#9269, #9273).
--show-json/--show-md/--show-csv flags are removed (#9475). Use --json/--md/--csv instead.
--recursive option from dvc add is removed (#9513). Use dvc add dir to recursively add files in a directory.
--file option from dvc add, dvc import and dvc import-url is now removed (#9547, #9562, #9548).
--meta, --desc, --label, and --type option from dvc add, dvc import and dvc import-url is now removed (#9481).
--jobs option that is used in combination with dvc add --to-remote is now renamed to --remote-jobs to avoid confusion with core.checksum_jobs (#9522, #9550).
--metrics option is removed from both exp run and repro commands (#9458).
--pcp option from exp show has been removed (#9270).
Read-only support for dvc 1.0 lockfile format has been removed (#9476).
Support for defining multiple plots as a dictionary has been removed (#9486). Use a list instead.
dvc.yaml: stage-level vars is removed (#9556).
use of .dvc file as a pipeline stage has been removed, which has been deprecated in 1.0. This means that now it is forbidden to use params/cmd/metrics/plots in .dvc files (#9546, #9551, #9552, #9554). Also, if you have used dvc before 1.0, Dvcfile is no longer supported or recognized.
pkg info has moved from dvc.utils.pkg to dvc._build. You can now import it using from dvc import PKG (#9559).

🐛 Bug Fixes

repro: check for hash mismatch between deleted dependencies and upstream outputs (#9533).
exp list: show experiment shas (#9501).
update: make sure we update hashes/checksums on --to-remote (#9536).
fetch: cache collected (#9579).

Full Changelog: https://github.com/iterative/dvc/compare/2.58.2...3.0.0

Open source →

3.0.0a27 Jun 2023pre-release

Nothing published for this version

3.0.0a125 May 2023pre-release

Nothing published for this version

3.0.0a023 May 2023pre-release

What's Changed

🛠 Breaking Changes

commands: remove --show-json/--show-md/--show-csv flags by @skshetry in https://github.com/iterative/dvc/pull/9475
lockfile: drop 1.0 lockfile support by @skshetry in https://github.com/iterative/dvc/pull/9476
exp: Drop init. by @daavoo in https://github.com/iterative/dvc/pull/9269
exp show: Drop --pcp. by @daavoo in https://github.com/iterative/dvc/pull/9270
remove data ls and support for --meta/--desc/--label/--type cli flags by @skshetry in https://github.com/iterative/dvc/pull/9481
remove dvc.main.main alias by @skshetry in https://github.com/iterative/dvc/pull/9488
drop Repo.stages by @skshetry in https://github.com/iterative/dvc/pull/9489
drop top-level plots definition as mapping support by @skshetry in https://github.com/iterative/dvc/pull/9486
exp: Drop gc. by @daavoo in https://github.com/iterative/dvc/pull/9273
exp run / repro: Drop --metrics. by @daavoo in https://github.com/iterative/dvc/pull/9458

🚀 New Features and Enhancements

stage add: introduce --run option by @skshetry in https://github.com/iterative/dvc/pull/9480

🐛 Bug Fixes

exp: Fix --rev args for ls pull and remove. by @daavoo in https://github.com/iterative/dvc/pull/9483
get_random_exp_name: Use custom random generator. by @daavoo in https://github.com/iterative/dvc/pull/9490

Other Changes

set destination branch to PR title on backport by @skshetry in https://github.com/iterative/dvc/pull/9492

Full Changelog: https://github.com/iterative/dvc/compare/2.57.2...3.0.0a0

Open source →

2.58.231 May 2023

What's Changed

Other Changes

(2.x) repro: Continue on RunCacheNotSupported by @mergify in https://github.com/iterative/dvc/pull/9511
(2.x) deps: bumps dvc-azure>=2.21.2 by @mergify in https://github.com/iterative/dvc/pull/9526

Full Changelog: https://github.com/iterative/dvc/compare/2.58.1...2.58.2

Open source →

2.58.123 May 2023

What's Changed

Other Changes

(2.x) plots diff: collect live plots for queued experiments (backport by @mergify in https://github.com/iterative/dvc/pull/9496)

Full Changelog: https://github.com/iterative/dvc/compare/2.58.0...2.58.1

Open source →

2.58.022 May 2023

What's Changed

🚀 New Features and Enhancements

stage add: introduce --run option (backport #9480) by @mergify in https://github.com/iterative/dvc/pull/9487

Other Changes

get_random_exp_name: Use custom random generator. (backport #9490) by @mergify in https://github.com/iterative/dvc/pull/9491

Full Changelog: https://github.com/iterative/dvc/compare/2.57.3...2.57.4

Open source →

2.57.321 May 2023

What's Changed

Other Changes

exp: Fix --rev args for ls pull and remove. (backport #9483) by @mergify in https://github.com/iterative/dvc/pull/9484

Full Changelog: https://github.com/iterative/dvc/compare/2.57.2...2.57.3

Open source →

2.57.218 May 2023

What's Changed

🐛 Bug Fixes

exp push: Handle rev arg as list. by @daavoo in https://github.com/iterative/dvc/pull/9472

Other Changes

show hydra dumped results in debug mode by @dberenbaum in https://github.com/iterative/dvc/pull/9460

Full Changelog: https://github.com/iterative/dvc/compare/2.57.1...2.57.2

Open source →

2.57.117 May 2023

What's Changed

🐛 Bug Fixes

testing: Lazy import pytest_virtualenv by @daavoo in https://github.com/iterative/dvc/pull/9469

Full Changelog: https://github.com/iterative/dvc/compare/2.57.0...2.57.1

Open source →

2.57.017 May 2023

What's Changed

🚀 New Features and Enhancements

metrics: support strings by @paulourbano in https://github.com/iterative/dvc/pull/9387
exp: Update --rev to support append action. by @daavoo in https://github.com/iterative/dvc/pull/9391
api: exp_show: Postprocess empty strings as None. by @daavoo in https://github.com/iterative/dvc/pull/9392
exp run/save: Support message by @daavoo in https://github.com/iterative/dvc/pull/9408
repro: pull all missing files by @daavoo in https://github.com/iterative/dvc/pull/9395
add: support virtual operation by @skshetry in https://github.com/iterative/dvc/pull/9389
fix checkout callback during add/commit by @skshetry in https://github.com/iterative/dvc/pull/9445
disable nested progress bar during checkout by @skshetry in https://github.com/iterative/dvc/pull/9446
exp: fix temporary ref namespacing by @pmrowla in https://github.com/iterative/dvc/pull/9456
repro: Add --allow-missing by @daavoo in https://github.com/iterative/dvc/pull/9437

🐛 Bug Fixes

repo: consolidate Repo.open logic by @efiop in https://github.com/iterative/dvc/pull/9414
import: don't forget to set cache.dir by @efiop in https://github.com/iterative/dvc/pull/9415

🔨 Maintenance

repro: Move pull logic to inside Stage. by @daavoo in https://github.com/iterative/dvc/pull/9434
build(deps-dev): bump mypy from 1.2.0 to 1.3.0 by @dependabot in https://github.com/iterative/dvc/pull/9439
build(deps-dev): bump pylint from 2.17.2 to 2.17.4 by @dependabot in https://github.com/iterative/dvc/pull/9418

Other Changes

add: msg for overlapping parent by @dberenbaum in https://github.com/iterative/dvc/pull/9386
testing: add testing.benchmarks and register dvc-testing as a pytest plugin by @pmrowla in https://github.com/iterative/dvc/pull/9383
deps: temporarily pin ruamel.yaml by @efiop in https://github.com/iterative/dvc/pull/9398
deps: unpin ruamel.yaml by @efiop in https://github.com/iterative/dvc/pull/9406
gha: try setting PYTHONUTF8 by @efiop in https://github.com/iterative/dvc/pull/9412
data status: exclude remote status by default by @dberenbaum in https://github.com/iterative/dvc/pull/9411
add random seed to benchmark stories by @dberenbaum in https://github.com/iterative/dvc/pull/9429
Add API to add artifacts by @aguschin in https://github.com/iterative/dvc/pull/9345
tests: isolate dvc config and directories by @skshetry in https://github.com/iterative/dvc/pull/9450
import: don't forget to set other cache config options by @efiop in https://github.com/iterative/dvc/pull/9423
gc: disallow --remote without other flags by @dberenbaum in https://github.com/iterative/dvc/pull/9443
packaging: use PyPI trusted publishers by @skshetry in https://github.com/iterative/dvc/pull/9459
ci(Mergify): configuration update by @skshetry in https://github.com/iterative/dvc/pull/9463
run tests and codeql on 2.x branch by @skshetry in https://github.com/iterative/dvc/pull/9465
Live metrics config by @dberenbaum in https://github.com/iterative/dvc/pull/9433

New Contributors

@paulourbano made their first contribution in https://github.com/iterative/dvc/pull/9387

Full Changelog: https://github.com/iterative/dvc/compare/2.56.0...2.57.0

Open source →

2.56.02 May 2023

What's Changed

🚀 New Features and Enhancements

exp: show active experiments first by @dberenbaum in https://github.com/iterative/dvc/pull/9351
Fix: Prettifying unexpected error on FileExists for get/get-url/imp-url/add and introducing --force by @omesser in https://github.com/iterative/dvc/pull/9365
gc: Add --not-in-remote arg. by @daavoo in https://github.com/iterative/dvc/pull/9350
api: Add exp_show. by @daavoo in https://github.com/iterative/dvc/pull/9356
exp push: notify studio even if cache push fails by @skshetry in https://github.com/iterative/dvc/pull/9380

🐛 Bug Fixes

studio: Ensure studio_repo_url works with exp run --queue. by @daavoo in https://github.com/iterative/dvc/pull/9353

🔨 Maintenance

build(deps-dev): update dvc-render requirement from <0.4.0,>=0.3.1 to >=0.3.1,<1 by @dependabot in https://github.com/iterative/dvc/pull/9359
deps: bump dvc-task to 0.2.1 by @pmrowla in https://github.com/iterative/dvc/pull/9372

Other Changes

exp push: soft wrap link so that the URL does not break by @skshetry in https://github.com/iterative/dvc/pull/9368

Full Changelog: https://github.com/iterative/dvc/compare/2.55.0...2.56.0

Open source →

2.55.020 Apr 2023

What's Changed

🛠 Breaking Changes

exp: refactor show behavior by @pmrowla in https://github.com/iterative/dvc/pull/9170 (dvc exp show --json format has changed vs prior DVC releases)

🚀 New Features and Enhancements

exp push: add DVC_STUDIO_URL envvar support by @skshetry in https://github.com/iterative/dvc/pull/9340

🐛 Bug Fixes

exp run: do not autostage on dvc repro by @skshetry in https://github.com/iterative/dvc/pull/9344
import-url: make version-aware and to-remote exclusive by @dberenbaum in https://github.com/iterative/dvc/pull/9332

🔨 Maintenance

build(deps-dev): bump dvc-s3 from 2.21 to 2.22.0 by @dependabot in https://github.com/iterative/dvc/pull/9343
build(deps-dev): bump dvc-gdrive from 2.19.1 to 2.19.2 by @dependabot in https://github.com/iterative/dvc/pull/9315

Other Changes

release: remove feature flags for experiment sharing by @skshetry in https://github.com/iterative/dvc/pull/9257

Full Changelog: https://github.com/iterative/dvc/compare/2.54.0...2.55.0

Open source →

2.54.012 Apr 2023

What's Changed

🔨 Maintenance

deps: bump dvc-ssh to 2.22.1 by @pmrowla in https://github.com/iterative/dvc/pull/9311
build(deps-dev): bump mypy from 1.1.1 to 1.2.0 by @dependabot in https://github.com/iterative/dvc/pull/9313

Other Changes

deps: bump scmrepo to 1.0.0 by @pmrowla in https://github.com/iterative/dvc/pull/9317
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/iterative/dvc/pull/9319
deps: put lower bound on dvc-http by @efiop in https://github.com/iterative/dvc/pull/9326

Full Changelog: https://github.com/iterative/dvc/compare/2.53.0...2.54.0

Open source →

2.53.06 Apr 2023

What's Changed

🚀 New Features and Enhancements

exp run/save: track top level files by @daavoo in https://github.com/iterative/dvc/pull/9250
exp save: include untracked dvclock by @daavoo in https://github.com/iterative/dvc/pull/9261
Add top-level artifacts: section by @aguschin in https://github.com/iterative/dvc/pull/9220
exp run: Add --copy-paths arg. by @daavoo in https://github.com/iterative/dvc/pull/9302

🐛 Bug Fixes

api: data: set default remote instead of using it directly by @efiop in https://github.com/iterative/dvc/pull/9306
exp run: git add param files that will be modified. by @daavoo in https://github.com/iterative/dvc/pull/9305

🔨 Maintenance

build(deps-dev): bump pylint from 2.17.1 to 2.17.2 by @dependabot in https://github.com/iterative/dvc/pull/9299
deps: bump scmrepo minver to 0.2.1 by @pmrowla in https://github.com/iterative/dvc/pull/9307

Other Changes

dep: repo: use dvcfs by @efiop in https://github.com/iterative/dvc/pull/9246
repo: site_cache_dir improvements by @efiop in https://github.com/iterative/dvc/pull/9298
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/iterative/dvc/pull/9251
exp push: improve ui by @skshetry in https://github.com/iterative/dvc/pull/9308

Full Changelog: https://github.com/iterative/dvc/compare/2.52.0...2.53.0

Open source →

2.52.031 Mar 2023

What's Changed

🚀 New Features and Enhancements

api: Add exp_save. by @daavoo in https://github.com/iterative/dvc/pull/8727
exp branch: Make branch arg optional. by @daavoo in https://github.com/iterative/dvc/pull/9211
exp remove: fix ui for removing from git remotes by @dberenbaum in https://github.com/iterative/dvc/pull/9266

🐛 Bug Fixes

config: don't look for .dvc dir implicitly by @efiop in https://github.com/iterative/dvc/pull/9274

🔨 Maintenance

build(deps-dev): bump pylint from 2.17.0 to 2.17.1 by @dependabot in https://github.com/iterative/dvc/pull/9229
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/iterative/dvc/pull/9168
build(deps): bump pyinstaller from 5.8.0 to 5.9.0 by @dependabot in https://github.com/iterative/dvc/pull/9169
exp save: Reintroduce implementation based on executor/queue. by @daavoo in https://github.com/iterative/dvc/pull/9165
deps: bump scmrepo to 0.1.17 by @pmrowla in https://github.com/iterative/dvc/pull/9237

Other Changes

erepo: pass rev instead of fs/scm by @efiop in https://github.com/iterative/dvc/pull/9222
erepo: set subrepos/uninitialized explicitly by @efiop in https://github.com/iterative/dvc/pull/9224
erepo: move legacy exceptions to api by @efiop in https://github.com/iterative/dvc/pull/9228
dvcfs: handle broken symlink/TreeError by @efiop in https://github.com/iterative/dvc/pull/9231
Update duplicate output error msg by @dberenbaum in https://github.com/iterative/dvc/pull/9138
deps: bump dvc-data to 0.46.0 by @efiop in https://github.com/iterative/dvc/pull/9241
output: ignore missing size from files when calculating total size by @skshetry in https://github.com/iterative/dvc/pull/9242
replace funcy.cat with itertools.chain.from_iterable by @skshetry in https://github.com/iterative/dvc/pull/9279
deps: bump dvc-studio-client>=0.6.1,<1 by @daavoo in https://github.com/iterative/dvc/pull/9285
exp run: Propagate .dvc/config.local in TempDirExecutor. by @daavoo in https://github.com/iterative/dvc/pull/9289

Full Changelog: https://github.com/iterative/dvc/compare/2.51.0...2.52.0

Open source →

2.51.020 Mar 2023

What's Changed

⚡ Optimizations

deps: bump dvc-render>=0.3.1<0.4.0. by @daavoo in https://github.com/iterative/dvc/pull/9197

🐛 Bug Fixes

hydra: resolve OmegaConf interpolations. by @daavoo in https://github.com/iterative/dvc/pull/9212

Other Changes

dvcfs: support caching remote streams; use that in plots by @skshetry in https://github.com/iterative/dvc/pull/9183
close streams by @skshetry in https://github.com/iterative/dvc/pull/9204
parsing: fix foreach resolution with int keys by @dtrifiro in https://github.com/iterative/dvc/pull/8904

New Contributors

@omesser made their first contribution in https://github.com/iterative/dvc/pull/9208

Full Changelog: https://github.com/iterative/dvc/compare/2.50.0...2.51.0

Open source →

2.50.015 Mar 2023

What's Changed

🚀 New Features and Enhancements

ui: disable colorama on write_json when highlighting is disabled by @skshetry in https://github.com/iterative/dvc/pull/9186

Other Changes

deps: bump dvc-data to 0.44.0 by @efiop in https://github.com/iterative/dvc/pull/9180
repo: create site_cache_dir with proper perms by @efiop in https://github.com/iterative/dvc/pull/9185

Full Changelog: https://github.com/iterative/dvc/compare/2.49.0...2.50.0

Open source →

2.49.015 Mar 2023

What's Changed

Other Changes

exp: push/pull: don't include baseline commit by @efiop in https://github.com/iterative/dvc/pull/9164
exp: Include STUDIO_REPO_URL in run_env. by @daavoo in https://github.com/iterative/dvc/pull/9161
exp: fail fast in empty git repo by @dberenbaum in https://github.com/iterative/dvc/pull/8840
install: pre-commit: install all deps by default by @efiop in https://github.com/iterative/dvc/pull/9179

Full Changelog: https://github.com/iterative/dvc/compare/2.48.0...2.49.0

Open source →

2.48.013 Mar 2023

What's Changed

Other Changes

repo: move state/index/data_index to site_cache_dir by @efiop in https://github.com/iterative/dvc/pull/9151
tests: remove gc.collect() from windows by @skshetry in https://github.com/iterative/dvc/pull/9159
deps: bump dvc-data to >=0.43.0 by @efiop in https://github.com/iterative/dvc/pull/9167

Full Changelog: https://github.com/iterative/dvc/compare/2.47.2...2.48.0

Open source →

2.47.211 Mar 2023

What's Changed

Other Changes

repo: data_index: fallback to in-memory by @efiop in https://github.com/iterative/dvc/pull/9157
deps: bump dvc-data to >=0.42.3 by @efiop in https://github.com/iterative/dvc/pull/9158

Full Changelog: https://github.com/iterative/dvc/compare/2.47.1...2.47.2

Open source →

2.47.110 Mar 2023

What's Changed

🚀 New Features and Enhancements

fix(exp): cleanup help messages by @shcheklein in https://github.com/iterative/dvc/pull/9149
plots: disable syntax highlighting on plots json output by @skshetry in https://github.com/iterative/dvc/pull/9155

Other Changes

config: ignore unspecified keys from feature section by @skshetry in https://github.com/iterative/dvc/pull/9153
deps: bump dvc-data to >= 0.42.2 by @efiop in https://github.com/iterative/dvc/pull/9156

Full Changelog: https://github.com/iterative/dvc/compare/2.47.0...2.47.1

Open source →

2.47.09 Mar 2023

What's Changed

🚀 New Features and Enhancements

exp show: fix cached running checkpoint state bug by @pmrowla in https://github.com/iterative/dvc/pull/9128
studio: Send metrics on done event. by @daavoo in https://github.com/iterative/dvc/pull/9027
plots: avoid printing anything on --json output by @skshetry in https://github.com/iterative/dvc/pull/9144

🐛 Bug Fixes

push: allow no default remote by @shcheklein in https://github.com/iterative/dvc/pull/9111
output: suppress cloud.pull errors on cache collection by @efiop in https://github.com/iterative/dvc/pull/9112

🔨 Maintenance

build(deps-dev): bump pylint from 2.16.3 to 2.16.4 by @dependabot in https://github.com/iterative/dvc/pull/9127
build(deps-dev): bump mypy from 1.0.1 to 1.1.1 by @dependabot in https://github.com/iterative/dvc/pull/9126
build(deps-dev): bump pylint from 2.16.4 to 2.17.0 by @dependabot in https://github.com/iterative/dvc/pull/9141

Other Changes

migrate from appdirs to platformdirs by @skshetry in https://github.com/iterative/dvc/pull/9131
Add back an dvc ignore test by @karajan1001 in https://github.com/iterative/dvc/pull/9134
try to improve test speed by @skshetry in https://github.com/iterative/dvc/pull/9136
studio: handle revision errors when posting by @dberenbaum in https://github.com/iterative/dvc/pull/9137

Full Changelog: https://github.com/iterative/dvc/compare/2.46.0...2.47.0

Open source →

2.46.06 Mar 2023

What's Changed

🚀 New Features and Enhancements

repo: enable data index caching by default by @efiop in https://github.com/iterative/dvc/pull/9044
Add metrics_show to dvc.api by @adamliter in https://github.com/iterative/dvc/pull/9042
pull: Add allow_missing flag. by @daavoo in https://github.com/iterative/dvc/pull/9071
exp show: don't cache collection errors by @pmrowla in https://github.com/iterative/dvc/pull/9114

⚡ Optimizations

exp show: cache collected experiments by git revision by @pmrowla in https://github.com/iterative/dvc/pull/9069
exp show: cache git refs per show() call by @pmrowla in https://github.com/iterative/dvc/pull/9077
exp save: Don't relink during commit by @daavoo in https://github.com/iterative/dvc/pull/9093
exp: support dvc-task/celery message cleanup by @pmrowla in https://github.com/iterative/dvc/pull/9090

🐛 Bug Fixes

exp save: Use pathspec to handle include_untracked. by @daavoo in https://github.com/iterative/dvc/pull/9064
repo: use local root when determining state/index db dirname by @pmrowla in https://github.com/iterative/dvc/pull/9078
plots: Fix plots defined with windows syntax by @daavoo in https://github.com/iterative/dvc/pull/9072

🔨 Maintenance

build(deps-dev): bump mypy from 0.991 to 1.0.1 (#9049)Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> by @dependabot in https://github.com/iterative/dvc/pull/9049
build(deps): bump pyinstaller from 5.7.0 to 5.8.0 by @dependabot in https://github.com/iterative/dvc/pull/9013
deps: use version ranges for dvc sub-packages by @pmrowla in https://github.com/iterative/dvc/pull/9056
build(deps-dev): unpin pytest-docker by @dependabot in https://github.com/iterative/dvc/pull/9054
tests: unmark exp celery tests as xfail by @pmrowla in https://github.com/iterative/dvc/pull/9101
build(deps-dev): bump pylint from 2.16.2 to 2.16.3 by @dependabot in https://github.com/iterative/dvc/pull/9113

Other Changes

config: don't set default cache dir by @efiop in https://github.com/iterative/dvc/pull/9037
Revert "repo: enable data index caching by default" by @efiop in https://github.com/iterative/dvc/pull/9045
repo: move data_index to .dvc/tmp/index by @efiop in https://github.com/iterative/dvc/pull/9046
config: enable data index caching by default by @efiop in https://github.com/iterative/dvc/pull/9047
deps: bump dvc-data to 0.40.4 by @efiop in https://github.com/iterative/dvc/pull/9048
deps: drop importlib-resources and typing-extensions by @skshetry in https://github.com/iterative/dvc/pull/9055
exp apply: allow apply from other commits by @pmrowla in https://github.com/iterative/dvc/pull/8994
dvcfs: implement get_file by @efiop in https://github.com/iterative/dvc/pull/9057
data: status: introduce --not-in-remote by @efiop in https://github.com/iterative/dvc/pull/8962
index: store data index under tree prefix by @efiop in https://github.com/iterative/dvc/pull/9060
index: use has_node instead of ls by @efiop in https://github.com/iterative/dvc/pull/9062
data: status: introduce --remote-refresh by @efiop in https://github.com/iterative/dvc/pull/9063
exp: run: don't relink during commit by @efiop in https://github.com/iterative/dvc/pull/9076
plots: shorten names in the legend by @dberenbaum in https://github.com/iterative/dvc/pull/8900
remove typing.cast by @skshetry in https://github.com/iterative/dvc/pull/9082
testing: fixtures: fix docker regression by @efiop in https://github.com/iterative/dvc/pull/9083
Revert "testing: fixtures: fix docker regression" by @efiop in https://github.com/iterative/dvc/pull/9084
deps: Bump scmrepo>=0.1.13. by @daavoo in https://github.com/iterative/dvc/pull/9087
dvc.testing: fix lockfile in docker_services fixture by @skshetry in https://github.com/iterative/dvc/pull/9088
build: use macos-11 to build package by @skshetry in https://github.com/iterative/dvc/pull/9091
deps: bump dvc-data to 0.42.0 by @efiop in https://github.com/iterative/dvc/pull/9092
deps: bump dvc-gs to 2.22.0 by @efiop in https://github.com/iterative/dvc/pull/9094
exp: fix celery run file descriptor leak by @pmrowla in https://github.com/iterative/dvc/pull/9089
exp: use stash-apply instead of merge by @pmrowla in https://github.com/iterative/dvc/pull/9096
remote: set hash_name as md5 by @efiop in https://github.com/iterative/dvc/pull/9097
deps: bump dvc-data to >=0.42.1 by @efiop in https://github.com/iterative/dvc/pull/9104
deps: Drop dvclive. by @daavoo in https://github.com/iterative/dvc/pull/9105
deps: Bump scmrepo>=0.1.14 by @daavoo in https://github.com/iterative/dvc/pull/9107
scm: Remove unused GitMergeError. by @daavoo in https://github.com/iterative/dvc/pull/9109

New Contributors

@adamliter made their first contribution in https://github.com/iterative/dvc/pull/9042

Full Changelog: https://github.com/iterative/dvc/compare/2.45.1...2.46.0

Open source →

2.45.116 Feb 2023

What's Changed

🚀 New Features and Enhancements

repo: cache index for cloud versioning by @efiop in https://github.com/iterative/dvc/pull/9029

⚡ Optimizations

render: avoid deepcopying by @skshetry in https://github.com/iterative/dvc/pull/9033

🔨 Maintenance

build(deps-dev): bump pylint from 2.16.1 to 2.16.2 by @dependabot in https://github.com/iterative/dvc/pull/9020
build(deps-dev): bump scmrepo from 0.1.10 to 0.1.11 by @dependabot in https://github.com/iterative/dvc/pull/9039

Other Changes

8998 exp run include new staged files by @daavoo in https://github.com/iterative/dvc/pull/9017
index: build_data_index: use dvcignore by @efiop in https://github.com/iterative/dvc/pull/9028
data: status: misc fixes by @efiop in https://github.com/iterative/dvc/pull/9031
diff: use index by @efiop in https://github.com/iterative/dvc/pull/8930
ui: log footer support message to standard error by @skshetry in https://github.com/iterative/dvc/pull/9034
Revert "scm: use dulwich backend when fetching exps during clone/pull" by @skshetry in https://github.com/iterative/dvc/pull/9041

Full Changelog: https://github.com/iterative/dvc/compare/2.45.0...2.45.1

Open source →

2.45.014 Feb 2023

What's Changed

🚀 New Features and Enhancements

index: experimental persistent data index by @efiop in https://github.com/iterative/dvc/pull/8827

🐛 Bug Fixes

Handle filenames which has ":" by @karanjakhar in https://github.com/iterative/dvc/pull/9000
scm: use dulwich backend when fetching exps during clone/pull by @skshetry in https://github.com/iterative/dvc/pull/9023

🔨 Maintenance

build(deps-dev): bump dvc-render from 0.1.1 to 0.1.2 by @dependabot in https://github.com/iterative/dvc/pull/9003

Other Changes

update rich by @dberenbaum in https://github.com/iterative/dvc/pull/9001
Fix some mypy error. by @karajan1001 in https://github.com/iterative/dvc/pull/8947
deps: bump dvc-data to 0.40.1 by @efiop in https://github.com/iterative/dvc/pull/9011
brancher: add trace when switching filesystem by @skshetry in https://github.com/iterative/dvc/pull/9022

New Contributors

@karanjakhar made their first contribution in https://github.com/iterative/dvc/pull/9000

Full Changelog: https://github.com/iterative/dvc/compare/2.44.0...2.45.0

Open source →

2.44.09 Feb 2023

What's Changed

🚀 New Features and Enhancements

logging: defer calling colorama.init() in jupyter, otherwise initialize immediately by @skshetry in https://github.com/iterative/dvc/pull/8969
push: check if versioning is supported or not during checkout on cloud versioning by @skshetry in https://github.com/iterative/dvc/pull/8949

⚡ Optimizations

Use pygit2 backend for fetch_refspecs by @karajan1001 in https://github.com/iterative/dvc/pull/8907

🐛 Bug Fixes

studio: Move post_live_metrics from queue to executor by @daavoo in https://github.com/iterative/dvc/pull/8955

🔨 Maintenance

build(deps-dev): bump dvc-data from 0.38.1 to 0.38.3 by @dependabot in https://github.com/iterative/dvc/pull/8983
build(deps-dev): bump dvc-render from 0.1.0 to 0.1.1 by @dependabot in https://github.com/iterative/dvc/pull/8982
build(deps-dev): bump pytest-xdist from 3.1.0 to 3.2.0 by @dependabot in https://github.com/iterative/dvc/pull/8981
build(deps-dev): bump dvc-azure from 2.21.0 to 2.21.1 by @dependabot in https://github.com/iterative/dvc/pull/8991

Other Changes

serialization: reorder files section metadata (#8950 by @skshetry in https://github.com/iterative/dvc/pull/8950
deps: bump dvc-data to 0.38.1 by @efiop in https://github.com/iterative/dvc/pull/8976
testing: mark 00 prefix tests xfail on fs without find() by @pmrowla in https://github.com/iterative/dvc/pull/8979
Support setting a exp name prefix in hydra sweeps by @hkariti in https://github.com/iterative/dvc/pull/8943
import-url: fix update after cloud versioned import-url --no-download by @pmrowla in https://github.com/iterative/dvc/pull/8984
logging: change from dictConfig to equivalent code for creating logge… (#8985 by @skshetry in https://github.com/iterative/dvc/pull/8985
logger: check isatty stream to print colored logs or not instead of depending on colorama (#8993 by @skshetry in https://github.com/iterative/dvc/pull/8993
logging: do not disable other loggers by @skshetry in https://github.com/iterative/dvc/pull/8995
get/import: lazy import dvc.scm; reduces dvc --help by ~20% by @skshetry in https://github.com/iterative/dvc/pull/8996

New Contributors

@hkariti made their first contribution in https://github.com/iterative/dvc/pull/8943

Full Changelog: https://github.com/iterative/dvc/compare/2.43.4...2.44.0

Open source →

2.43.46 Feb 2023

What's Changed

🐛 Bug Fixes

testing: re-add 00 prefix remote traverse tests by @pmrowla in https://github.com/iterative/dvc/pull/8965

Full Changelog: https://github.com/iterative/dvc/compare/2.43.3...2.43.4

Open source →

2.43.36 Feb 2023

What's Changed

🐛 Bug Fixes

worktree update: fix metadata merge on update by @pmrowla in https://github.com/iterative/dvc/pull/8945
import-url: fix pull after import-url --version-aware with subdirs by @pmrowla in https://github.com/iterative/dvc/pull/8946
index: build_data_index: handle empty dirs by @efiop in https://github.com/iterative/dvc/pull/8959

🔨 Maintenance

build(deps-dev): bump pylint from 2.16.0 to 2.16.1 by @dependabot in https://github.com/iterative/dvc/pull/8944

Full Changelog: https://github.com/iterative/dvc/compare/2.43.2...2.43.3

Open source →

2.43.22 Feb 2023

What's Changed

🚀 New Features and Enhancements

output: Don't serialize hash_info or meta in cloud versioning. by @daavoo in https://github.com/iterative/dvc/pull/8849
import/import-url: try not to delete dvcfile before import/import-url completes by @skshetry in https://github.com/iterative/dvc/pull/8876
logging: log pkg version/type, platform info and cli arguments by @skshetry in https://github.com/iterative/dvc/pull/8918
version/info: match dashes' length below DVC version by @skshetry in https://github.com/iterative/dvc/pull/8921

🐛 Bug Fixes

output: Pass version_aware=True to fs if files is present. by @daavoo in https://github.com/iterative/dvc/pull/8882
stage: use repo.fs directly without copying by @efiop in https://github.com/iterative/dvc/pull/8929

🔨 Maintenance

build(deps-dev): bump dvc-data from 0.35.1 to 0.35.2 by @dependabot in https://github.com/iterative/dvc/pull/8871
build(deps-dev): bump dvc-gs from 2.20.0 to 2.21.0 by @dependabot in https://github.com/iterative/dvc/pull/8841
build(deps-dev): bump dvc-data from 0.36.0 to 0.36.1 by @dependabot in https://github.com/iterative/dvc/pull/8887
testing: add initial basic cloud versioning tests by @pmrowla in https://github.com/iterative/dvc/pull/8888
build(deps-dev): bump scmrepo from 0.1.6 to 0.1.7 by @dependabot in https://github.com/iterative/dvc/pull/8821
ci: run dvc-s3 tests on DVC pull requests by @pmrowla in https://github.com/iterative/dvc/pull/8913
build(deps-dev): bump beautifulsoup4 from 4.11.1 to 4.11.2 by @dependabot in https://github.com/iterative/dvc/pull/8928
build(deps-dev): bump pylint from 2.15.10 to 2.16.0 by @dependabot in https://github.com/iterative/dvc/pull/8936
build(deps-dev): bump dvc-render from 0.0.17 to 0.1.0 by @dependabot in https://github.com/iterative/dvc/pull/8935

Other Changes

data: status: use data index by @efiop in https://github.com/iterative/dvc/pull/8846
stage.save: Remove merge_versioned option. by @daavoo in https://github.com/iterative/dvc/pull/8873
add support for output-specific remotes by @skshetry in https://github.com/iterative/dvc/pull/8862
queue: update kill ui messages by @dberenbaum in https://github.com/iterative/dvc/pull/8798
deps: bump dvc-data to 0.36.0 by @efiop in https://github.com/iterative/dvc/pull/8885
worktree: bug fixes from testing by @pmrowla in https://github.com/iterative/dvc/pull/8890
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/iterative/dvc/pull/8869
Fixed typo in _format_field function. issue https://github.com/iterative/dvc/issues/8891 by @AIladin in https://github.com/iterative/dvc/pull/8892
analytics: differentiate ci users by @dberenbaum in https://github.com/iterative/dvc/pull/8838
gc: fix usage with --date by @dtrifiro in https://github.com/iterative/dvc/pull/8880
update ruff and enable flake8-logging-format and flake8-type-checking by @skshetry in https://github.com/iterative/dvc/pull/8894
index: expose rev property by @efiop in https://github.com/iterative/dvc/pull/8909
testing: add tests for cloud versioned update and import-url by @pmrowla in https://github.com/iterative/dvc/pull/8916
deps: bump dvc-gs to 2.21.1 by @pmrowla in https://github.com/iterative/dvc/pull/8919
deps: bump dvc-data to 0.37.3 by @efiop in https://github.com/iterative/dvc/pull/8923
index: introduce data_keys by @efiop in https://github.com/iterative/dvc/pull/8938
Custom header for dvc webdav (#8933)Fix https://github.com/iterative/dvc/issues/8931 by @frederik-sandfort in https://github.com/iterative/dvc/pull/8933

New Contributors

@AIladin made their first contribution in https://github.com/iterative/dvc/pull/8892
@frederik-sandfort made their first contribution in https://github.com/iterative/dvc/pull/8933

Full Changelog: https://github.com/iterative/dvc/compare/2.43.1...2.43.2

Open source →

2.43.122 Jan 2023

What's Changed

Other Changes

deps: bump dvc-azure to 2.21.0 by @efiop in https://github.com/iterative/dvc/pull/8864
deps: bump dvc-ssh to 2.21.0 by @efiop in https://github.com/iterative/dvc/pull/8865

Full Changelog: https://github.com/iterative/dvc/compare/2.43.0...2.43.1

Open source →

2.43.022 Jan 2023

What's Changed

🔨 Maintenance

deps: bump dvc-data to 0.35.1 by @pmrowla in https://github.com/iterative/dvc/pull/8857

Other Changes

deps: bump dvc-data to 0.35.0 by @efiop in https://github.com/iterative/dvc/pull/8847
remove setup.py file by @skshetry in https://github.com/iterative/dvc/pull/8851
add viztracer async option by @dberenbaum in https://github.com/iterative/dvc/pull/8856

Full Changelog: https://github.com/iterative/dvc/compare/2.42.0...2.43.0

Open source →

2.42.019 Jan 2023

What's Changed

🚀 New Features and Enhancements

stage: Skip run-cache if any out has cache: false. by @daavoo in https://github.com/iterative/dvc/pull/8738

⚡ Optimizations

perf: remove fs exists check in plots, parallel data collect by @shcheklein in https://github.com/iterative/dvc/pull/8777
deps: bump dvc-data to 0.34.0 by @pmrowla in https://github.com/iterative/dvc/pull/8842

🐛 Bug Fixes

config: Reraise ConfigError from ConfigObjError. by @daavoo in https://github.com/iterative/dvc/pull/8802
exp run: Fix --dry option. by @daavoo in https://github.com/iterative/dvc/pull/8833
param: Fix status check for Tuples. by @daavoo in https://github.com/iterative/dvc/pull/8823

🔨 Maintenance

build(deps-dev): unpin grandalf by @dependabot in https://github.com/iterative/dvc/pull/8792
build(deps-dev): bump dvc-task from 0.1.9 to 0.1.10 by @dependabot in https://github.com/iterative/dvc/pull/8807
build(deps-dev): bump dvc-task from 0.1.10 to 0.1.11 by @dependabot in https://github.com/iterative/dvc/pull/8820
build(deps-dev): bump pytest from 7.2.0 to 7.2.1 by @dependabot in https://github.com/iterative/dvc/pull/8819

Other Changes

index/stage: move repo collection logic to index by @skshetry in https://github.com/iterative/dvc/pull/8782
mypy: use typesafe cached_property by @skshetry in https://github.com/iterative/dvc/pull/8799
Bump pathspec to 0.10.3 by @karajan1001 in https://github.com/iterative/dvc/pull/8767
index: introduce build_data_index by @efiop in https://github.com/iterative/dvc/pull/8810
pre-commit update: flake8/ruff/pyupgrade/black/isort by @skshetry in https://github.com/iterative/dvc/pull/8813
mypy: don't ignore all imports, also disallow implicit optional by @skshetry in https://github.com/iterative/dvc/pull/8814
Add misc type hints by @dtrifiro in https://github.com/iterative/dvc/pull/8430
deps: bump dvc-data to 0.31.3 by @efiop in https://github.com/iterative/dvc/pull/8816
deps: bump dvc-data to 0.31.4 by @efiop in https://github.com/iterative/dvc/pull/8818
use dvc-data/dvc-objects batching by @pmrowla in https://github.com/iterative/dvc/pull/8805
exp: drop some words from exp names by @dberenbaum in https://github.com/iterative/dvc/pull/8811
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/iterative/dvc/pull/8830
output.remove: Pass explicit recursive flag by @daavoo in https://github.com/iterative/dvc/pull/8825

Full Changelog: https://github.com/iterative/dvc/compare/2.41.1...2.42.0

Open source →

2.41.111 Jan 2023

What's Changed

⚡ Optimizations

deps: bump dvc-data to 0.29.0 by @efiop in https://github.com/iterative/dvc/pull/8791

Full Changelog: https://github.com/iterative/dvc/compare/2.41.0...2.41.1

Open source →

2.41.011 Jan 2023

What's Changed

🚀 New Features and Enhancements

repro: Disable run-cache if --no-commit. by @daavoo in https://github.com/iterative/dvc/pull/8718
metrics/params: diff: don't show diff if active branch is the same as workspace by @dberenbaum in https://github.com/iterative/dvc/pull/8716
import-url: Update options order by @jorgeorpinel in https://github.com/iterative/dvc/pull/8785

⚡ Optimizations

cloud versioning: fix push/fetch performance by @pmrowla in https://github.com/iterative/dvc/pull/8766
deps: bump dvc-data to 0.28.6 by @pmrowla in https://github.com/iterative/dvc/pull/8790

🔨 Maintenance

build(deps-dev): Bump pylint from 2.15.9 to 2.15.10 by @dependabot in https://github.com/iterative/dvc/pull/8784

Other Changes

gha: remove env vars SHELL by @skshetry in https://github.com/iterative/dvc/pull/8737

Full Changelog: https://github.com/iterative/dvc/compare/2.40.0...2.41.0

Open source →

2.40.08 Jan 2023

What's Changed

⚡ Optimizations

dvcfs: ls: don't call info() by @efiop in https://github.com/iterative/dvc/pull/8779
ls: compute relparts once for every dir by @efiop in https://github.com/iterative/dvc/pull/8780

Full Changelog: https://github.com/iterative/dvc/compare/2.39.0...2.40.0

Open source →

2.39.06 Jan 2023

What's Changed

🚀 New Features and Enhancements

Add post_to_studio start and done calls. by @daavoo in https://github.com/iterative/dvc/pull/8688
post_live_metrics: Pass params on start event. by @daavoo in https://github.com/iterative/dvc/pull/8741
scm: add cause of clone errors by @dtrifiro in https://github.com/iterative/dvc/pull/8746
Use SIGINT as the default signal in queue kill by @karajan1001 in https://github.com/iterative/dvc/pull/8657
exp apply can accept exp names and failed exps as target by @karajan1001 in https://github.com/iterative/dvc/pull/8708

🐛 Bug Fixes

plots: fix regressions to top-level plots by @dberenbaum in https://github.com/iterative/dvc/pull/8703
Make temp dir executed checkpoint experiment return result to workspace. by @karajan1001 in https://github.com/iterative/dvc/pull/8668

🔨 Maintenance

build(deps-dev): Bump mypy from 0.990 to 0.991 by @dependabot in https://github.com/iterative/dvc/pull/8563
build(deps): Bump pyinstaller from 5.6.2 to 5.7.0 by @dependabot in https://github.com/iterative/dvc/pull/8655
build(deps-dev): Bump pylint from 2.15.8 to 2.15.9 by @dependabot in https://github.com/iterative/dvc/pull/8706
build(deps-dev): Bump dvc-render from 0.0.15 to 0.0.17 by @dependabot in https://github.com/iterative/dvc/pull/8725
build(deps-dev): Bump scmrepo from 0.1.4 to 0.1.5 by @dependabot in https://github.com/iterative/dvc/pull/8749
build(deps-dev): Bump filelock from 3.8.2 to 3.9.0 by @dependabot in https://github.com/iterative/dvc/pull/8745
internal: hoist resolver/top-level metrics/plots/params data to file level by @skshetry in https://github.com/iterative/dvc/pull/8754
build(deps-dev): Bump dvc-data from 0.28.4 to 0.28.5 by @dependabot in https://github.com/iterative/dvc/pull/8770

Other Changes

index: remove unused APIs by @skshetry in https://github.com/iterative/dvc/pull/8712
exp save: simplify implementation by @dtrifiro in https://github.com/iterative/dvc/pull/8690
exp run --run-all: re-enable --jobs concurrency by @PythonFZ in https://github.com/iterative/dvc/pull/8608
queue stop --kill can kill false running status tasks by @karajan1001 in https://github.com/iterative/dvc/pull/8713
exp save: update --help by @dtrifiro in https://github.com/iterative/dvc/pull/8729
update: prevent re-download on every update by @dtrifiro in https://github.com/iterative/dvc/pull/8752
exp: stop checking for unchanged experiments by @dberenbaum in https://github.com/iterative/dvc/pull/8743
exp save: fix help by @dtrifiro in https://github.com/iterative/dvc/pull/8758
config: expose http timeout in config schema by @dtrifiro in https://github.com/iterative/dvc/pull/8722

Full Changelog: https://github.com/iterative/dvc/compare/2.38.1...2.39.0

Open source →

2.38.115 Dec 2022

What's Changed

Other Changes

add index._plot_sources by @skshetry in https://github.com/iterative/dvc/pull/8693

Full Changelog: https://github.com/iterative/dvc/compare/2.38.0...2.38.1

Open source →

2.38.014 Dec 2022

What's Changed

🚀 New Features and Enhancements

exp: Generate a human-readable name beforehand. by @daavoo in https://github.com/iterative/dvc/pull/8659

🐛 Bug Fixes

Reset all indices on the brancher iteration by @shcheklein in https://github.com/iterative/dvc/pull/8679

🔨 Maintenance

build(deps-dev): Bump filelock from 3.8.0 to 3.8.2 by @dependabot in https://github.com/iterative/dvc/pull/8666
build(deps-dev): Bump pylint from 2.15.7 to 2.15.8 by @dependabot in https://github.com/iterative/dvc/pull/8661
build(deps-dev): Bump dvc-task from 0.1.6 to 0.1.8 by @dependabot in https://github.com/iterative/dvc/pull/8686

Full Changelog: https://github.com/iterative/dvc/compare/2.37.0...2.38.0

Open source →

2.37.09 Dec 2022

What's Changed

🐛 Bug Fixes

worktree: fix default worktree remote/odb exception by @pmrowla in https://github.com/iterative/dvc/pull/8672

🔨 Maintenance

deps: bump dvc-data to 0.28.4 by @pmrowla in https://github.com/iterative/dvc/pull/8674

Other Changes

dvc update: support worktree update by @pmrowla in https://github.com/iterative/dvc/pull/8649
remote: disable gc/status for versioned remotes by @pmrowla in https://github.com/iterative/dvc/pull/8662
cloud versioning: push/fetch behavior cleanup by @pmrowla in https://github.com/iterative/dvc/pull/8667
push/fetch: cleanup cloud versioning CLI flags behavior by @pmrowla in https://github.com/iterative/dvc/pull/8673
deps: remove 3.11 checks for hydra; has 3.11 support now by @skshetry in https://github.com/iterative/dvc/pull/8677

Full Changelog: https://github.com/iterative/dvc/compare/2.36.0...2.37.0

Open source →

2.36.01 Dec 2022

What's Changed

🚀 New Features and Enhancements

Solve the locking problem in temp and celery dir executor initialization. by @karajan1001 in https://github.com/iterative/dvc/pull/8623
exp: Expose baseline and name via run_env. by @daavoo in https://github.com/iterative/dvc/pull/8630
exp save: initial implementation by @daavoo in https://github.com/iterative/dvc/pull/8599
feat: top level params and metrics by @skshetry in https://github.com/iterative/dvc/pull/8529

🐛 Bug Fixes

index: skip data index load on empty view by @pmrowla in https://github.com/iterative/dvc/pull/8632
Solve the unexpected error at the end of the queued tasks running by @karajan1001 in https://github.com/iterative/dvc/pull/8640
plots: fix multi-file plots by @dberenbaum in https://github.com/iterative/dvc/pull/8639
stage add: don't fail if unable to create .gitignore by @dberenbaum in https://github.com/iterative/dvc/pull/8644

🔨 Maintenance

deps: add support for hdfs in Python 3.11 by @skshetry in https://github.com/iterative/dvc/pull/8627
exp list: cleanup and move logic inside repo api by @shcheklein in https://github.com/iterative/dvc/pull/8575
deps: bump dvc-data to 0.28.1 by @pmrowla in https://github.com/iterative/dvc/pull/8633
deps: bump dvc-data to 0.28.2 by @pmrowla in https://github.com/iterative/dvc/pull/8641
build(deps-dev): Bump pylint from 2.15.5 to 2.15.7 by @dependabot in https://github.com/iterative/dvc/pull/8643
deps: bump dvc-data to 0.28.3 by @pmrowla in https://github.com/iterative/dvc/pull/8648

Other Changes

remote: separate worktree vs version_aware behavior by @pmrowla in https://github.com/iterative/dvc/pull/8634

Full Changelog: https://github.com/iterative/dvc/compare/2.35.2...2.36.0

Open source →

2.35.224 Nov 2022

What's Changed

Other Changes

repro dry: show information if the stage is cached by @ykasimov in https://github.com/iterative/dvc/pull/8405

Full Changelog: https://github.com/iterative/dvc/compare/2.35.1...2.35.2

Open source →

2.35.123 Nov 2022

Full Changelog: https://github.com/iterative/dvc/compare/2.35.0...2.35.1

Open source →

2.35.023 Nov 2022

What's Changed

🚀 New Features and Enhancements

ui: Fix WSL check in open_browser by @daavoo in https://github.com/iterative/dvc/pull/8604

🔨 Maintenance

build: fpm: don't create .build-id/* files by @efiop in https://github.com/iterative/dvc/pull/8611

Other Changes

worktree push: do not push existing versions by @pmrowla in https://github.com/iterative/dvc/pull/8606
testing: api: test opening a file in subdir by @efiop in https://github.com/iterative/dvc/pull/8610

Full Changelog: https://github.com/iterative/dvc/compare/2.34.3...2.35.0

Open source →

2.34.322 Nov 2022

What's Changed

🐛 Bug Fixes

Fix exp list ref heads handling by @shcheklein in https://github.com/iterative/dvc/pull/8554
parsing: Escape str interpolation in dict unpacking. by @daavoo in https://github.com/iterative/dvc/pull/8204
hydra: Use OmegaConf.to_yaml for dumping .yaml output. by @daavoo in https://github.com/iterative/dvc/pull/8587
queue kill: we can manually mark problematic tasks as failure by @karajan1001 in https://github.com/iterative/dvc/pull/8580
Solve the wrong checkpoint tip info during executor running by @karajan1001 in https://github.com/iterative/dvc/pull/8596

🔨 Maintenance

build(deps-dev): Bump dvc-render from 0.0.12 to 0.0.13 by @dependabot in https://github.com/iterative/dvc/pull/8568
build(deps-dev): Bump dvc-render from 0.0.13 to 0.0.14 by @dependabot in https://github.com/iterative/dvc/pull/8591
deps: bump dvc-data, dvc-azure by @pmrowla in https://github.com/iterative/dvc/pull/8594
deps: bump dvc-data to 0.28.0 by @pmrowla in https://github.com/iterative/dvc/pull/8605

Other Changes

deps: bump dvc-data to 0.26.0 by @efiop in https://github.com/iterative/dvc/pull/8566
import-url: disable push by default for cloud-versioned imports by @pmrowla in https://github.com/iterative/dvc/pull/8578
plots: data conversion: adjust for viewer backend by @pared in https://github.com/iterative/dvc/pull/8421
worktree: support push: false by @pmrowla in https://github.com/iterative/dvc/pull/8581
worktree add: preserve version metadata for unmodified files on dvc add by @pmrowla in https://github.com/iterative/dvc/pull/8595
plots: set default x label by @dberenbaum in https://github.com/iterative/dvc/pull/8589

Full Changelog: https://github.com/iterative/dvc/compare/2.34.2...2.34.3

Open source →

2.34.215 Nov 2022

What's Changed

🐛 Bug Fixes

hydra: Raise error when name and sweeps. by @daavoo in https://github.com/iterative/dvc/pull/8556
fetch/pull: fix regression when using targeted fetch in repo containing import-url imports by @pmrowla in https://github.com/iterative/dvc/pull/8551

🔨 Maintenance

pyinstaller: use pydrive2 package hooks by @pmrowla in https://github.com/iterative/dvc/pull/8564

Full Changelog: https://github.com/iterative/dvc/compare/2.34.1...2.34.2

Open source →

2.34.111 Nov 2022

What's Changed

🐛 Bug Fixes

Make exp show handle errors better by @karajan1001 in https://github.com/iterative/dvc/pull/8533
Solve the crash on getting name of applied experiment branch by @karajan1001 in https://github.com/iterative/dvc/pull/8541
Fix some celery queue related ci failure. by @karajan1001 in https://github.com/iterative/dvc/pull/8404

🔨 Maintenance

index: support filtering view by output by @pmrowla in https://github.com/iterative/dvc/pull/8537
dvc exceptions CyclicGraphError: add more clear message for the excep… by @ykasimov in https://github.com/iterative/dvc/pull/8263
build(deps-dev): Bump dvc-task from 0.1.4 to 0.1.5 by @dependabot in https://github.com/iterative/dvc/pull/8539
build(deps-dev): Bump dvc-gs from 2.19.1 to 2.20.0 by @dependabot in https://github.com/iterative/dvc/pull/8548
build(deps-dev): Bump mypy from 0.982 to 0.990 by @dependabot in https://github.com/iterative/dvc/pull/8535
build(deps-dev): Bump iterative-telemetry from 0.0.5 to 0.0.6 by @dependabot in https://github.com/iterative/dvc/pull/8538

Other Changes

plots: support svg by @blakeNaccarato in https://github.com/iterative/dvc/pull/8542

New Contributors

@blakeNaccarato made their first contribution in https://github.com/iterative/dvc/pull/8542

Full Changelog: https://github.com/iterative/dvc/compare/2.34.0...2.34.1

Open source →

2.34.07 Nov 2022

What's Changed

🔨 Maintenance

hydra: Raise lazy DvcException for Python >= 3.11 by @daavoo in https://github.com/iterative/dvc/pull/8521
build(deps-dev): Bump dvc-s3 from 2.20.1 to 2.21.0 by @dependabot in https://github.com/iterative/dvc/pull/8524

Other Changes

plots: allow top-level strings by @dberenbaum in https://github.com/iterative/dvc/pull/8482
import-url: include files entry for cloud versioned dir dependencies by @pmrowla in https://github.com/iterative/dvc/pull/8528
ci: bench: use 3.11 in benchmarks by @skshetry in https://github.com/iterative/dvc/pull/8525
fix hydra_sweeps referenced before assignment by @dberenbaum in https://github.com/iterative/dvc/pull/8530
DVCLive 1.0 by @daavoo in https://github.com/iterative/dvc/pull/8532

Full Changelog: https://github.com/iterative/dvc/compare/2.33.2...2.34.0

Open source →

2.33.23 Nov 2022

What's Changed

🐛 Bug Fixes

commit: skip changed_entries check on force commit by @pmrowla in https://github.com/iterative/dvc/pull/8505
exp run: catch hydra import in 3.11 by @pmrowla in https://github.com/iterative/dvc/pull/8519

🔨 Maintenance

build(deps-dev): Bump pylint from 2.15.4 to 2.15.5 by @dependabot in https://github.com/iterative/dvc/pull/8463
build(deps-dev): Bump pytest from 7.1.3 to 7.2.0 by @dependabot in https://github.com/iterative/dvc/pull/8479
build(deps): Bump pyinstaller from 5.0 to 5.6.1 by @dependabot in https://github.com/iterative/dvc/pull/8475
build(deps-dev): Bump pytest-xdist from 2.5.0 to 3.0.2 by @dependabot in https://github.com/iterative/dvc/pull/8474
build(deps): Bump pyinstaller from 5.6.1 to 5.6.2 by @dependabot in https://github.com/iterative/dvc/pull/8499
build: bump pyinstaller packages python version to 3.10 by @skshetry in https://github.com/iterative/dvc/pull/8511
deps: bump scmrepo to 0.1.3 by @pmrowla in https://github.com/iterative/dvc/pull/8520

New Contributors

@step-security-bot made their first contribution in https://github.com/iterative/dvc/pull/8496

Full Changelog: https://github.com/iterative/dvc/compare/2.33.1...2.33.2

Open source →

2.33.131 Oct 2022

deps: bump dvc-data to 0.25.2 by @efiop in https://github.com/iterative/dvc/pull/8489

What's Changed

deps: bump dvc-data to 0.25.2 by @efiop in https://github.com/iterative/dvc/pull/8489

Full Changelog: https://github.com/iterative/dvc/compare/2.33.0...2.33.1

Open source →

2.33.030 Oct 2022

deps: bump dvc-data to 0.25.1 by @efiop in https://github.com/iterative/dvc/pull/8487

What's Changed

deps: bump dvc-data to 0.25.1 by @efiop in https://github.com/iterative/dvc/pull/8487

Full Changelog: https://github.com/iterative/dvc/compare/2.32.1...2.33.0

Open source →

2.32.129 Oct 2022

yappi: add --yappi-separate-threads flag by @efiop in https://github.com/iterative/dvc/pull/8485

What's Changed

yappi: add --yappi-separate-threads flag by @efiop in https://github.com/iterative/dvc/pull/8485

Full Changelog: https://github.com/iterative/dvc/compare/2.32.0...2.32.1

Open source →

2.32.029 Oct 2022

Use celery status as the exp show status by @karajan1001 in https://github.com/iterative/dvc/pull/8369

What's Changed

Use celery status as the exp show status by @karajan1001 in https://github.com/iterative/dvc/pull/8369
index: support multiple targets within output in IndexView by @efiop in https://github.com/iterative/dvc/pull/8471
auto solve corrupted rwlock info by @karajan1001 in https://github.com/iterative/dvc/pull/8469

Full Changelog: https://github.com/iterative/dvc/compare/2.31.0...2.32.0

Open source →

2.31.021 Oct 2022

> Refer to https://dvc.org/doc/install for installation instructions.

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🔨 Maintenance

build(deps): Bump dvc-data from 0.20.0 to 0.22.0 (#8459) @dependabot

Thanks again to @dependabot, @dependabot[bot] and @efiop for the contributions! 🎉

Open source →

2.30.121 Oct 2022

> Refer to https://dvc.org/doc/install for installation instructions.

Refer to https://dvc.org/doc/install for installation instructions.

Changes

import-url: use dvc-data index.save() for fetching imports (#8249) @pmrowla
[pre-commit.ci] pre-commit autoupdate (#8441) @pre-commit-ci
plots: allow definition of plots section as list (#8412) @dtrifiro
config: ssh: Add passphrase, ask_passphrase (#8143) @daavoo
index: add IndexView, brancher: support index (#8407) @pmrowla
ignore: walk: support detail=True (#8398) @efiop

🚀 New Features and Enhancements

exp show: Preserve full branch and tag names. (#8425) @daavoo

🏇 Optimizations

exp show: Use batch call on scm.describe (#8453) @karajan1001

🐛 Bug Fixes

Give lock acquiring more time in concurrency situation. (#8436) @karajan1001
exp show: Preserve full branch and tag names. (#8425) @daavoo

🔨 Maintenance

build(deps): Bump dvc-task from 0.1.3 to 0.1.4 (#8447) @dependabot
deps: bump dvc-data to 0.20.0 (#8443) @pmrowla
build(deps-dev): Bump pylint from 2.15.2 to 2.15.4 (#8424) @dependabot
build(deps): Bump dvc-data from 0.18.0 to 0.19.0 (#8442) @dependabot
build(deps-dev): Bump pytest-mock from 3.9.0 to 3.10.0 (#8402) @dependabot
deps: bump dvc-data to 0.18.0 (#8432) @pmrowla
[pre-commit.ci] pre-commit autoupdate (#8422) @pre-commit-ci

Thanks again to @daavoo, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @karajan1001, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Open source →

2.30.010 Oct 2022

exp show :Add --hide-queued and --hide-failed flag by @karajan1001 in https://github.com/iterative/dvc/pull/8318

What's Changed

exp show :Add --hide-queued and --hide-failed flag by @karajan1001 in https://github.com/iterative/dvc/pull/8318
build(deps): Bump dvc-render from 0.0.11 to 0.0.12 by @dependabot in https://github.com/iterative/dvc/pull/8401
Refactor dvc get-url by @rlamy in https://github.com/iterative/dvc/pull/8410
deps: bump dvc-data to 0.17.1 by @pmrowla in https://github.com/iterative/dvc/pull/8416

Full Changelog: https://github.com/iterative/dvc/compare/2.29.0...2.30.0

Open source →

2.29.04 Oct 2022

> Refer to https://dvc.org/doc/install for installation instructions.

Refer to https://dvc.org/doc/install for installation instructions.

Changes

hydra: Fix append and remove sweeps. (#8381) @daavoo
Create basic version of dvc ls-url command (#8299) @rlamy
deps: bump dvc-data to 0.14.0 (#8389) @efiop
dvcfs tests: copy pytest param instead of in-place update (#8388) @skshetry
Rename dvc.testing.test_*.py (#8386) @rlamy
cli: remove foreach-group from help text (#8383) @dberenbaum
[pre-commit.ci] pre-commit autoupdate (#8367) @pre-commit-ci

🐛 Bug Fixes

repo: fix crash while collecting stages with symlinks (#8364) @dtrifiro
import: fix rev lock and pull with --no-download (#8341) @dtrifiro
config: wrap UnicodeDecodeErrors on load (#8380) @pmrowla

🔨 Maintenance

logger: init logging config before colorama (#8395) @pmrowla
build(deps-dev): Bump mypy from 0.981 to 0.982 (#8393) @dependabot
build(deps-dev): Bump mypy from 0.971 to 0.981 (#8368) @dependabot
config: wrap UnicodeDecodeErrors on load (#8380) @pmrowla
build(deps-dev): Bump pytest-mock from 3.8.2 to 3.9.0 (#8378) @dependabot
build(deps-dev): Bump pytest-cov from 3.0.0 to 4.0.0 (#8379) @dependabot
build(deps): Bump dvc-task from 0.1.2 to 0.1.3 (#8377) @dependabot

Thanks again to @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot], @rlamy and @skshetry for the contributions! 🎉

Open source →

2.28.027 Sept 2022

> Refer to https://dvc.org/doc/install for installation instructions.

Refer to https://dvc.org/doc/install for installation instructions.

Changes

vscode: support flexible plots (#8282) @pared
pull: hide glob option (#8337) @dberenbaum
deps: bump codespell (#8199) @pared
import/import-url: ignore outs when using --no-download (#8343) @dtrifiro
fixed link to "get started: pipelines" docs (#8340) @MartinoMensio

🚀 New Features and Enhancements

exp show: sync state between queue and exp show table (#8158) @karajan1001
merge-driver: support removes and changes (#8360) @dberenbaum

🐛 Bug Fixes

cloud-versioning: better handling for directories (#8362) @efiop
Solve the on_diverged function not executed error. (#8351) @karajan1001
hydra: Fix sweeps on Defaults List. (#8308) @daavoo

🔨 Maintenance

build(deps): Bump dvc-data from 0.10.1 to 0.12.0 (#8346) @dependabot
deps: bump dvc-http to 2.27.2 (#8333) @dtrifiro
deps: bump dvc-data to 0.10.1 (#8330) @pmrowla

Thanks again to @MartinoMensio, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @karajan1001, @pared, @pmrowla and @skshetry for the contributions! 🎉

Open source →

Your coding agent can read these notes before it upgrades. Set up the MCP server →