dask

Released on May 28, 2021

Pandas compatibility ( dask#7712 ) Julia Signell

Fix optimize_dataframe_getitem bug ( dask#7698 ) Richard (Rick) Zamora

Update make_meta import in docs ( dask#7713 ) Benjamin Zaitlen

Implement da.searchsorted ( dask#7696 ) Tom White

Fix format string in error message ( dask#7706 ) Jiaming Yuan

Fix read_sql_table returning wrong result for single column loads ( dask#7572 ) c-thiel

Add slack join link in support.rst ( dask#7679 ) Naty Clementi

Remove unused alphabet variable ( dask#7700 ) James Bourbeau

Fix meta creation incase of object ( dask#7586 ) GALI PREM SAGAR

Add dispatch for union_categoricals ( dask#7699 ) GALI PREM SAGAR

Consolidate array Dispatch objects ( dask#7505 ) James Bourbeau

Move DataFrame dispatch.registers to their own file ( dask#7503 ) Julia Signell

Fix delayed with dataclasses where init=False ( dask#7656 ) Julia Signell

Allow a column to be named divisions ( dask#7605 ) Julia Signell

Stack nd array with unknown chunks ( dask#7562 ) Chris Roat

Promote the 2021 Dask User Survey ( dask#7694 ) Genevieve Buckley

Fix typo in DataFrame.set_index() ( dask#7691 ) James Lamb

Cleanup array API reference links ( dask#7684 ) David Hoese

Accept axis tuple for flip to be consistent with NumPy ( dask#7675 ) Andrew Champion

Bump pre-commit hook versions ( dask#7676 ) James Bourbeau

Cleanup to_zarr docstring ( dask#7683 ) David Hoese

Fix the docstring of read_orc ( dask#7678 ) Justus Magin

Doc ipyparallel & mpi4py concurrent.futures ( dask#7665 ) John A Kirkham

Update tests to support CuPy 9 ( dask#7671 ) Peter Andreas Entschev

Fix some HighLevelGraph documentation inaccuracies ( dask#7662 ) Mads R. B. Kristensen

Fix spelling in Series getitem error message ( dask#7659 ) Maisie Marshall

Released on May 14, 2021

Remove deprecated kind kwarg to comply with pandas 1.3.0 ( dask#7653 ) Julia Signell

Fix bug in DataFrame column projection ( dask#7645 ) Richard (Rick) Zamora

Merge global annotations when packing ( dask#7565 ) Mads R. B. Kristensen

Avoid inplace= in pandas set_categories ( dask#7633 ) James Bourbeau

Change the active-fusion default to False for Dask-Dataframe ( dask#7620 ) Richard (Rick) Zamora

Array: remove extraneous code from RandomState ( dask#7487 ) Gabe Joseph

Implement str.concat when others=None ( dask#7623 ) Daniel Mesejo-León

Fix dask.dataframe in sandboxed environments ( dask#7601 ) Noah D. Brenowitz

Support for cupyx.scipy.linalg ( dask#7563 ) Benjamin Zaitlen

Move timeseries and daily-stock to Blockwise ( dask#7615 ) Richard (Rick) Zamora

Fix bugs in broadcast join ( dask#7617 ) Richard (Rick) Zamora

Use Blockwise for DataFrame IO (parquet, csv, and orc) ( dask#7415 ) Richard (Rick) Zamora

Adding chunk & type information to Dask HighLevelGraph s ( dask#7309 ) Genevieve Buckley

Add pyarrow sphinx intersphinx_mapping ( dask#7612 ) Ray Bell

Remove skip on test freq ( dask#7608 ) Julia Signell

Defaults in read_parquet parameters ( dask#7567 ) Ray Bell

Remove ignore_abc_warning ( dask#7606 ) Julia Signell

Harden DataFrame merge between column-selection and index ( dask#7575 ) Richard (Rick) Zamora

Get rid of ignore_abc decorator ( dask#7604 ) Julia Signell

Remove kwarg validation for bokeh ( dask#7597 ) Julia Signell

Add loky example ( dask#7590 ) Naty Clementi

Delayed: nout when arguments become tasks ( dask#7593 ) Gabe Joseph

Update distributed version in mindep CI build ( dask#7602 ) James Bourbeau

Support all or no overlap between partition columns and real columns ( dask#7541 ) Richard (Rick) Zamora

Released on April 23, 2021

Handle Blockwise HLG pack/unpack for concatenate=True ( dask#7455 ) Richard (Rick) Zamora

map_partitions : use tokenized info as name of the SubgraphCallable ( dask#7524 ) Mads R. B. Kristensen

Using tmp_path and tmpdir to avoid temporary files and directories hanging in the repo ( dask#7592 ) Naty Clementi

Contributing to docs (development guide) ( dask#7591 ) Naty Clementi

Add more packages to Python 3.9 CI build ( dask#7588 ) James Bourbeau

Array: Fix NEP-18 dispatching in finalize ( dask#7508 ) Gabe Joseph

Misc fixes for numpydoc ( dask#7569 ) Matthias Bussonnier

Avoid pandas level= keyword deprecation ( dask#7577 ) James Bourbeau

Map e.g. .repartition(freq="M") to .repartition(freq="MS") ( dask#7504 ) Ruben van de Geer

Remove hash seeding in parallel CI runs ( dask#7128 ) Elliott Sales de Andrade

Add defaults in parameters in to_parquet ( dask#7564 ) Ray Bell

Simplify transpose axes cleanup ( dask#7561 ) Julia Signell

Make ValueError in len(index_names) > 1 explicit it’s using fastparquet ( dask#7556 ) Ray Bell

Fix dict -column appending for pyarrow parquet engines ( dask#7527 ) Richard (Rick) Zamora

Add a documentation auto label ( dask#7560 ) Doug Davis

Add dask.delayed.Delayed to docs so it can be referenced by other sphinx docs ( dask#7559 ) Doug Davis

Fix upstream idxmaxmin for uneven split_every ( dask#7538 ) Julia Signell

Make normalize_token for pandas Series / DataFrame future proof (no direct block access) ( dask#7318 ) Joris Van den Bossche

Redesigned setitem implementation ( dask#7393 ) David Hassell

histogram , histogramdd improvements (docs; return consistencies) ( dask#7520 ) Doug Davis

Force nightly pyarrow in the upstream build ( dask#7530 ) Joris Van den Bossche

Fix Configuration Reference ( dask#7533 ) Benjamin Zaitlen

Use .to_parquet on dask.dataframe in doc string ( dask#7528 ) Ray Bell

Avoid double msgpack serialization of HLGs ( dask#7525 ) Mads R. B. Kristensen

Encourage usage of yaml.safe_load() in configuration doc ( dask#7529 ) Hristo Georgiev

Fix reshape bug. Add relevant test. Fixes #7171. ( dask#7523 ) JSKenyon

Support custom_metadata= argument in to_parquet ( dask#7359 ) Richard (Rick) Zamora

Clean some documentation warnings ( dask#7518 ) Daniel Mesejo-León

Getting rid of more docs warnings ( dask#7426 ) Julia Signell

Added product (alias of prod ) ( dask#7517 ) Freyam Mehta

Fix upstream array_ufunc tests ( dask#7494 ) Julia Signell

Escape from map_overlap to map_blocks if depth is zero ( dask#7481 ) Genevieve Buckley

Add check_type to array assert_eq ( dask#7491 ) Julia Signell

Released on April 2, 2021

Adding support for multidimensional histograms with dask.array.histogramdd ( dask#7387 ) Doug Davis

Update docs on number of threads and workers in default LocalCluster ( dask#7497 ) cameron16

Add labels automatically when certain files are touched in a PR ( dask#7506 ) Julia Signell

Extract ignore_order from kwargs ( dask#7500 ) GALI PREM SAGAR

Only provide installation instructions when distributed is missing ( dask#7498 ) Matthew Rocklin

Start adding isort ( dask#7370 ) Julia Signell

Add ignore_order parameter in dd.concat ( dask#7473 ) Daniel Mesejo-León

Use powers-of-two when displaying RAM ( dask#7484 ) crusaderky

Added License Classifier ( dask#7485 ) Tom Augspurger

Replace conda with mamba ( dask#7227 ) crusaderky

Fix typo in array docs ( dask#7478 ) James Lamb

Use concurrent.futures in local scheduler ( dask#6322 ) John A Kirkham

Released on March 26, 2021

Add a dispatch for is_categorical_dtype to handle non-pandas objects ( dask#7469 ) brandon-b-miller

Use multiprocessing.Pool in test_read_text ( dask#7472 ) John A Kirkham

Add missing meta kwarg to gufunc class ( dask#7423 ) Peter Andreas Entschev

Example for memory-mapped Dask array ( dask#7380 ) Dieter Weber

Fix NumPy upstream failures xfail pandas and fastparquet failures ( dask#7441 ) Julia Signell

Fix bug in repartition with freq ( dask#7357 ) Ruben van de Geer

Fix array_function dispatching for tril / triu ( dask#7457 ) Peter Andreas Entschev

Use concurrent.futures.Executors in a few tests ( dask#7429 ) John A Kirkham

Require NumPy >=1.16 ( dask#7383 ) crusaderky

Minor sort_values housekeeping ( dask#7462 ) Ryan Williams

Ensure natural sort order in parquet part paths ( dask#7249 ) Ryan Williams

Remove global env mutation upon running test_config.py ( dask#7464 ) Hristo Georgiev

Update NumPy intersphinx URL ( dask#7460 ) Gabe Joseph

Add rot90 ( dask#7440 ) Trevor Manz

Update docs for required package for endpoint ( dask#7454 ) Nick Vazquez

Master -> main in slice_array docstring ( dask#7453 ) Gabe Joseph

Expand dask.utils.is_arraylike docstring ( dask#7445 ) Doug Davis

Simplify BlockwiseIODeps importing ( dask#7420 ) Richard (Rick) Zamora

Update layer annotation packing method ( dask#7430 ) James Bourbeau

Drop duplicate test in test_describe_empty ( dask#7431 ) John A Kirkham

Add Series.dot method to dataframe module ( dask#7236 ) Madhu94

Added df kurtosis -method and testing ( dask#7273 ) Jan Borchmann

Avoid quadratic-time performance for HLG culling ( dask#7403 ) Bruce Merry

Temporarily skip problematic sparse test ( dask#7421 ) James Bourbeau

Update some CI workflow names ( dask#7422 ) James Bourbeau

Fix HDFS test ( dask#7418 ) Julia Signell

Make changelog subtitles match the hierarchy ( dask#7419 ) Julia Signell

Add support for normalize in value_counts ( dask#7342 ) Julia Signell

Avoid unnecessary imports for HLG Layer unpacking and materialization ( dask#7381 ) Richard (Rick) Zamora

Bincount fix slicing ( dask#7391 ) Genevieve Buckley

Add sliding_window_view ( dask#7234 ) Deepak Cherian

Fix typo in docs/source/develop.rst ( dask#7414 ) Hristo Georgiev

Switch documentation builds for PRs to readthedocs ( dask#7397 ) James Bourbeau

Adds sort_values to dask.DataFrame ( dask#7286 ) gerrymanoim

Pin sqlalchemy<1.4.0 in CI ( dask#7405 ) James Bourbeau

Comment fixes ( dask#7215 ) Ryan Williams

Dead code removal / fixes ( dask#7388 ) Ryan Williams

Use single thread for pa.Table.from_pandas calls ( dask#7347 ) Richard (Rick) Zamora

Replace 'container' with 'image' ( dask#7389 ) James Lamb

DOC hyperlink repartition ( dask#7394 ) Ray Bell

Pass delimiter to fsspec in bag.read_text ( dask#7349 ) Martin Durant

Update read_hdf default mode to "r" ( dask#7039 ) rs9w33

Embed literals in SubgraphCallable when packing Blockwise ( dask#7353 ) Mads R. B. Kristensen

Update test_hdf.py to not reuse file handlers ( dask#7044 ) rs9w33

Require additional dependencies: cloudpickle, partd, fsspec, toolz ( dask#7345 ) Julia Signell

Prepare Blockwise + IO infrastructure ( dask#7281 ) Richard (Rick) Zamora

Remove duplicated imports from test_slicing.py ( dask#7365 ) Hristo Georgiev

Add test deps for pip development ( dask#7360 ) Julia Signell

Support int slicing for non-NumPy arrays ( dask#7364 ) Peter Andreas Entschev

Automatically cancel previous CI builds ( dask#7348 ) James Bourbeau

dask.array.asarray should handle case where xarray class is in top-level namespace ( dask#7335 ) Tom White

HighLevelGraph length without materializing layers ( dask#7274 ) Gabe Joseph

Drop support for Python 3.6 ( dask#7006 ) James Bourbeau

Fix fsspec usage in create_metadata_file ( dask#7295 ) Richard (Rick) Zamora

Change default branch from master to main ( dask#7198 ) Julia Signell

Add Xarray to CI software environment ( dask#7338 ) James Bourbeau

Update repartition argument name in error text ( dask#7336 ) Eoin Shanaghy

Run upstream tests based on commit message ( dask#7329 ) James Bourbeau

Use pytest.register_assert_rewrite on util modules ( dask#7278 ) Bruce Merry

Add example on using specific chunk sizes in from_array() ( dask#7330 ) James Lamb

Move NumPy skip into test ( dask#7247 ) Julia Signell

Released on March 5, 2021

Note

This is the first release with support for Python 3.9 and the last release with support for Python 3.6

Bump minimum version of distributed ( dask#7328 ) James Bourbeau

Fix percentiles_summary with dask_cudf ( dask#7325 ) Peter Andreas Entschev

Temporarily revert recent Array.setitem updates ( dask#7326 ) James Bourbeau

Blockwise.clone ( dask#7312 ) crusaderky

NEP-35 duck array update ( dask#7321 ) James Bourbeau

Don’t allow setting .name for array ( dask#7222 ) Julia Signell

Use nearest interpolation for creating percentiles of integer input ( dask#7305 ) Kyle Barron

Test exp with CuPy arrays ( dask#7322 ) John A Kirkham

Check that computed chunks have right size and dtype ( dask#7277 ) Bruce Merry

pytest.mark.flaky ( dask#7319 ) crusaderky

Contributing docs: add note to pull the latest git tags before pip installing Dask ( dask#7308 ) Genevieve Buckley

Support for Python 3.9 ( dask#7289 ) crusaderky

Add broadcast-based merge implementation ( dask#7143 ) Richard (Rick) Zamora

Add split_every to graph_manipulation ( dask#7282 ) crusaderky

Typo in optimize docs ( dask#7306 ) Julius Busecke

dask.graph_manipulation support for xarray.Dataset ( dask#7276 ) crusaderky

Add plot width and height support for Bokeh 2.3.0 ( dask#7297 ) James Bourbeau

Add NumPy functions tri , triu_indices , triu_indices_from , tril_indices , tril_indices_from ( dask#6997 ) Illviljan

Remove “cleanup” task in DataFrame on-disk shuffle ( dask#7260 ) Sinclair Target

Use development version of distributed in CI ( dask#7279 ) James Bourbeau

Moving high level graph pack/unpack Dask ( dask#7179 ) Mads R. B. Kristensen

Improve performance of merge_percentiles ( dask#7172 ) Ashwin Srinath

DOC: add dask-sql and fugue ( dask#7129 ) Ray Bell

Example for working with categoricals and parquet ( dask#7085 ) McToel

Adds tree reduction to bincount ( dask#7183 ) Thomas J. Fan

Improve documentation of name in from_array ( dask#7264 ) Bruce Merry

Fix cumsum for empty partitions ( dask#7230 ) Julia Signell

Add map_blocks example to dask array creation docs ( dask#7221 ) Julia Signell

Fix performance issue in dask.graph_manipulation.wait_on() ( dask#7258 ) crusaderky

Replace coveralls with codecov.io ( dask#7246 ) crusaderky

Pin to a particular black rev in pre-commit ( dask#7256 ) Julia Signell

Minor typo in documentation: array-chunks.rst ( dask#7254 ) Magnus Nord

Fix bugs in Blockwise and ShuffleLayer ( dask#7213 ) Richard (Rick) Zamora

Fix parquet filtering bug for "pyarrow-dataset" with pyarrow-3.0.0 ( dask#7200 ) Richard (Rick) Zamora

graph_manipulation without NumPy ( dask#7243 ) crusaderky

Support for NEP-35 ( dask#6738 ) Peter Andreas Entschev

Avoid running unit tests during doctest CI build ( dask#7240 ) James Bourbeau

Run doctests on CI ( dask#7238 ) Julia Signell

Cleanup code quality on set arithmetics ( dask#7196 ) crusaderky

Add dask.array.delete ( dask#7125 ) Julia Signell

Unpin graphviz now that new conda-forge recipe is built ( dask#7235 ) Julia Signell

Don’t use NumPy 1.20 from conda-forge on Mac ( dask#7211 ) crusaderky

map_overlap : Don’t rechunk axes without overlap ( dask#7233 ) Deepak Cherian

Pin graphviz to avoid issue with latest conda-forge build ( dask#7232 ) Julia Signell

Use html_css_files in docs for custom CSS ( dask#7220 ) James Bourbeau

Graph manipulation: clone , bind , checkpoint , wait_on ( dask#7109 ) crusaderky

Fix handling of filter expressions in parquet pyarrow-dataset engine ( dask#7186 ) Joris Van den Bossche

Extend setitem to more closely match numpy ( dask#7033 ) David Hassell

Clean up Python 2 syntax ( dask#7195 ) crusaderky

Fix regression in Delayed._length ( dask#7194 ) crusaderky

dask_layers() tests and tweaks ( dask#7177 ) crusaderky

Properly convert HighLevelGraph in multiprocessing scheduler ( dask#7191 ) Jim Crist-Harif

Don’t fail fast in CI ( dask#7188 ) James Bourbeau

Released on February 5, 2021

Add percentile support for NEP-35 ( dask#7162 ) Peter Andreas Entschev

Added support for Float64 in column assignment ( dask#7173 ) Nils Braun

Coarsen rechunking error ( dask#7127 ) Davis Bennett

Fix upstream CI tests ( dask#6896 ) Julia Signell

Revise HighLevelGraph Mapping API ( dask#7160 ) crusaderky

Update low-level graph spec to use any hashable for keys ( dask#7163 ) James Bourbeau

Generically rebuild a collection with different keys ( dask#7142 ) crusaderky

Make easier to link issues in PRs ( dask#7130 ) Ray Bell

Add dask.array.append ( dask#7146 ) D-Stacks

Allow dask.array.ravel to accept array_like argument ( dask#7138 ) D-Stacks

Fixes link in array design doc ( dask#7152 ) Thomas J. Fan

Fix example of using blockwise for an outer product ( dask#7119 ) Bruce Merry

Deprecate HighlevelGraph.dicts in favor of .layers ( dask#7145 ) Amit Kumar

Align FastParquetEngine with pyarrow engines ( dask#7091 ) Richard (Rick) Zamora

Merge annotations ( dask#7102 ) Ian Rose

Simplify contents of parts list in read_parquet ( dask#7066 ) Richard (Rick) Zamora

check_meta( ): use class when checking DataFrame types ( dask#7099 ) Mads R. B. Kristensen

Cache several properties ( dask#7104 ) Illviljan

Fix parquet getitem optimization ( dask#7106 ) Richard (Rick) Zamora

Add cytoolz back to CI environment ( dask#7103 ) James Bourbeau

Released on January 22, 2021

Partially fix cumprod ( dask#7089 ) Julia Signell

Test pandas 1.1.x / 1.2.0 releases and pandas nightly ( dask#6996 ) Joris Van den Bossche

Use assign to avoid SettingWithCopyWarning ( dask#7092 ) Julia Signell

'mode' argument passed to bokeh.output_file() ( dask#7034 ) ( dask#7075 ) patquem

Skip empty partitions when doing groupby.value_counts ( dask#7073 ) Julia Signell

Add error messages to assert_eq() ( dask#7083 ) James Lamb

Make cached properties read-only ( dask#7077 ) Illviljan

Released on January 15, 2021

map_partitions with review comments ( dask#6776 ) Kumar Bharath Prabhu

Make sure that population is a real list ( dask#7027 ) Julia Signell

Propagate storage_options in read_csv ( dask#7074 ) Richard (Rick) Zamora

Remove all BlockwiseIO code ( dask#7067 ) Richard (Rick) Zamora

Fix CI ( dask#7069 ) James Bourbeau

Add option to control rechunking in reshape ( dask#6753 ) Tom Augspurger

Fix linalg.lstsq for complex inputs ( dask#7056 ) Johnnie Gray

Add compression='infer' default to read_csv ( dask#6960 ) Richard (Rick) Zamora

Revert parameter changes in svd_compressed #7003 ( dask#7004 ) Eric Czech

Skip failing s3 test ( dask#7064 ) Martin Durant

Revert BlockwiseIO ( dask#7048 ) Richard (Rick) Zamora

Add some cross-references to DataFrame.to_bag() and Series.to_bag() ( dask#7049 ) Rob Malouf

Rewrite matmul as blockwise without contraction/concatenate ( dask#7000 ) Rafal Wojdyla

Use functools.cached_property in da.shape ( dask#7023 ) Illviljan

Use meta value in series non_empty ( dask#6976 ) Julia Signell

Revert “Temporarly pin sphinx version to 3.3.1 ( dask#7002 )” ( dask#7014 ) Rafal Wojdyla

Revert python-graphviz pinning ( dask#7037 ) Julia Signell

Accidentally committed print statement ( dask#7038 ) Julia Signell

Pass dropna and observed in agg ( dask#6992 ) Julia Signell

Add index to meta after .str.split with expand ( dask#7026 ) Ruben van de Geer

CI: test pyarrow 2.0 and nightly ( dask#7030 ) Joris Van den Bossche

Temporarily pin python-graphviz in CI ( dask#7031 ) James Bourbeau

Underline section in numpydoc ( dask#7013 ) Matthias Bussonnier

Keep normal optimizations when adding custom optimizations ( dask#7016 ) Matthew Rocklin

Temporarily pin sphinx version to 3.3.1 ( dask#7002 ) Rafal Wojdyla

DOC: Misc formatting ( dask#6998 ) Matthias Bussonnier

Add inline_array option to from_array ( dask#6773 ) Tom Augspurger

Revert “Initial pass at blockwise array creation routines ( dask#6931)” (:pr:`6995 ) James Bourbeau

Set npartitions in set_index ( dask#6978 ) Julia Signell

Upstream config serialization and inheritance ( dask#6987 ) Jacob Tomlinson

Bump the minimum time in test_minimum_time ( dask#6988 ) Martin Durant

Fix pandas dtype inference for read_parquet ( dask#6985 ) Richard (Rick) Zamora

Avoid data loss in set_index with sorted=True ( dask#6980 ) Richard (Rick) Zamora

Bugfix in read_parquet for handling un-named indices with index=False ( dask#6969 ) Richard (Rick) Zamora

Use class when comparing meta data ( dask#6981 ) Mads R. B. Kristensen

Comparing string versions won’t always work ( dask#6979 ) Rafal Wojdyla

Fix dask#6925 ( dask#6982 ) sdementen

Initial pass at blockwise array creation routines ( dask#6931 ) Ian Rose

Simplify has_parallel_type() ( dask#6927 ) Mads R. B. Kristensen

Handle annotation unpacking in BlockwiseIO ( dask#6934 ) Simon Perkins

Avoid deprecated yield_fixture in test_sql.py ( dask#6968 ) Richard (Rick) Zamora

Remove bad graph logic in BlockwiseIO ( dask#6933 ) Richard (Rick) Zamora

Get config item if variable is None ( dask#6862 ) Jacob Tomlinson

Update from_pandas docstring ( dask#6957 ) Richard (Rick) Zamora

Prevent fuse_roots from clobbering annotations ( dask#6955 ) Simon Perkins

Released on December 10, 2020

Highlights

Switched to CalVer for versioning scheme.

Introduced new APIs for HighLevelGraph to enable sending high-level representations of task graphs to the distributed scheduler.

Introduced new HighLevelGraph layer objects including BasicLayer , Blockwise , BlockwiseIO , ShuffleLayer , and more.

Added support for applying custom Layer -level annotations like priority , retries , etc. with the dask.annotations context manager.

Updated minimum supported version of pandas to 0.25.0 and NumPy to 1.15.1.

Support for the pyarrow.dataset API to read_parquet .

Several fixes to Dask Array’s SVD.

All changes

Make observed kwarg optional ( dask#6952 ) Julia Signell

Min supported pandas 0.25.0 numpy 1.15.1 ( dask#6895 ) Julia Signell

Make order of categoricals unambiguous ( dask#6949 ) Julia Signell

Improve “pyarrow-dataset” statistics performance for read_parquet ( dask#6918 ) Richard (Rick) Zamora

Add observed keyword to groupby ( dask#6854 ) Julia Signell

Make sure include_path_column works when there are multiple partitions per file ( dask#6911 ) Julia Signell

Fix: array.overlap and array.map_overlap block sizes are incorrect when depth is an unsigned bit type ( dask#6909 ) GFleishman

Fix syntax error in HLG docs example ( dask#6946 ) Mark

Return a Bag from sample ( dask#6941 ) Shang Wang

Add ravel_multi_index ( dask#6939 ) Illviljan

Enable parquet metadata collection in parallel ( dask#6921 ) Richard (Rick) Zamora

Avoid using _file in progressbar if it is None ( dask#6938 ) Mark Harfouche

Add Zarr to upstream CI build ( dask#6932 ) James Bourbeau

Introduce BlockwiseIO layer ( dask#6878 ) Richard (Rick) Zamora

Transmit Layer Annotations to Scheduler ( dask#6889 ) Simon Perkins

Update opportunistic caching page to remove experimental warning ( dask#6926 ) Timost

Allow pyarrow >2.0.0 ( dask#6772 ) Richard (Rick) Zamora

Support pyarrow.dataset API for read_parquet ( dask#6534 ) Richard (Rick) Zamora

Add more informative error message to da.coarsen when coarsening factors do not divide shape ( dask#6908 ) Davis Bennett

Only run the cron CI on dask/dask not forks ( dask#6905 ) Jacob Tomlinson

Add annotations to ShuffleLayers ( dask#6913 ) Matthew Rocklin

Temporarily xfail test_from_s3 ( dask#6915 ) James Bourbeau

Added dataframe skew method ( dask#6881 ) Jan Borchmann

Fix dtype in array meta ( dask#6893 ) Julia Signell

Missing name arg in helm install ... ( dask#6903 ) Ruben van de Geer

Fix: exception when reading an item with filters ( dask#6901 ) Martin Durant

Add support for cupyx sparse to dask.array.dot ( dask#6846 ) Akira Naruse

Pin array mindeps up a bit to get the tests to pass [test-mindeps] ( dask#6894 ) Julia Signell

Update/remove pandas and numpy in mindeps ( dask#6888 ) Julia Signell

Fix ArrowEngine bug in use of clear_known_categories ( dask#6887 ) Richard (Rick) Zamora

Fix documentation about task scheduler ( dask#6879 ) Zhengnan Zhao

Add human relative time formatting utility ( dask#6883 ) Jacob Tomlinson

Possible fix for 6864 set_index issue ( dask#6866 ) Richard (Rick) Zamora

BasicLayer : remove dependency arguments ( dask#6859 ) Mads R. B. Kristensen

Serialization of Blockwise ( dask#6848 ) Mads R. B. Kristensen

Address columns=[] bug ( dask#6871 ) Richard (Rick) Zamora

Avoid duplicate parquet schema communication ( dask#6841 ) Richard (Rick) Zamora

Add create_metadata_file utility for existing parquet datasets ( dask#6851 ) Richard (Rick) Zamora

Improve ordering for workloads with a common terminus ( dask#6779 ) Tom Augspurger

Stringify utilities ( dask#6852 ) Mads R. B. Kristensen

Add keyword overwrite=True to to_parquet to remove dangling files when overwriting a pyarrow Dataset . ( dask#6825 ) Greg Hayes

Removed map_tasks() and map_basic_layers() ( dask#6853 ) Mads R. B. Kristensen

Introduce QR iteration to svd_compressed ( dask#6813 ) RogerMoens

dask_distributed_pack() now takes a client argument ( dask#6850 ) Mads R. B. Kristensen

Use map_partitions instead of delayed in set_index ( dask#6837 ) Mads R. B. Kristensen

Add doc hit for as_completed().update(futures) ( dask#6817 ) manuels

Bump GHA setup-miniconda version ( dask#6847 ) Jacob Tomlinson

Remove nans when setting sorted index ( dask#6829 ) Rockwell Weiner

Fix transpose of u in SVD ( dask#6799 ) RogerMoens

Migrate to GitHub Actions ( dask#6794 ) Jacob Tomlinson

Fix sphinx currentmodule usage ( dask#6839 ) James Bourbeau

Fix minimum dependencies CI builds ( dask#6838 ) James Bourbeau

Avoid graph materialization during Blockwise culling ( dask#6815 ) Richard (Rick) Zamora

Fixed typo ( dask#6834 ) Devanshu Desai

Use HighLevelGraph.merge in collections_to_dsk ( dask#6836 ) Mads R. B. Kristensen

Respect dtype in svd compression_matrix #2849 ( dask#6802 ) RogerMoens

Add blocksize to task name ( dask#6818 ) Julia Signell

Check for all-NaN partitions ( dask#6821 ) Rockwell Weiner

Change “institutional” SQL doc section to point to main SQL doc ( dask#6823 ) Martin Durant

Fix: DataFrame.join doesn’t accept Series as other ( dask#6809 ) David Katz

Remove to_delayed operations from to_parquet ( dask#6801 ) Richard (Rick) Zamora

Layer annotation docstrings improvements ( dask#6806 ) Simon Perkins

Avro reader ( dask#6780 ) Martin Durant

Rechunk array if smallest chunk size is smaller than depth ( dask#6708 ) Julia Signell

Add Layer Annotations ( dask#6767 ) Simon Perkins

Add “view code” links to documentation ( dask#6793 ) manuels

Add optional IO-subgraph to Blockwise Layers ( dask#6715 ) Richard (Rick) Zamora

Add high level graph pack/unpack for distributed ( dask#6786 ) Mads R. B. Kristensen

Add missing methods of the Dataframe API ( dask#6789 ) Stephannie Jimenez Gacha

Add doc on managing environments ( dask#6778 ) Martin Durant

HLG: get_all_external_keys() ( dask#6774 ) Mads R. B. Kristensen

Avoid rechunking in reshape with chunksize=1 ( dask#6748 ) Tom Augspurger

Try to make categoricals work on join ( dask#6205 ) Julia Signell

Fix some minor typos and trailing whitespaces in array-slice.rst ( dask#6771 ) Magnus Nord

Bugfix for parquet metadata writes of empty dataframe partitions (pyarrow) ( dask#6741 ) Callum Noble

Document meta kwarg in map_blocks and map_overlap . ( dask#6763 ) Peter Andreas Entschev

Begin experimenting with parallel prefix scan for cumsum and cumprod ( dask#6675 ) Erik Welch

Clarify differences in boolean indexing between dask and numpy arrays ( dask#6764 ) Illviljan

Efficient serialization of shuffle layers ( dask#6760 ) James Bourbeau

Config array optimize to skip fusion and return a HLG ( dask#6751 ) Mads R. B. Kristensen

Temporarily use pyarrow<2 in CI ( dask#6759 ) James Bourbeau

Fix meta for min / max reductions ( dask#6736 ) Peter Andreas Entschev

Add 2D possibility to da.linalg.lstsq - mirroring numpy ( dask#6749 ) Pascal Bourgault

CI: Fixed bug causing flaky test failure in pivot ( dask#6752 ) Tom Augspurger

Serialization of layers ( dask#6693 ) Mads R. B. Kristensen

Add attrs property to Series/Dataframe ( dask#6742 ) Illviljan

Removed Mutable Default Argument ( dask#6747 ) Mads R. B. Kristensen

Adjust parquet ArrowEngine to allow more easy subclass for writing ( dask#6505 ) Joris Van den Bossche

Add ShuffleStage HLG Layer ( dask#6650 ) Richard (Rick) Zamora

Handle literal in meta_from_array ( dask#6731 ) Peter Andreas Entschev

Do balanced rechunking even if chunks are the same ( dask#6735 ) Chris Roat

Fix docstring DataFrame.set_index ( dask#6739 ) Gil Forsyth

Ensure HighLevelGraph layers always contain Layer instances ( dask#6716 ) James Bourbeau

Map on HighLevelGraph Layers ( dask#6689 ) Mads R. B. Kristensen

Update overlap *_like function calls and CuPy tests ( dask#6728 ) Peter Andreas Entschev

Fixes for svd with array_function ( dask#6727 ) Peter Andreas Entschev

Added doctest extension for documentation ( dask#6397 ) Jim Circadian

Minor fix to #5628 using @pentschev’s suggestion ( dask#6724 ) John A Kirkham

Change type of Dask array when meta type changes ( dask#5628 ) Matthew Rocklin

Add az ( dask#6719 ) Ray Bell

HLG: get_dependencies() of single keys ( dask#6699 ) Mads R. B. Kristensen

Revert “Revert “Use HighLevelGraph layers everywhere in collections ( dask#6510 )” ( dask#6697 )” ( dask#6707 ) Tom Augspurger

Allow *_like array creation functions to respect input array type ( dask#6680 ) Genevieve Buckley

Update dask-sphinx-theme version ( dask#6700 ) Gil Forsyth

Array

Allow rechunk to evenly split into N chunks ( dask#6420 ) Scott Sievert

Array

repr_html : color sides darker instead of drawing all the lines ( dask#6683 ) Julia Signell

Removes warning from nanstd and nanvar ( dask#6667 ) Thomas J. Fan

Get shape of output from original array - map_overlap ( dask#6682 ) Julia Signell

Replace np.searchsorted with bisect in indexing ( dask#6669 ) Joachim B Haga

Bag

Make sure subprocesses have a consistent hash for bag groupby ( dask#6660 ) Itamar Turner-Trauring

Core

Revert “Use HighLevelGraph layers everywhere in collections ( dask#6510 )” ( dask#6697 ) Tom Augspurger

Use pandas.testing ( dask#6687 ) John A Kirkham

Improve 128-bit floating-point skip in tests ( dask#6676 ) Elliott Sales de Andrade

DataFrame

Allow setting dataframe items using a bool dataframe ( dask#6608 ) Julia Signell

Documentation

Fix typo ( dask#6692 ) garanews

Fix a few typos ( dask#6678 ) Pav A

Array

Partially reverted changes to Array indexing that produces large changes. This restores the behavior from Dask 2.25.0 and earlier, with a warning when large chunks are produced. A configuration option is provided to avoid creating the large chunks, see Efficiency . ( dask#6665 ) Tom Augspurger

Add meta to to_dask_array ( dask#6651 ) Kyle Nicholson

Fix dask#6631 and dask#6611 ( dask#6632 ) Rafal Wojdyla

Infer object in array reductions ( dask#6629 ) Daniel Saxton

Adding v_based flag for svd_flip ( dask#6658 ) Eric Czech

Fix flakey array mean ( dask#6656 ) Sam Grayson

Core

Removed dsk equality check from SubgraphCallable.eq ( dask#6666 ) Mads R. B. Kristensen

Use HighLevelGraph layers everywhere in collections ( dask#6510 ) Mads R. B. Kristensen

Adds hash dunder method to SubgraphCallable for caching purposes ( dask#6424 ) Andrew Fulton

Stop writing commented out config files by default ( dask#6647 ) Matthew Rocklin

DataFrame

Add support for collect list aggregation via agg API ( dask#6655 ) Madhur Tandon

Slightly better error message ( dask#6657 ) Julia Signell

Array

Preserve dtype in svd ( dask#6643 ) Eric Czech

Core

store() : create a single HLG layer ( dask#6601 ) Mads R. B. Kristensen

Add pre-commit CI build ( dask#6645 ) James Bourbeau

Update .pre-commit-config to latest black. ( dask#6641 ) Julia Signell

Update super usage to remove Python 2 compatibility ( dask#6630 ) Poruri Sai Rahul

Remove u string prefixes ( dask#6633 ) Poruri Sai Rahul

DataFrame

Improve error message for to_sql ( dask#6638 ) Julia Signell

Use empty list as categories ( dask#6626 ) Julia Signell

Documentation

Add autofunction to array api docs for more ufuncs ( dask#6644 ) James Bourbeau

Add a number of missing ufuncs to dask.array docs ( dask#6642 ) Ralf Gommers

Add HelmCluster docs ( dask#6290 ) Jacob Tomlinson

Array

Backend-aware dtype inference for single-chunk svd ( dask#6623 ) Eric Czech

Make array.reduction docstring match for dtype ( dask#6624 ) Martin Durant

Set lower bound on compression level for svd_compressed using rows and cols ( dask#6622 ) Eric Czech

Improve SVD consistency and small array handling ( dask#6616 ) Eric Czech

Add svd_flip #6599 ( dask#6613 ) Eric Czech

Handle sequences containing dask Arrays ( dask#6595 ) Gabe Joseph

Avoid large chunks from getitem with lists ( dask#6514 ) Tom Augspurger

Eagerly slice numpy arrays in from_array ( dask#6605 ) Deepak Cherian

Restore ability to pickle dask arrays ( dask#6594 ) Noah D. Brenowitz

Add SVD support for short-and-fat arrays ( dask#6591 ) Eric Czech

Add simple chunk type registry and defer as appropriate to upcast types ( dask#6393 ) Jon Thielen

Align coarsen chunks by default ( dask#6580 ) Deepak Cherian

Fixup reshape on unknown dimensions and other testing fixes ( dask#6578 ) Ryan Williams

Core

Add validation and fixes for HighLevelGraph dependencies ( dask#6588 ) Mads R. B. Kristensen

Fix linting issue ( dask#6598 ) Tom Augspurger

Skip bokeh version 2.0.0 ( dask#6572 ) John A Kirkham

DataFrame

Added bytes/row calculation when using meta ( dask#6585 ) McToel

Handle min_count in Series.sum / prod ( dask#6618 ) Daniel Saxton

Update DataFrame.set_index docstring ( dask#6549 ) Timost

Always compute 0 and 1 quantiles during quantile calculations ( dask#6564 ) Erik Welch

Fix wrong path when reading empty csv file ( dask#6573 ) Abdulelah Bin Mahfoodh

Documentation

Doc: Troubleshooting dashboard 404 ( dask#6215 ) Kilian Lieret

Fixup extraConfig example ( dask#6625 ) Tom Augspurger

Update supported Python versions ( dask#6609 ) Julia Signell

Document dask/daskhub helm chart ( dask#6560 ) Tom Augspurger

Core

Compare key hashes in subs() ( dask#6559 ) Mads R. B. Kristensen

Rerun with latest black release ( dask#6568 ) James Bourbeau

License update ( dask#6554 ) Tom Augspurger

DataFrame

Add gs read_parquet example ( dask#6548 ) Ray Bell

Documentation

Remove version from documentation page names ( dask#6558 ) James Bourbeau

Update kubernetes-helm.rst ( dask#6523 ) David Sheldon

Stop 2020 survey ( dask#6547 ) Tom Augspurger

Array

Fix setting random seed in tests. ( dask#6518 ) Elliott Sales de Andrade

Support meta in apply gufunc ( dask#6521 ) joshreback

Replace cupy.sparse with cupyx.scipy.sparse ( dask#6530 ) John A Kirkham

Dataframe

Bump up tolerance for rolling tests ( dask#6502 ) Julia Signell

Implement DatFrame.len ( dask#6515 ) Tom Augspurger

Infer arrow schema in to_parquet (for ArrowEngine`) ( dask#6490 ) Richard (Rick) Zamora

Fix parquet test when no pyarrow ( dask#6524 ) Martin Durant

Remove problematic filter arguments in ArrowEngine ( dask#6527 ) Richard (Rick) Zamora

Avoid schema validation by default in ArrowEngine ( dask#6536 ) Richard (Rick) Zamora

Core

Use unpack_collections in make_blockwise_graph ( dask#6517 ) Thomas J. Fan

Move key_split() from optimization.py to utils.py ( dask#6529 ) Mads R. B. Kristensen

Make tests run on moto server ( dask#6528 ) Martin Durant

Array

Reduce np.zeros , ones , and full array size with broadcasting ( dask#6491 ) Matthias Bussonnier

Add missing meta= for trim in map_overlap ( dask#6494 ) Peter Andreas Entschev

Bag

Bag repartition partition size ( dask#6371 ) joshreback

Core

Scalar.dask_layers() to return self._name instead of self.key ( dask#6507 ) Mads R. B. Kristensen

Update dependencies correctly in fuse_root optimization ( dask#6508 ) Mads R. B. Kristensen

DataFrame

Adds items to dataframe ( dask#6503 ) Thomas J. Fan

Include compression in write_table call ( dask#6499 ) Julia Signell

Fixed warning in nonempty_series ( dask#6485 ) Tom Augspurger

Intelligently determine partitions based on type of first arg ( dask#6479 ) Matthew Rocklin

Fix pyarrow mkdirs ( dask#6475 ) Julia Signell

Fix duplicate parquet output in to_parquet ( dask#6451 ) michaelnarodovitch

Documentation

Fix documentation da.histogram ( dask#6439 ) Roberto Panai

Add agg nunique example ( dask#6404 ) Ray Bell

Fixed a few typos in the SQL docs ( dask#6489 ) Mike McCarty

Docs for SQLing ( dask#6453 ) Martin Durant

Array

Compatibility for NumPy dtype deprecation ( dask#6430 ) Tom Augspurger

Core

Implement sizeof for some bytes -like objects ( dask#6457 ) John A Kirkham

HTTP error for new fsspec ( dask#6446 ) Martin Durant

When RecursionError is raised, return uuid from tokenize function ( dask#6437 ) Julia Signell

Install deps of upstream-dev packages ( dask#6431 ) Tom Augspurger

Use updated link in setup.cfg ( dask#6426 ) Zhengnan Zhao

DataFrame

Add single quotes around column names if strings ( dask#6471 ) Gil Forsyth

Refactor ArrowEngine for better read_parquet performance ( dask#6346 ) Richard (Rick) Zamora

Add tolist dispatch ( dask#6444 ) GALI PREM SAGAR

Compatibility with pandas 1.1.0rc0 ( dask#6429 ) Tom Augspurger

Multi value pivot table ( dask#6428 ) joshreback

Duplicate argument definitions in to_csv docstring ( dask#6411 ) Jun Han (Johnson) Ooi

Documentation

Add utility to docs to convert YAML config to env vars and back ( dask#6472 ) Jacob Tomlinson

Fix parameter server rendering ( dask#6466 ) Scott Sievert

Fixes broken links ( dask#6403 ) Jim Circadian

Complete parameter server implementation in docs ( dask#6449 ) Scott Sievert

Fix typo ( dask#6436 ) Jack Xiaosong Xu

Array

Correct error message in array.routines.gradient() ( dask#6417 ) johnomotani

Fix blockwise concatenate for array with some dimension=1 ( dask#6342 ) Matthias Bussonnier

Bag

Fix bag.take example ( dask#6418 ) Roberto Panai

Core

Groups values in optimization pass should only be graph and keys – not an optimization + keys ( dask#6409 ) Benjamin Zaitlen

Call custom optimizations once, with kwargs provided ( dask#6382 ) Clark Zinzow

Include pickle5 for testing on Python 3.7 ( dask#6379 ) John A Kirkham

DataFrame

Correct typo in error message ( dask#6422 ) Tom McTiernan

Use pytest.warns to check for UserWarning ( dask#6378 ) Richard (Rick) Zamora

Parse bytes_per_chunk keyword from string ( dask#6370 ) Matthew Rocklin

Documentation

Numpydoc formatting ( dask#6421 ) Matthias Bussonnier

Unpin numpydoc following 1.1 release ( dask#6407 ) Gil Forsyth

Numpydoc formatting ( dask#6402 ) Matthias Bussonnier

Add instructions for using conda when installing code for development ( dask#6399 ) Ray Bell

Update visualize docstrings ( dask#6383 ) Zhengnan Zhao

Array

Register sizeof for numpy zero-strided arrays ( dask#6343 ) Matthias Bussonnier

Use concatenate_lookup in concatenate ( dask#6339 ) John A Kirkham

Fix rechunking of arrays with some zero-length dimensions ( dask#6335 ) Matthias Bussonnier

DataFrame

Dispatch iloc` calls to getitem ( dask#6355 ) Gil Forsyth

Handle unnamed pandas RangeIndex in fastparquet engine ( dask#6350 ) Richard (Rick) Zamora

Preserve index when writing partitioned parquet datasets with pyarrow ( dask#6282 ) Richard (Rick) Zamora

Use ignore_index for pandas’ group_split_dispatch ( dask#6251 ) Richard (Rick) Zamora

Documentation

Add doc describing argument ( dask#6318 ) asmith26

Array

Cast chunk sizes to python int dtype ( dask#6326 ) Gil Forsyth

Add shape=None to *_like() array creation functions ( dask#6064 ) Anderson Banihirwe

Core

Update expected error msg for protocol difference in fsspec ( dask#6331 ) Gil Forsyth

Fix for floats < 1 in parse_bytes ( dask#6311 ) Gil Forsyth

Fix exception causes all over the codebase ( dask#6308 ) Ram Rachum

Fix duplicated tests ( dask#6303 ) James Lamb

Remove unused testing function ( dask#6304 ) James Lamb

DataFrame

Add high-level CSV Subgraph ( dask#6262 ) Gil Forsyth

Fix ValueError when merging an index-only 1-partition dataframe ( dask#6309 ) Krishan Bhasin

Make index.map clear divisions. ( dask#6285 ) Julia Signell

Documentation

Add link to 2020 survey ( dask#6328 ) Tom Augspurger

Update bag.rst ( dask#6317 ) Ben Shaver

Array

Don’t try to set name on full ( dask#6299 ) Julia Signell

Histogram: support lazy values for range/bins (another way) ( dask#6252 ) Gabe Joseph

Core

Fix exception causes in utils.py ( dask#6302 ) Ram Rachum

Improve performance of HighLevelGraph construction ( dask#6293 ) Julia Signell

Documentation

Now readthedocs builds unrelased features’ docstrings ( dask#6295 ) Antonio Ercole De Luca

Add asyncssh intersphinx mappings ( dask#6298 ) Jacob Tomlinson

Array

Cast slicing index to dask array if same shape as original ( dask#6273 ) Julia Signell

Fix stack error message ( dask#6268 ) Stephanie Gott

full & full_like : error on non-scalar fill_value ( dask#6129 ) Huite

Support for multiple arrays in map_overlap ( dask#6165 ) Eric Czech

Pad resample divisions so that edges are counted ( dask#6255 ) Julia Signell

Bag

Random sampling of k elements from a dask bag #4799 ( dask#6239 ) Antonio Ercole De Luca

DataFrame

Add dropna , sort , and ascending to sort_values ( dask#5880 ) Julia Signell

Generalize from_dask_array ( dask#6263 ) GALI PREM SAGAR

Add derived docstring for SeriesGroupby.nunique ( dask#6284 ) Julia Signell

Remove NotImplementedError in resample with rule ( dask#6274 ) Abdulelah Bin Mahfoodh

Add dd.to_sql ( dask#6038 ) Ryan Williams

Documentation

Update remote data section ( dask#6258 ) Ray Bell

Core

Re-add the complete extra ( dask#6257 ) Jim Crist-Harif

DataFrame

Raise error if resample isn’t going to give right answer ( dask#6244 ) Julia Signell

Array

Empty array rechunk ( dask#6233 ) Andrew Fulton

Core

Make pyyaml required ( dask#6250 ) Jim Crist-Harif

Fix install commands from ImportError ( dask#6238 ) Gaurav Sheni

Remove issue template ( dask#6249 ) Jacob Tomlinson

DataFrame

Pass ignore_index to dd_shuffle from DataFrame.shuffle ( dask#6247 ) Richard (Rick) Zamora

Cope with missing HDF keys ( dask#6204 ) Martin Durant

Generalize describe & quantile apis ( dask#5137 ) GALI PREM SAGAR

Array

Small improvements to da.pad ( dask#6213 ) Mark Boer

Return tuple if multiple outputs in dask.array.apply_gufunc , add test to check for tuple ( dask#6207 ) Kai Mühlbauer

Support stack with unknown chunksizes ( dask#6195 ) swapna

Bag

Random Choice on Bags ( dask#6208 ) Antonio Ercole De Luca

Core

Raise warning delayed.visualise() ( dask#6216 ) Amol Umbarkar

Ensure other pickle arguments work ( dask#6229 ) John A Kirkham

Overhaul fuse() config ( dask#6198 ) crusaderky

Update dask.order.order to consider “next” nodes using both FIFO and LIFO ( dask#5872 ) Erik Welch

DataFrame

Use 0 as fill_value for more agg methods ( dask#6245 ) Julia Signell

Generalize rearrange_by_column_tasks and add DataFrame.shuffle ( dask#6066 ) Richard (Rick) Zamora

Xfail test_rolling_numba_engine for newer numba and older pandas ( dask#6236 ) James Bourbeau

Generalize fix_overlap ( dask#6240 ) GALI PREM SAGAR

Fix DataFrame.shape with no columns ( dask#6237 ) noreentry

Avoid shuffle when setting a presorted index with overlapping divisions ( dask#6226 ) Krishan Bhasin

Adjust the Parquet engine classes to allow more easily subclassing ( dask#6211 ) Marius van Niekerk

Fix dd.merge_asof with left_on='col' & right_index=True ( dask#6192 ) noreentry

Disable warning for concat ( dask#6210 ) Tung Dang

Move AUTO_BLOCKSIZE out of read_csv signature ( dask#6214 ) Jim Crist-Harif

.loc indexing with callable ( dask#6185 ) Endre Mark Borza

Avoid apply in _compute_sum_of_squares for groupby std agg ( dask#6186 ) Richard (Rick) Zamora

Minor correction to test_parquet ( dask#6190 ) Brian Larsen

Adhering to the passed pat for delimeter join and fix error message ( dask#6194 ) GALI PREM SAGAR

Skip test_to_parquet_with_get if no parquet libs available ( dask#6188 ) Scott Sanderson

Documentation

Added documentation for distributed.Event class ( dask#6231 ) Nils Braun

Doc write to remote ( dask#6124 ) Ray Bell

Array

Fix array general-reduction name ( dask#6176 ) Nick Evans

Replace dim with shape in unravel_index ( dask#6155 ) Julia Signell

Moment: handle all elements being masked ( dask#5339 ) Gabe Joseph

Core

Remove Redundant string concatenations in dask code-base ( dask#6137 ) GALI PREM SAGAR

Upstream compat ( dask#6159 ) Tom Augspurger

Ensure sizeof of dict and sequences returns an integer ( dask#6179 ) James Bourbeau

Estimate python collection sizes with random sampling ( dask#6154 ) Florian Jetter

Update test upstream ( dask#6146 ) Tom Augspurger

Skip test for mindeps build ( dask#6144 ) Tom Augspurger

Switch default multiprocessing context to “spawn” ( dask#4003 ) Itamar Turner-Trauring

Update manifest to include dask-schema ( dask#6140 ) Benjamin Zaitlen

DataFrame

Harden inconsistent-schema handling in pyarrow-based read_parquet ( dask#6160 ) Richard (Rick) Zamora

Add compute kwargs to methods that write data to disk ( dask#6056 ) Krishan Bhasin

Fix issue where unique returns an index like result from backends ( dask#6153 ) GALI PREM SAGAR

Fix internal error in map_partitions with collections ( dask#6103 ) Tom Augspurger

Documentation

Add phase of computation to index TOC ( dask#6157 ) Benjamin Zaitlen

Remove unused imports in scheduling script ( dask#6138 ) James Lamb

Fix indent ( dask#6147 ) Martin Durant

Add Tom’s log config example ( dask#6143 ) Martin Durant

Array

Update dask.array.from_array to warn when passed a Dask collection ( dask#6122 ) James Bourbeau

Un-numpy like behaviour in dask.array.pad ( dask#6042 ) Mark Boer

Add support for repeats=0 in da.repeat ( dask#6080 ) James Bourbeau

Core

Fix yaml layout for schema ( dask#6132 ) Benjamin Zaitlen

Configuration Reference ( dask#6069 ) Benjamin Zaitlen

Add configuration option to turn off task fusion ( dask#6087 ) Matthew Rocklin

Skip pyarrow on windows ( dask#6094 ) Tom Augspurger

Set limit to maximum length of fused key ( dask#6057 ) Lucas Rademaker

Add test against #6062 ( dask#6072 ) Martin Durant

Bump checkout action to v2 ( dask#6065 ) James Bourbeau

DataFrame

Generalize categorical calls to support cudf Categorical ( dask#6113 ) GALI PREM SAGAR

Avoid reading _metadata on every worker ( dask#6017 ) Richard (Rick) Zamora

Use group_split_dispatch and ignore_index in apply_concat_apply ( dask#6119 ) Richard (Rick) Zamora

Handle new (dtype) pandas metadata with pyarrow ( dask#6090 ) Richard (Rick) Zamora

Skip test_partition_on_cats_pyarrow if pyarrow is not installed ( dask#6112 ) James Bourbeau

Update DataFrame len to handle columns with the same name ( dask#6111 ) James Bourbeau

ArrowEngine bug fixes and test coverage ( dask#6047 ) Richard (Rick) Zamora

Added mode ( dask#5958 ) Adam Lewis

Documentation

Update “helm install” for helm 3 usage ( dask#6130 ) JulianWgs

Extend preload documentation ( dask#6077 ) Matthew Rocklin

Fixed small typo in DataFrame map_partitions() docstring ( dask#6115 ) Eugene Huang

Fix typo: “double” should be times, not plus ( dask#6091 ) David Chudzicki

Fix first line of array.random.* docs ( dask#6063 ) Martin Durant

Add section about Semaphore in distributed ( dask#6053 ) Florian Jetter

Array

Added np.iscomplexobj implementation ( dask#6045 ) Tom Augspurger

Core

Update test_rearrange_disk_cleanup_with_exception to pass without cloudpickle installed ( dask#6052 ) James Bourbeau

Fixed flaky test-rearrange ( dask#5977 ) Tom Augspurger

DataFrame

Use _meta_nonempty for dtype casting in stack_partitions ( dask#6061 ) mlondschien

Fix bugs in _metadata creation and filtering in parquet ArrowEngine ( dask#6023 ) Richard (Rick) Zamora

Documentation

DOC: Add name caveats ( dask#6040 ) Tom Augspurger

Array

Support dtype and other keyword arguments in da.random ( dask#6030 ) Matthew Rocklin

Register support for cupy sparse hstack / vstack ( dask#5735 ) Corey J. Nolet

Force self.name to str in dask.array ( dask#6002 ) Chuanzhu Xu

Bag

Set rename_fused_keys to None by default in bag.optimize ( dask#6000 ) Lucas Rademaker

Core

Copy dict in to_graphviz to prevent overwriting ( dask#5996 ) JulianWgs

Stricter pandas xfail ( dask#6024 ) Tom Augspurger

Fix CI failures ( dask#6013 ) James Bourbeau

Update toolz to 0.8.2 and use tlz ( dask#5997 ) Ryan Grout

Move Windows CI builds to GitHub Actions ( dask#5862 ) James Bourbeau

DataFrame

Improve path-related exceptions in read_hdf ( dask#6032 ) psimaj

Fix dtype handling in dd.concat ( dask#6006 ) mlondschien

Handle cudf’s leftsemi and leftanti joins ( dask#6025 ) Richard J Zamora

Remove unused npartitions variable in dd.from_pandas ( dask#6019 ) Daniel Saxton

Added shuffle to DataFrame.random_split ( dask#5980 ) petiop

Documentation

Fix indentation in scheduler-overview docs ( dask#6022 ) Matthew Rocklin

Update task graphs in optimize docs ( dask#5928 ) Julia Signell

Optionally get rid of intermediary boxes in visualize, and add more labels ( dask#5976 ) Julia Signell

Array

Improve reuse of temporaries with numpy ( dask#5933 ) Bruce Merry

Make map_blocks with block_info produce a Blockwise ( dask#5896 ) Bruce Merry

Optimize make_blockwise_graph ( dask#5940 ) Bruce Merry

Fix axes ordering in da.tensordot ( dask#5975 ) Gil Forsyth

Adds empty mode to array.pad ( dask#5931 ) Thomas J. Fan

Core

Remove toolz.memoize dependency in dask.utils ( dask#5978 ) Ryan Grout

Close pool leaking subprocess ( dask#5979 ) Tom Augspurger

Pin numpydoc to 0.8.0 (fix double autoescape) ( dask#5961 ) Gil Forsyth

Register deterministic tokenization for range objects ( dask#5947 ) James Bourbeau

Unpin msgpack in CI ( dask#5930 ) JAmes Bourbeau

Ensure dot results are placed in unique files. ( dask#5937 ) Elliott Sales de Andrade

Add remaining optional dependencies to Travis 3.8 CI build environment ( dask#5920 ) James Bourbeau

DataFrame

Skip parquet getitem optimization for some keys ( dask#5917 ) Tom Augspurger

Add ignore_index argument to rearrange_by_column code path ( dask#5973 ) Richard J Zamora

Add DataFrame and Series memory_usage_per_partition methods ( dask#5971 ) James Bourbeau

xfail test_describe when using Pandas 0.24.2 ( dask#5948 ) James Bourbeau

Implement dask.dataframe.to_numeric ( dask#5929 ) Julia Signell

Add new error message content when columns are in a different order ( dask#5927 ) Julia Signell

Use shallow copy for assign operations when possible ( dask#5740 ) Richard J Zamora

Documentation

Changed above to below in dask.array.triu docs ( dask#5984 ) Henrik Andersson

Array slicing: fix typo in slice_with_int_dask_array error message ( dask#5981 ) Gabe Joseph

Grammar and formatting updates to docstrings ( dask#5963 ) James Lamb

Update develop doc with conda option ( dask#5939 ) Ray Bell

Update title of DataFrame extension docs ( dask#5954 ) James Bourbeau

Fixed typos in documentation ( dask#5962 ) James Lamb

Add original class or module as a kwarg on bind* methods ( dask#5946 ) Julia Signell

Add collect list example ( dask#5938 ) Ray Bell

Update optimization doc for python 3 ( dask#5926 ) Julia Signell

Array

Cache result of Array.shape ( dask#5916 ) Bruce Merry

Improve accuracy of estimate_graph_size for rechunk ( dask#5907 ) Bruce Merry

Skip rechunk steps that do not alter chunking ( dask#5909 ) Bruce Merry

Support dtype and other kwargs in coarsen ( dask#5903 ) Matthew Rocklin

Push chunk override from map_blocks into blockwise ( dask#5895 ) Bruce Merry

Avoid using rewrite_blockwise for a singleton ( dask#5890 ) Bruce Merry

Optimize slices_from_chunks ( dask#5891 ) Bruce Merry

Avoid unnecessary getitem in block() when chunks have correct dimensionality ( dask#5884 ) Thomas Robitaille

Bag

Add include_path option for dask.bag.read_text ( dask#5836 ) Yifan Gu

Fixes ValueError in delayed execution of bagged NumPy array ( dask#5828 ) Surya Avala

Core

CI: Pin msgpack ( dask#5923 ) Tom Augspurger

Rename test_inner to test_outer ( dask#5922 ) Shiva Raisinghani

quote should quote dicts too ( dask#5905 ) Bruce Merry

Register a normalizer for literal ( dask#5898 ) Bruce Merry

Improve layer name synthesis for non-HLGs ( dask#5888 ) Bruce Merry

Replace flake8 pre-commit-hook with upstream ( dask#5892 ) Julia Signell

Call pip as a module to avoid warnings ( dask#5861 ) Cyril Shcherbin

Close ThreadPool at exit ( dask#5852 ) Tom Augspurger

Remove dask.dataframe import in tokenization code ( dask#5855 ) James Bourbeau

DataFrame

Require pandas>=0.23 ( dask#5883 ) Tom Augspurger

Remove lambda from dataframe aggregation ( dask#5901 ) Matthew Rocklin

Fix exception chaining in dataframe/init.py ( dask#5882 ) Ram Rachum

Add support for reductions on empty dataframes ( dask#5804 ) Shiva Raisinghani

Expose sort= argument for groupby ( dask#5801 ) Richard J Zamora

Add df.empty property ( dask#5711 ) rockwellw

Use parquet read speed-ups from fastparquet.api.paths_to_cats . ( dask#5821 ) Igor Gotlibovych

Documentation

Deprecate doc_wraps ( dask#5912 ) Tom Augspurger

Update array internal design docs for HighLevelGraph era ( dask#5889 ) Bruce Merry

Move over dashboard connection docs ( dask#5877 ) Matthew Rocklin

Move prometheus docs from distributed.dask.org ( dask#5876 ) Matthew Rocklin

Removing duplicated DO block at the end ( dask#5878 ) K.-Michael Aye

map_blocks see also ( dask#5874 ) Tom Augspurger

More derived from ( dask#5871 ) Julia Signell

Fix typo ( dask#5866 ) Yetunde Dada

Fix typo in cloud.rst ( dask#5860 ) Andrew Thomas

Add note pointing to code of conduct and diversity statement ( dask#5844 ) Matthew Rocklin

Fix Pandas 1.0 version comparison ( dask#5851 ) Tom Augspurger

Fix typo in distributed diagnostics documentation ( dask#5841 ) Gerrit Holl

Support for pandas 1.0’s new BooleanDtype and StringDtype ( dask#5815 ) Tom Augspurger

Compatibility with pandas 1.0’s API breaking changes and deprecations ( dask#5792 ) Tom Augspurger

Fixed non-deterministic tokenization of some extension-array backed pandas objects ( dask#5813 ) Tom Augspurger

Fixed handling of dataclass class objects in collections ( dask#5812 ) Matteo De Wint

Fixed resampling with tz-aware dates when one of the endpoints fell in a non-existent time ( dask#5807 ) dfonnegra

Delay initial Zarr dataset creation until the computation occurs ( dask#5797 ) Chris Roat

Use parquet dataset statistics in more cases with the pyarrow engine ( dask#5799 ) Richard J Zamora

Fixed exception in groupby.std() when some of the keys were large integers ( dask#5737 ) H. Thomson Comer

Array

Unify chunks in broadcast_arrays ( dask#5765 ) Matthew Rocklin

Core

xfail CSV encoding tests ( dask#5791 ) Tom Augspurger

Update order to handle empty dask graph ( dask#5789 ) James Bourbeau

Redo dask.order.order ( dask#5646 ) Erik Welch

DataFrame

Add transparent compression for on-disk shuffle with partd ( dask#5786 ) Christian Wesp

Fix repr for empty dataframes ( dask#5781 ) Shiva Raisinghani

Pandas 1.0.0RC0 compat ( dask#5784 ) Tom Augspurger

Remove buggy assertions ( dask#5783 ) Tom Augspurger

Pandas 1.0 compat ( dask#5782 ) Tom Augspurger

Fix bug in pyarrow-based read_parquet on partitioned datasets ( dask#5777 ) Richard J Zamora

Compat for pandas 1.0 ( dask#5779 ) Tom Augspurger

Fix groupby/mean error with with categorical index ( dask#5776 ) Richard J Zamora

Support empty partitions when performing cumulative aggregation ( dask#5730 ) Matthew Rocklin

set_index accepts single-item unnested list ( dask#5760 ) Wes Roach

Fixed partitioning in set index for ordered Categorical ( dask#5715 ) Tom Augspurger

Documentation

Note additional use case for normalize_token.register ( dask#5766 ) Thomas A Caswell

Update bag repartition docstring ( dask#5772 ) Timost

Small typos ( dask#5771 ) Maarten Breddels

Fix typo in Task Expectations docs ( dask#5767 ) James Bourbeau

Add docs section on task expectations to graph page ( dask#5764 ) Devin Petersohn

Array

Support Array.view with dtype=None ( dask#5736 ) Anderson Banihirwe

Add dask.array.nanmedian ( dask#5684 ) Deepak Cherian

Core

xfail test_temporary_directory on Python 3.8 ( dask#5734 ) James Bourbeau

Add support for Python 3.8 ( dask#5603 ) James Bourbeau

Use id to dedupe constants in rewrite_blockwise ( dask#5696 ) Jim Crist

DataFrame

Raise error when converting a dask dataframe scalar to a boolean ( dask#5743 ) James Bourbeau

Ensure dataframe groupby-variance is greater than zero ( dask#5728 ) Matthew Rocklin

Fix DataFrame.iter ( dask#5719 ) Tom Augspurger

Support Parquet filters in disjunctive normal form, like PyArrow ( dask#5656 ) Matteo De Wint

Auto-detect categorical columns in ArrowEngine-based read_parquet ( dask#5690 ) Richard J Zamora

Skip parquet getitem optimization tests if no engine found ( dask#5697 ) James Bourbeau

Fix independent optimization of parquet-getitem ( dask#5613 ) Tom Augspurger

Documentation

Update helm config doc ( dask#5750 ) Ray Bell

Link to examples.dask.org in several places ( dask#5733 ) Tom Augspurger

Add missing “ in performance report example ( dask#5724 ) James Bourbeau

Resolve several documentation build warnings ( dask#5685 ) James Bourbeau

add info on performance_report ( dask#5713 ) Benjamin Zaitlen

Add more docs disclaimers ( dask#5710 ) Julia Signell

Fix simple typo: wihout -> without ( dask#5708 ) Tim Gates

Update numpydoc dependency ( dask#5694 ) James Bourbeau

Array

Fix da.std to work with NumPy arrays ( dask#5681 ) James Bourbeau

Core

Register sizeof functions for Numba and RMM ( dask#5668 ) John A Kirkham

Update meeting time ( dask#5682 ) Tom Augspurger

DataFrame

Modify dd.DataFrame.drop to use shallow copy ( dask#5675 ) Richard J Zamora

Fix bug in _get_md_row_groups ( dask#5673 ) Richard J Zamora

Close sqlalchemy engine after querying DB ( dask#5629 ) Krishan Bhasin

Allow dd.map_partitions to not enforce meta ( dask#5660 ) Matthew Rocklin

Generalize concat_unindexed_dataframes to support cudf-backend ( dask#5659 ) Richard J Zamora

Add dataframe resample methods ( dask#5636 ) Benjamin Zaitlen

Compute length of dataframe as length of first column ( dask#5635 ) Matthew Rocklin

Documentation

Doc fixup ( dask#5665 ) James Bourbeau

Update doc build instructions ( dask#5640 ) James Bourbeau

Fix ADL link ( dask#5639 ) Ray Bell

Add documentation build ( dask#5617 ) James Bourbeau

Array

Use auto rechunking in da.rechunk if no value given ( dask#5605 ) Matthew Rocklin

Core

Add simple action to activate GH actions ( dask#5619 ) James Bourbeau

DataFrame

Fix “file_path_0” bug in aggregate_row_groups ( dask#5627 ) Richard J Zamora

Add chunksize argument to read_parquet ( dask#5607 ) Richard J Zamora

Change test_repartition_npartitions to support arch64 architecture ( dask#5620 ) ossdev07

Categories lost after groupby + agg ( dask#5423 ) Oliver Hofkens

Fixed relative path issue with parquet metadata file ( dask#5608 ) Nuno Gomes Silva

Enable gpu-backed covariance/correlation in dataframes ( dask#5597 ) Richard J Zamora

Documentation

Fix institutional faq and unknown doc warnings ( dask#5616 ) James Bourbeau

Add doc for some utils ( dask#5609 ) Tom Augspurger

Removes html_extra_path ( dask#5614 ) James Bourbeau

Fixed See Also referencence ( dask#5612 ) Tom Augspurger

Array

Implement complete dask.array.tile function ( dask#5574 ) Bouwe Andela

Add median along an axis with automatic rechunking ( dask#5575 ) Matthew Rocklin

Allow da.asarray to chunk inputs ( dask#5586 ) Matthew Rocklin

Bag

Use key_split in Bag name ( dask#5571 ) Matthew Rocklin

Core

Switch Doctests to Py3.7 ( dask#5573 ) Ryan Nazareth

Relax get_colors test to adapt to new Bokeh release ( dask#5576 ) Matthew Rocklin

Add dask.blockwise.fuse_roots optimization ( dask#5451 ) Matthew Rocklin

Add sizeof implementation for small dicts ( dask#5578 ) Matthew Rocklin

Update fsspec, gcsfs, s3fs ( dask#5588 ) Tom Augspurger

DataFrame

Add dropna argument to groupby ( dask#5579 ) Richard J Zamora

Revert “Remove import of dask_cudf, which is now a part of cudf ( dask#5568 )” ( dask#5590 ) Matthew Rocklin

Documentation

Add best practice for dask.compute function ( dask#5583 ) Matthew Rocklin

Create FUNDING.yml ( dask#5587 ) Gina Helfrich

Add screencast for coordination primitives ( dask#5593 ) Matthew Rocklin

Move funding to .github repo ( dask#5589 ) Tom Augspurger

Update calendar link ( dask#5569 ) Tom Augspurger

This release drops support for Python 3.5

Array

Reuse code for assert_eq util method ( dask#5496 ) Vijayant

Update da.array to always return a dask array ( dask#5510 ) James Bourbeau

Skip transpose on trivial inputs ( dask#5523 ) Ryan Abernathey

Avoid NumPy scalar string representation in tokenize ( dask#5527 ) James Bourbeau

Remove unnecessary tiledb shape constraint ( dask#5545 ) Norman Barker

Removes bytes from sparse array HTML repr ( dask#5556 ) James Bourbeau

Core

Drop Python 3.5 ( dask#5528 ) James Bourbeau

Update the use of fixtures in distributed tests ( dask#5497 ) Matthew Rocklin

Changed deprecated bokeh-port to dashboard-address ( dask#5507 ) darindf

Avoid updating with identical dicts in ensure_dict ( dask#5501 ) James Bourbeau

Test Upstream ( dask#5516 ) Tom Augspurger

Accelerate reverse_dict ( dask#5479 ) Ryan Grout

Update test_imports.sh ( dask#5534 ) James Bourbeau

Support cgroups limits on cpu count in multiprocess and threaded schedulers ( dask#5499 ) Albert DeFusco

Update minimum pyarrow version on CI ( dask#5562 ) James Bourbeau

Make cloudpickle optional ( dask#5511 ) crusaderky

DataFrame

Add an example of index_col usage ( dask#3072 ) Bruno Bonfils

Explicitly use iloc for row indexing ( dask#5500 ) Krishan Bhasin

Accept dask arrays on columns assignemnt ( dask#5224 ) Henrique Ribeiro -

Implement unique and value_counts for SeriesGroupBy ( dask#5358 ) Scott Sievert

Add sizeof definition for pyarrow tables and columns ( dask#5522 ) Richard J Zamora

Enable row-group task partitioning in pyarrow-based read_parquet ( dask#5508 ) Richard J Zamora

Removes npartitions=’auto’ from dd.merge docstring ( dask#5531 ) James Bourbeau

Apply enforce error message shows non-overlapping columns. ( dask#5530 ) Tom Augspurger

Optimize meta_nonempty for repetitive dtypes ( dask#5553 ) Petio Petrov

Remove import of dask_cudf, which is now a part of cudf ( dask#5568 ) Mads R. B. Kristensen

Documentation

Make capitalization more consistent in FAQ docs ( dask#5512 ) Matthew Rocklin

Add CONTRIBUTING.md ( dask#5513 ) Jacob Tomlinson

Document optional dependencies ( dask#5456 ) Prithvi MK

Update helm chart docs to reflect new chart repo ( dask#5539 ) Jacob Tomlinson

Add Resampler to API docs ( dask#5551 ) James Bourbeau

Fix typo in read_sql_table ( dask#5554 ) Eric Dill

Add adaptive deployments screencast [skip ci] ( dask#5566 ) Matthew Rocklin

Core

Call ensure_dict on graphs before entering toolz.merge ( dask#5486 ) Matthew Rocklin

Consolidating hash dispatch functions ( dask#5476 ) Richard J Zamora

DataFrame

Support Python 3.5 in Parquet code ( dask#5491 ) Benjamin Zaitlen

Avoid identity check in warn_dtype_mismatch ( dask#5489 ) Tom Augspurger

Enable unused groupby tests ( dask#3480 ) Jörg Dietrich

Remove old parquet and bcolz dataframe optimizations ( dask#5484 ) Matthew Rocklin

Add getitem optimization for read_parquet ( dask#5453 ) Tom Augspurger

Use _constructor_sliced method to determine Series type ( dask#5480 ) Richard J Zamora

Fix map(series) for unsorted base series index ( dask#5459 ) Justin Waugh

Fix KeyError with Groupby label ( dask#5467 ) Ryan Nazareth

Documentation

Use Zoom meeting instead of appear.in ( dask#5494 ) Matthew Rocklin

Added curated list of resources ( dask#5460 ) Javad

Update SSH docs to include SSHCluster ( dask#5482 ) Matthew Rocklin

Update “Why Dask?” page ( dask#5473 ) Matthew Rocklin

Fix typos in docstrings ( dask#5469 ) garanews

Array

Correct chunk size logic for asymmetric overlaps ( dask#5449 ) Ben Jeffery

Make da.unify_chunks public API ( dask#5443 ) Matthew Rocklin

DataFrame

Fix dask.dataframe.fillna handling of Scalar object ( dask#5463 ) Zhenqing Li

Documentation

Remove boxes in Spark comparison page ( dask#5445 ) Matthew Rocklin

Add latest presentations ( dask#5446 ) Javad

Update cloud documentation ( dask#5444 ) Matthew Rocklin

Core

Add sentinel no_default to get_dependencies task ( dask#5420 ) James Bourbeau

Update fsspec version ( dask#5415 ) Matthew Rocklin

Remove PY2 checks ( dask#5400 ) Jim Crist

DataFrame

Add option to not check meta in dd.from_delayed ( dask#5436 ) Christopher J. Wright

Fix test_timeseries_nulls_in_schema failures with pyarrow master ( dask#5421 ) Richard J Zamora

Reduce read_metadata output size in pyarrow/parquet ( dask#5391 ) Richard J Zamora

Test numeric edge case for repartition with npartitions. ( dask#5433 ) amerkel2

Unxfail pandas-datareader test ( dask#5430 ) Tom Augspurger

Add DataFrame.pop implementation ( dask#5422 ) Matthew Rocklin

Enable merge/set_index for cudf-based dataframes with cupy values ( dask#5322 ) Richard J Zamora

drop_duplicates support for positional subset parameter ( dask#5410 ) Wes Roach

Documentation

Add screencasts to array, bag, dataframe, delayed, futures and setup ( dask#5429 ) ( dask#5424 ) Matthew Rocklin

Fix delimeter parsing documentation ( dask#5428 ) Mahmut Bulut

Update overview image ( dask#5404 ) James Bourbeau

Array

Adds explicit h5py.File mode ( dask#5390 ) James Bourbeau

Provides method to compute unknown array chunks sizes ( dask#5312 ) Scott Sievert

Ignore runtime warning in Array compute_meta ( dask#5356 ) estebanag

Add _meta to Array.dask_postpersist ( dask#5353 ) Benoit Bovy

Fixup da.asarray and da.asanyarray for datetime64 dtype and xarray objects ( dask#5334 ) Stephan Hoyer

Add shape implementation ( dask#5293 ) Tom Augspurger

Add chunktype to array text repr ( dask#5289 ) James Bourbeau

Array.random.choice: handle array-like non-arrays ( dask#5283 ) Gabe Joseph

Core

Remove deprecated code ( dask#5401 ) Jim Crist

Fix funcname when vectorized func has no name ( dask#5399 ) James Bourbeau

Truncate funcname to avoid long key names ( dask#5383 ) Matthew Rocklin

Add support for numpy.vectorize in funcname ( dask#5396 ) James Bourbeau

Fixed HDFS upstream test ( dask#5395 ) Tom Augspurger

Support numbers and None in parse_bytes / timedelta ( dask#5384 ) Matthew Rocklin

Fix tokenizing of subindexes on memmapped numpy arrays ( dask#5351 ) Henry Pinkard

Upstream fixups ( dask#5300 ) Tom Augspurger

DataFrame

Allow pandas to cast type of statistics ( dask#5402 ) Richard J Zamora

Preserve index dtype after applying dd.pivot_table ( dask#5385 ) therhaag

Implement explode for Series and DataFrame ( dask#5381 ) Arpit Solanki

set_index on categorical fails with less categories than partitions ( dask#5354 ) Oliver Hofkens

Support output to a single CSV file ( dask#5304 ) Hongjiu Zhang

Add groupby().transform() ( dask#5327 ) Oliver Hofkens

Adding filter kwarg to pyarrow dataset call ( dask#5348 ) Richard J Zamora

Implement and check compression defaults for parquet ( dask#5335 ) Sarah Bird

Pass sqlalchemy params to delayed objects ( dask#5332 ) Arpit Solanki

Fixing schema handling in arrow-parquet ( dask#5307 ) Richard J Zamora

Add support for DF and Series groupby().idxmin/max() ( dask#5273 ) Oliver Hofkens

Add correlation calculation and add test ( dask#5296 ) Benjamin Zaitlen

Documentation

Numpy docstring standard has moved ( dask#5405 ) Wes Roach

Reference correct NumPy array name ( dask#5403 ) Wes Roach

Minor edits to Array chunk documentation ( dask#5372 ) Scott Sievert

Add methods to API docs ( dask#5387 ) Tom Augspurger

Add namespacing to configuration example ( dask#5374 ) Matthew Rocklin

Add get_task_stream and profile to the diagnostics page ( dask#5375 ) Matthew Rocklin

Add best practice to load data with Dask ( dask#5369 ) Matthew Rocklin

Update institutional-faq.rst ( dask#5345 ) DomHudson

Add threads and processes note to the best practices ( dask#5340 ) Matthew Rocklin

Update cuDF links ( dask#5328 ) James Bourbeau

Fixed small typo with parentheses placement ( dask#5311 ) Eugene Huang

Update link in reshape docstring ( dask#5297 ) James Bourbeau

Array

Raise exception when from_array is given a dask array ( dask#5280 ) David Hoese

Avoid adjusting gufunc’s meta dtype twice ( dask#5274 ) Peter Andreas Entschev

Add meta= keyword to map_blocks and add test with sparse ( dask#5269 ) Matthew Rocklin

Add rollaxis and moveaxis ( dask#4822 ) Tobias de Jong

Always increment old chunk index ( dask#5256 ) James Bourbeau

Shuffle dask array ( dask#3901 ) Tom Augspurger

Fix ordering when indexing a dask array with a bool dask array ( dask#5151 ) James Bourbeau

Bag

Add workaround for memory leaks in bag generators ( dask#5208 ) Marco Neumann

Core

Set strict xfail option ( dask#5220 ) James Bourbeau

test-upstream ( dask#5267 ) Tom Augspurger

Fixed HDFS CI failure ( dask#5234 ) Tom Augspurger

Error nicely if no file size inferred ( dask#5231 ) Jim Crist

A few changes to config.set ( dask#5226 ) Jim Crist

Fixup black string normalization ( dask#5227 ) Jim Crist

Pin NumPy in windows tests ( dask#5228 ) Jim Crist

Ensure parquet tests are skipped if fastparquet and pyarrow not installed ( dask#5217 ) James Bourbeau

Add fsspec to readthedocs ( dask#5207 ) Matthew Rocklin

Bump NumPy and Pandas to 1.17 and 0.25 in CI test ( dask#5179 ) John A Kirkham

DataFrame

Fix DataFrame.query docstring (incorrect numexpr API) ( dask#5271 ) Doug Davis

Parquet metadata-handling improvements ( dask#5218 ) Richard J Zamora

Improve messaging around sorted parquet columns for index ( dask#5265 ) Martin Durant

Add rearrange_by_divisions and set_index support for cudf ( dask#5205 ) Richard J Zamora

Fix groupby.std() with integer colum names ( dask#5096 ) Nicolas Hug

Add Series.iter ( dask#5071 ) Blane

Generalize hash_pandas_object to work for non-pandas backends ( dask#5184 ) GALI PREM SAGAR

Add rolling cov ( dask#5154 ) Ivars Geidans

Add columns argument in drop function ( dask#5223 ) Henrique Ribeiro

Documentation

Update institutional FAQ doc ( dask#5277 ) Matthew Rocklin

Add draft of institutional FAQ ( dask#5214 ) Matthew Rocklin

Make boxes for dask-spark page ( dask#5249 ) Martin Durant

Add motivation for shuffle docs ( dask#5213 ) Matthew Rocklin

Fix links and API entries for best-practices ( dask#5246 ) Martin Durant

Remove “bytes” (internal data ingestion) doc page ( dask#5242 ) Martin Durant

Redirect from our local distributed page to distributed.dask.org ( dask#5248 ) Matthew Rocklin

Cleanup API page ( dask#5247 ) Matthew Rocklin

Remove excess endlines from install docs ( dask#5243 ) Matthew Rocklin

Remove item list in phases of computation doc ( dask#5245 ) Martin Durant

Remove custom graphs from the TOC sidebar ( dask#5241 ) Matthew Rocklin

Remove experimental status of custom collections ( dask#5236 ) James Bourbeau

Adds table of contents to Why Dask? ( dask#5244 ) James Bourbeau

Moves bag overview to top-level bag page ( dask#5240 ) James Bourbeau

Remove use-cases in favor of stories.dask.org ( dask#5238 ) Matthew Rocklin

Removes redundant TOC information in index.rst ( dask#5235 ) James Bourbeau

Elevate dashboard in distributed diagnostics documentation ( dask#5239 ) Martin Durant

Updates “add” layer in HLG docs example ( dask#5237 ) James Bourbeau

Update GUFunc documentation ( dask#5232 ) Matthew Rocklin

Array

Use da.from_array(…, asarray=False) if input follows NEP-18 ( dask#5074 ) Matthew Rocklin

Add missing attributes to from_array documentation ( dask#5108 ) Peter Andreas Entschev

Fix meta computation for some reduction functions ( dask#5035 ) Peter Andreas Entschev

Raise informative error in to_zarr if unknown chunks ( dask#5148 ) James Bourbeau

Remove invalid pad tests ( dask#5122 ) Tom Augspurger

Ignore NumPy warnings in compute_meta ( dask#5103 ) Peter Andreas Entschev

Fix kurtosis calc for single dimension input array ( dask#5177 ) @andrethrill

Support Numpy 1.17 in tests ( dask#5192 ) Matthew Rocklin

Bag

Supply pool to bag test to resolve intermittent failure ( dask#5172 ) Tom Augspurger

Core

Base dask on fsspec ( dask#5064 ) ( dask#5121 ) Martin Durant

Various upstream compatibility fixes ( dask#5056 ) Tom Augspurger

Make distributed tests optional again. ( dask#5128 ) Elliott Sales de Andrade

Fix HDFS in dask ( dask#5130 ) Martin Durant

Ignore some more invalid value warnings. ( dask#5140 ) Elliott Sales de Andrade

DataFrame

Fix pd.MultiIndex size estimate ( dask#5066 ) Brett Naul

Generalizing has_known_categories ( dask#5090 ) GALI PREM SAGAR

Refactor Parquet engine ( dask#4995 ) Richard J Zamora

Add divide method to series and dataframe ( dask#5094 ) msbrown47

fix flaky partd test ( dask#5111 ) Tom Augspurger

Adjust is_dataframe_like to adjust for value_counts change ( dask#5143 ) Tom Augspurger

Generalize rolling windows to support non-Pandas dataframes ( dask#5149 ) Nick Becker

Avoid unnecessary aggregation in pivot_table ( dask#5173 ) Daniel Saxton

Add column names to apply_and_enforce error message ( dask#5180 ) Matthew Rocklin

Add schema keyword argument to to_parquet ( dask#5150 ) Sarah Bird

Remove recursion error in accessors ( dask#5182 ) Jim Crist

Allow fastparquet to handle gather_statistics=False for file lists ( dask#5157 ) Richard J Zamora

Documentation

Adds NumFOCUS badge to the README ( dask#5086 ) James Bourbeau

Update developer docs [ci skip] ( dask#5093 ) Jim Crist

Document DataFrame.set_index computataion behavior Natalya Rapstine

Use pip install . instead of calling setup.py ( dask#5139 ) Matthias Bussonier

Close user survey ( dask#5147 ) Tom Augspurger

Fix Google Calendar meeting link ( dask#5155 ) Loïc Estève

Add docker image customization example ( dask#5171 ) James Bourbeau

Update remote-data-services after fsspec ( dask#5170 ) Martin Durant

Fix typo in spark.rst ( dask#5164 ) Xavier Holt

Update setup/python docs for async/await API ( dask#5163 ) Matthew Rocklin

Update Local Storage HPC documentation ( dask#5165 ) Matthew Rocklin

Array

Add recompute= keyword to svd_compressed for lower-memory use ( dask#5041 ) Matthew Rocklin

Change array_function implementation for backwards compatibility ( dask#5043 ) Ralf Gommers

Added dtype and shape kwargs to apply_along_axis ( dask#3742 ) Davis Bennett

Fix reduction with empty tuple axis ( dask#5025 ) Peter Andreas Entschev

Drop size 0 arrays in stack ( dask#4978 ) John A Kirkham

Core

Removes index keyword from pandas to_parquet call ( dask#5075 ) James Bourbeau

Fixes upstream dev CI build installation ( dask#5072 ) James Bourbeau

Ensure scalar arrays are not rendered to SVG ( dask#5058 ) Willi Rath

Environment creation overhaul ( dask#5038 ) Tom Augspurger

s3fs, moto compatibility ( dask#5033 ) Tom Augspurger

pytest 5.0 compat ( dask#5027 ) Tom Augspurger

DataFrame

Fix compute_meta recursion in blockwise ( dask#5048 ) Peter Andreas Entschev

Remove hard dependency on pandas in get_dummies ( dask#5057 ) GALI PREM SAGAR

Check dtypes unchanged when using DataFrame.assign ( dask#5047 ) asmith26

Fix cumulative functions on tables with more than 1 partition ( dask#5034 ) tshatrov

Handle non-divisible sizes in repartition ( dask#5013 ) George Sakkis

Handles timestamp and preserve_index changes in pyarrow ( dask#5018 ) Richard J Zamora

Fix undefined meta for str.split(expand=False) ( dask#5022 ) Brett Naul

Removed checks used for debugging merge_asof ( dask#5011 ) Cody Johnson

Don’t use type when getting accessor in dataframes ( dask#4992 ) Matthew Rocklin

Add melt as a method of Dask DataFrame ( dask#4984 ) Dustin Tindall

Adds path-like support to to_hdf ( dask#5003 ) James Bourbeau

Documentation

Point to latest K8s setup article in JupyterHub docs ( dask#5065 ) Sean McKenna

Changes vizualize to visualize ( dask#5061 ) David Brochart

Fix from_sequence typo in delayed best practices ( dask#5045 ) James Bourbeau

Add user survey link to docs ( dask#5026 ) James Bourbeau

Fixes typo in optimization docs ( dask#5015 ) James Bourbeau

Update community meeting information ( dask#5006 ) Tom Augspurger

Array

Support automatic chunking in da.indices ( dask#4981 ) James Bourbeau

Err if there are no arrays to stack ( dask#4975 ) John A Kirkham

Asymmetrical Array Overlap ( dask#4863 ) Michael Eaton

Dispatch concatenate where possible within dask array ( dask#4669 ) Hameer Abbasi

Fix tokenization of memmapped numpy arrays on different part of same file ( dask#4931 ) Henry Pinkard

Preserve NumPy condition in da.asarray to preserve output shape ( dask#4945 ) Alistair Miles

Expand foo_like_safe usage ( dask#4946 ) Peter Andreas Entschev

Defer order/casting einsum parameters to NumPy implementation ( dask#4914 ) Peter Andreas Entschev

Remove numpy warning in moment calculation ( dask#4921 ) Matthew Rocklin

Fix meta_from_array to support Xarray test suite ( dask#4938 ) Matthew Rocklin

Cache chunk boundaries for integer slicing ( dask#4923 ) Bruce Merry

Drop size 0 arrays in concatenate ( dask#4167 ) John A Kirkham

Raise ValueError if concatenate is given no arrays ( dask#4927 ) John A Kirkham

Promote types in concatenate using _meta ( dask#4925 ) John A Kirkham

Add chunk type to html repr in Dask array ( dask#4895 ) Matthew Rocklin

• Add Dask Array._meta attribute ( dask#4543 ) Peter Andreas Entschev

Fix _meta slicing of flexible types ( dask#4912 ) Peter Andreas Entschev

Minor meta construction cleanup in concatenate ( dask#4937 ) Peter Andreas Entschev

Further relax Array meta checks for Xarray ( dask#4944 ) Matthew Rocklin

Support meta= keyword in da.from_delayed ( dask#4972 ) Matthew Rocklin

Concatenate meta along axis ( dask#4977 ) John A Kirkham

Use meta in stack ( dask#4976 ) John A Kirkham

Move blockwise_meta to more general compute_meta function ( dask#4954 ) Matthew Rocklin

Alias .partitions to .blocks attribute of dask arrays ( dask#4853 ) Genevieve Buckley

Drop outdated numpy_compat functions ( dask#4850 ) John A Kirkham

Allow da.eye to support arbitrary chunking sizes with chunks=’auto’ ( dask#4834 ) Anderson Banihirwe

Fix CI warnings in dask.array tests ( dask#4805 ) Tom Augspurger

Make map_blocks work with drop_axis + block_info ( dask#4831 ) Bruce Merry

Add SVG image and table in Array.repr_html ( dask#4794 ) Matthew Rocklin

ufunc: avoid array_wrap in favor of array_function ( dask#4708 ) Peter Andreas Entschev

Ensure trivial padding returns the original array ( dask#4990 ) John A Kirkham

Test da.block with 0-size arrays ( dask#4991 ) John A Kirkham

Core

Drop Python 2.7 ( dask#4919 ) Jim Crist

Quiet dependency installs in CI ( dask#4960 ) Tom Augspurger

Raise on warnings in tests ( dask#4916 ) Tom Augspurger

Add a diagnostics extra to setup.py (includes bokeh) ( dask#4924 ) John A Kirkham

Add newline delimter keyword to OpenFile ( dask#4935 ) btw08

Overload HighLevelGraphs values method ( dask#4918 ) James Bourbeau

Add await method to Dask collections ( dask#4901 ) Matthew Rocklin

Also ignore AttributeErrors which may occur if snappy (not python-snappy) is installed ( dask#4908 ) Mark Bell

Canonicalize key names in config.rename ( dask#4903 ) Ian Bolliger

Bump minimum partd to 0.3.10 ( dask#4890 ) Tom Augspurger

Catch async def SyntaxError ( dask#4836 ) James Bourbeau

catch IOError in ensure_file ( dask#4806 ) Justin Poehnelt

Cleanup CI warnings ( dask#4798 ) Tom Augspurger

Move distributed’s parse and format functions to dask.utils ( dask#4793 ) Matthew Rocklin

Apply black formatting ( dask#4983 ) James Bourbeau

Package license file in wheels ( dask#4988 ) John A Kirkham

DataFrame

Add an optional partition_size parameter to repartition ( dask#4416 ) George Sakkis

merge_asof and prefix_reduction ( dask#4877 ) Cody Johnson

Allow dataframes to be indexed by dask arrays ( dask#4882 ) Endre Mark Borza

Avoid deprecated message parameter in pytest.raises ( dask#4962 ) James Bourbeau

Update test_to_records to test with lengths argument( dask#4515 ) asmith26

Remove pandas pinning in Dataframe accessors ( dask#4955 ) Matthew Rocklin

Fix correlation of series with same names ( dask#4934 ) Philipp S. Sommer

Map Dask Series to Dask Series ( dask#4872 ) Justin Waugh

Warn in dd.merge on dtype warning ( dask#4917 ) mcsoini

Add groupby Covariance/Correlation ( dask#4889 ) Benjamin Zaitlen

keep index name with to_datetime ( dask#4905 ) Ian Bolliger

Add Parallel variance computation for dataframes ( dask#4865 ) Ksenia Bobrova

Add divmod implementation to arrays and dataframes ( dask#4884 ) Henrique Ribeiro

Add documentation for dataframe reshape methods ( dask#4896 ) tpanza

Avoid use of pandas.compat ( dask#4881 ) Tom Augspurger

Added accessor registration for Series, DataFrame, and Index ( dask#4829 ) Tom Augspurger

Add read_function keyword to read_json ( dask#4810 ) Richard J Zamora

Provide full type name in check_meta ( dask#4819 ) Matthew Rocklin

Correctly estimate bytes per row in read_sql_table ( dask#4807 ) Lijo Jose

Adding support of non-numeric data to describe() ( dask#4791 ) Ksenia Bobrova

Scalars for extension dtypes. ( dask#4459 ) Tom Augspurger

Call head before compute in dd.from_delayed ( dask#4802 ) Matthew Rocklin

Add support for rolling operations with larger window that partition size in DataFrames with Time-based index ( dask#4796 ) Jorge Pessoa

Update groupby-apply doc with warning ( dask#4800 ) Tom Augspurger

Change groupby-ness tests in _maybe_slice ( dask#4786 ) Benjamin Zaitlen

Add master best practices document ( dask#4745 ) Matthew Rocklin

Add document for how Dask works with GPUs ( dask#4792 ) Matthew Rocklin

Add cli API docs ( dask#4788 ) James Bourbeau

Ensure concat output has coherent dtypes ( dask#4692 ) Guillaume Lemaitre

Fixes pandas_datareader dependencies installation ( dask#4989 ) James Bourbeau

Accept pathlib.Path as pattern in read_hdf ( dask#3335 ) Jörg Dietrich

Documentation

Move CLI API docs to relavant pages ( dask#4980 ) James Bourbeau

Add to_datetime function to dataframe API docs Matthew Rocklin

Add documentation entry for dask.array.ma.average ( dask#4970 ) Bouwe Andela

Add bag.read_avro to bag API docs ( dask#4969 ) James Bourbeau

Fix typo ( dask#4968 ) mbarkhau

Docs: Drop support for Python 2.7 ( dask#4932 ) Hugo

Remove requirement to modify changelog ( dask#4915 ) Matthew Rocklin

Add documentation about meta column order ( dask#4887 ) Tom Augspurger

Add documentation note in DataFrame.shift ( dask#4886 ) Tom Augspurger

Docs: Fix typo ( dask#4868 ) Paweł Kordek

Put do/don’t into boxes for delayed best practice docs ( dask#3821 ) Martin Durant

Doc fixups ( dask#2528 ) Tom Augspurger

Add quansight to paid support doc section ( dask#4838 ) Martin Durant

Add document for custom startup ( dask#4833 ) Matthew Rocklin

Allow utils.derive_from to accept functions, apply across array ( dask#4804 ) Martin Durant

Add “Avoid Large Partitions” section to best practices ( dask#4808 ) Matthew Rocklin

Update URL for joblib to new website hosting their doc ( dask#4816 ) Christian Hudon