NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI · #807 most downloaded on PyPI
Parallel PyData with Task Scheduling
Last release 1 months ago
24 Aug 2026
Ships fairly regularly
a new release about every 5 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
2 versions withdrawn
withdrawn after publishing
12 years old
239 releases · first in 2015
- Avoid fusing dependencies of atop reductions ( dask#4207 ) Matthew Rocklin
Avoid fusing dependencies of atop reductions ( dask#4207 ) Matthew Rocklin
Improve memory footprint for dataframe correlation ( dask#4193 ) Damien Garaud
Add empty DataFrame check to boundary_slice ( dask#4212 ) James Bourbeau
Copy edit documentation ( dask#4197 ) ( dask#4204 ) ( dask#4198 ) ( dask#4199 ) ( dask#4200 ) ( dask#4202 ) ( dask#4209 ) Miguel Farrajota
Add stats module namespace ( dask#4206 ) James Bourbeau
Fix link in dataframe documentation ( dask#4208 ) James Bourbeau
Avoid fusing dependencies of atop reductions (4207) `Matthew Rocklin`_
Improve memory footprint for dataframe correlation (4193) `Damien Garaud`_
Add empty DataFrame check to boundary_slice (4212) `James Bourbeau`_
Copy edit documentation (4197) (4204) (4198) (4199) (4200) (4202) (4209) `Miguel Farrajota`_
Add stats module namespace (4206) `James Bourbeau`_
Fix link in dataframe documentation (4208) `James Bourbeau`_
One column per quarter.
- Only allocate the result space in wrapped_pad_func ( dask#4153 ) John A Kirkham
Only allocate the result space in wrapped_pad_func ( dask#4153 ) John A Kirkham
Generalize expand_pad_width to expand_pad_value ( dask#4150 ) John A Kirkham
Test da.pad with 2D linear_ramp case ( dask#4162 ) John A Kirkham
Fix import for broadcast_to. ( dask#4168 ) samc0de
Rewrite Dask Array’s pad to add only new chunks ( dask#4152 ) John A Kirkham
Validate index inputs to atop ( dask#4182 ) Matthew Rocklin
Dask.config set and get normalize underscores and hyphens ( dask#4143 ) James Bourbeau
Only subs on core collections, not subclasses ( dask#4159 ) Matthew Rocklin
Add block_size=0 option to HTTPFileSystem. ( dask#4171 ) Martin Durant
Add traverse support for dataclasses ( dask#4165 ) Armin Berres
Avoid optimization on sharedicts without dependencies ( dask#4181 ) Matthew Rocklin
Update the pytest version for TravisCI ( dask#4189 ) Damien Garaud
Use key_split rather than funcname in visualize names ( dask#4160 ) Matthew Rocklin
Add fix for DataFrame.setitem for index ( dask#4151 ) Anderson Banihirwe
Fix column choice when passing list of files to fastparquet ( dask#4174 ) Martin Durant
Pass engine_kwargs from read_sql_table to sqlalchemy ( dask#4187 ) Damien Garaud
Fix documentation in Delayed best practices example that returned an empty list ( dask#4147 ) Jonathan Fraine
Copy edit documentation ( dask#4164 ) ( dask#4175 ) ( dask#4185 ) ( dask#4192 ) ( dask#4191 ) ( dask#4190 ) ( dask#4180 ) Miguel Farrajota
Fix typo in docstring ( dask#4183 ) Carlos Valiente
Only allocate the result space in wrapped_pad_func (4153) `John A Kirkham`_
Generalize expand_pad_width to expand_pad_value (4150) `John A Kirkham`_
Test da.pad with 2D linear_ramp case (4162) `John A Kirkham`_
Fix import for broadcast_to. (4168) `samc0de`_
Rewrite Dask Array's pad to add only new chunks (4152) `John A Kirkham`_
Validate index inputs to atop (4182) `Matthew Rocklin`_
Dask.config set and get normalize underscores and hyphens (4143) `James Bourbeau`_
Only subs on core collections, not subclasses (4159) `Matthew Rocklin`_
Add block_size=0 option to HTTPFileSystem. (4171) `Martin Durant`_
Add traverse support for dataclasses (4165) `Armin Berres`_
Avoid optimization on sharedicts without dependencies (4181) `Matthew Rocklin`_
Update the pytest version for TravisCI (4189) `Damien Garaud`_
Use key_split rather than funcname in visualize names (4160) `Matthew Rocklin`_
Add fix for DataFrame.__setitem__ for index (4151) `Anderson Banihirwe`_
Fix column choice when passing list of files to fastparquet (4174) `Martin Durant`_
Pass engine_kwargs from read_sql_table to sqlalchemy (4187) `Damien Garaud`_
Fix documentation in Delayed best practices example that returned an empty list (4147) `Jonathan Fraine`_
Copy edit documentation (4164) (4175) (4185) (4192) (4191) (4190) (4180) `Miguel Farrajota`_
Fix typo in docstring (4183) `Carlos Valiente`_
- Avoid warnings and deprecated pandas methods ( dask#4115 ) Matthew Rocklin
Fuse Atop operations ( dask#3998 ), ( dask#4081 ) Matthew Rocklin
Support da.asanyarray on dask dataframes ( dask#4080 ) Matthew Rocklin
Remove unnecessary endianness check in datetime test ( dask#4113 ) Elliott Sales de Andrade
Set name=False in array foo_like functions ( dask#4116 ) Matthew Rocklin
Remove dask.array.ghost module ( dask#4121 ) Matthew Rocklin
Fix use of getargspec in dask array ( dask#4125 ) Stephan Hoyer
Adds dask.array.invert ( dask#4127 ), ( dask#4131 ) Anderson Banihirwe
Raise informative error on arg-reduction on unknown chunksize ( dask#4128 ), ( dask#4135 ) Matthew Rocklin
Normalize reversed slices in dask array ( dask#4126 ) Matthew Rocklin
Add bag.to_avro ( dask#4076 ) Martin Durant
Pull num_workers from config.get ( dask#4086 ), ( dask#4093 ) James Bourbeau
Fix invalid escape sequences with raw strings ( dask#4112 ) Elliott Sales de Andrade
Raise an error on the use of the get= keyword and set_options ( dask#4077 ) Matthew Rocklin
Add import for Azure DataLake storage, and add docs ( dask#4132 ) Martin Durant
Avoid collections.Mapping/Sequence ( dask#4138 ) Matthew Rocklin
Include index keyword in to_dask_dataframe ( dask#4071 ) Matthew Rocklin
add support for duplicate column names ( dask#4087 ) Jan Koch
Implement min_count for the DataFrame methods sum and prod ( dask#4090 ) Bart Broere
Remove pandas warnings in concat ( dask#4095 ) Matthew Rocklin
DataFrame.to_csv header option to only output headers in the first chunk ( dask#3909 ) Rahul Vaidya
Remove Series.to_parquet ( dask#4104 ) Justin Dennison
Avoid warnings and deprecated pandas methods ( dask#4115 ) Matthew Rocklin
Swap ‘old’ and ‘previous’ when reporting append error ( dask#4130 ) Martin Durant
Copy edit documentation ( dask#4073 ), ( dask#4074 ), ( dask#4094 ), ( dask#4097 ), ( dask#4107 ), ( dask#4124 ), ( dask#4133 ), ( dask#4139 ) Miguel Farrajota
Fix typo in code example ( dask#4089 ) Antonino Ingargiola
Add pycon 2018 presentation ( dask#4102 ) Javad
Quick description for gcsfs ( dask#4109 ) Martin Durant
Fixed typo in docstrings of read_sql_table method ( dask#4114 ) TakaakiFuruse
Make target directories in redirects if they don’t exist ( dask#4136 ) Matthew Rocklin
Fuse Atop operations (3998), (4081) `Matthew Rocklin`_
Support da.asanyarray on dask dataframes (4080) `Matthew Rocklin`_
Remove unnecessary endianness check in datetime test (4113) `Elliott Sales de Andrade`_
Set name=False in array foo_like functions (4116) `Matthew Rocklin`_
Remove dask.array.ghost module (4121) `Matthew Rocklin`_
Fix use of getargspec in dask array (4125) `Stephan Hoyer`_
Adds dask.array.invert (4127), (4131) `Anderson Banihirwe`_
Raise informative error on arg-reduction on unknown chunksize (4128), (4135) `Matthew Rocklin`_
Normalize reversed slices in dask array (4126) `Matthew Rocklin`_
Add bag.to_avro (4076) `Martin Durant`_
Pull num_workers from config.get (4086), (4093) `James Bourbeau`_
Fix invalid escape sequences with raw strings (4112) `Elliott Sales de Andrade`_
Raise an error on the use of the get= keyword and set_options (4077) `Matthew Rocklin`_
Add import for Azure DataLake storage, and add docs (4132) `Martin Durant`_
Avoid collections.Mapping/Sequence (4138) `Matthew Rocklin`_
Include index keyword in to_dask_dataframe (4071) `Matthew Rocklin`_
add support for duplicate column names (4087) `Jan Koch`_
Implement min_count for the DataFrame methods sum and prod (4090) `Bart Broere`_
Remove pandas warnings in concat (4095) `Matthew Rocklin`_
DataFrame.to_csv header option to only output headers in the first chunk (3909) `Rahul Vaidya`_
Remove Series.to_parquet (4104) `Justin Dennison`_
Avoid warnings and deprecated pandas methods (4115) `Matthew Rocklin`_
Swap 'old' and 'previous' when reporting append error (4130) `Martin Durant`_
Copy edit documentation (4073), (4074), (4094), (4097), (4107), (4124), (4133), (4139) `Miguel Farrajota`_
Fix typo in code example (4089) `Antonino Ingargiola`_
Add pycon 2018 presentation (4102) `Javad`_
Quick description for gcsfs (4109) `Martin Durant`_
Fixed typo in docstrings of read_sql_table method (4114) `TakaakiFuruse`_
Make target directories in redirects if they don't exist (4136) `Matthew Rocklin`_
- Implement apply_gufunc(..., axes=..., keepdims=...) ( dask#3985 ) Markus Gonser
Implement apply_gufunc(..., axes=..., keepdims=...) ( dask#3985 ) Markus Gonser
Fix typo in datasets.make_people ( dask#4069 ) Matthew Rocklin
Added percentiles options for dask.dataframe.describe method ( dask#4067 ) Zhenqing Li
Add DataFrame.partitions accessor similar to Array.blocks ( dask#4066 ) Matthew Rocklin
Pass get functions and Clients through scheduler keyword ( dask#4062 ) Matthew Rocklin
Fix Typo on hpc example. (missing = in kwarg). ( dask#4068 ) Matthias Bussonier
Extensive copy-editing: ( dask#4065 ), ( dask#4064 ), ( dask#4063 ) Miguel Farrajota
Implement apply_gufunc(..., axes=..., keepdims=...) (3985) `Markus Gonser`_
Fix typo in datasets.make_people (4069) `Matthew Rocklin`_
Added percentiles options for dask.dataframe.describe method (4067) `Zhenqing Li`_
Add DataFrame.partitions accessor similar to Array.blocks (4066) `Matthew Rocklin`_
Pass get functions and Clients through scheduler keyword (4062) `Matthew Rocklin`_
Fix Typo on hpc example. (missing = in kwarg). (4068) `Matthias Bussonier`_
Extensive copy-editing: (4065), (4064), (4063) `Miguel Farrajota`_
- Make da.RandomState extensible to other modules ( dask#4041 ) Matthew Rocklin
Make da.RandomState extensible to other modules ( dask#4041 ) Matthew Rocklin
Support unknown dims in ravel no-op case ( dask#4055 ) Jim Crist
Add basic infrastructure for cupy ( dask#4019 ) Matthew Rocklin
Avoid asarray and lock arguments for from_array(getitem) ( dask#4044 ) Matthew Rocklin
Move local imports in corrcoef to global imports ( dask#4030 ) John A Kirkham
Move local indices import to global import ( dask#4029 ) John A Kirkham
Fix-up Dask Array’s fromfunction w.r.t. dtype and kwargs ( dask#4028 ) John A Kirkham
Don’t use dummy expansion for trim_internal in overlapped ( dask#3964 ) Mark Harfouche
Add unravel_index ( dask#3958 ) John A Kirkham
Sort result in Bag.frequencies ( dask#4033 ) Matthew Rocklin
Add support for npartitions=1 edge case in groupby ( dask#4050 ) James Bourbeau
Add new random dataset for people ( dask#4018 ) Matthew Rocklin
Improve performance of bag.read_text on small files ( dask#4013 ) Eric Wolak
Add bag.read_avro ( dask#4000 ) ( dask#4007 ) Martin Durant
Added an index parameter to dask.dataframe.from_dask_array() for creating a dask DataFrame from a dask Array with a given index. ( dask#3991 ) Tom Augspurger
Improve sub-classability of dask dataframe ( dask#4015 ) Matthew Rocklin
Fix failing hdfs test [test-hdfs] ( dask#4046 ) Jim Crist
fuse_subgraphs works without normal fuse ( dask#4042 ) Jim Crist
Make path for reading many parquet files without prescan ( dask#3978 ) Martin Durant
Index in dd.from_dask_array ( dask#3991 ) Tom Augspurger
Making skiprows accept lists ( dask#3975 ) Julia Signell
Fail early in fastparquet read for nonexistent column ( dask#3989 ) Martin Durant
Add support for npartitions=1 edge case in groupby ( dask#4050 ) James Bourbeau
Automatically wrap large arguments with dask.delayed in map_blocks/partitions ( dask#4002 ) Matthew Rocklin
Fuse linear chains of subgraphs ( dask#3979 ) Jim Crist
Make multiprocessing context configurable ( dask#3763 ) Itamar Turner-Trauring
Extensive copy-editing ( dask#4049 ), ( dask#4034 ), ( dask#4031 ), ( dask#4020 ), ( dask#4021 ), ( dask#4022 ), ( dask#4023 ), ( dask#4016 ), ( dask#4017 ), ( dask#4010 ), ( dask#3997 ), ( dask#3996 ), Miguel Farrajota
Update shuffle method selection docs ( dask#4048 ) James Bourbeau
Remove docs/source/examples, point to examples.dask.org ( dask#4014 ) Matthew Rocklin
Replace readthedocs links with dask.org ( dask#4008 ) Matthew Rocklin
Updates DataFrame.to_hdf docstring for returned values ( dask#3992 ) James Bourbeau
Make da.RandomState extensible to other modules (4041) `Matthew Rocklin`_
Support unknown dims in ravel no-op case (4055) `Jim Crist`_
Add basic infrastructure for cupy (4019) `Matthew Rocklin`_
Avoid asarray and lock arguments for from_array(getitem) (4044) `Matthew Rocklin`_
Move local imports in corrcoef to global imports (4030) `John A Kirkham`_
Move local indices import to global import (4029) `John A Kirkham`_
Fix-up Dask Array's fromfunction w.r.t. dtype and kwargs (4028) `John A Kirkham`_
Don't use dummy expansion for trim_internal in overlapped (3964) `Mark Harfouche`_
Add unravel_index (3958) `John A Kirkham`_
Sort result in Bag.frequencies (4033) `Matthew Rocklin`_
Add support for npartitions=1 edge case in groupby (4050) `James Bourbeau`_
Add new random dataset for people (4018) `Matthew Rocklin`_
Improve performance of bag.read_text on small files (4013) `Eric Wolak`_
Add bag.read_avro (4000) (4007) `Martin Durant`_
Added an index parameter to dask.dataframe.from_dask_array for creating a dask DataFrame from a dask Array with a given index. (3991) `Tom Augspurger`_
Improve sub-classability of dask dataframe (4015) `Matthew Rocklin`_
Fix failing hdfs test [test-hdfs] (4046) `Jim Crist`_
fuse_subgraphs works without normal fuse (4042) `Jim Crist`_
Make path for reading many parquet files without prescan (3978) `Martin Durant`_
Index in dd.from_dask_array (3991) `Tom Augspurger`_
Making skiprows accept lists (3975) `Julia Signell`_
Fail early in fastparquet read for nonexistent column (3989) `Martin Durant`_
Add support for npartitions=1 edge case in groupby (4050) `James Bourbeau`_
Automatically wrap large arguments with dask.delayed in map_blocks/partitions (4002) `Matthew Rocklin`_
Fuse linear chains of subgraphs (3979) `Jim Crist`_
Make multiprocessing context configurable (3763) `Itamar Turner-Trauring`_
Extensive copy-editing (4049), (4034), (4031), (4020), (4021), (4022), (4023), (4016), (4017), (4010), (3997), (3996), `Miguel Farrajota`_
Update shuffle method selection docs (4048) `James Bourbeau`_
Remove docs/source/examples, point to examples.dask.org (4014) `Matthew Rocklin`_
Replace readthedocs links with dask.org (4008) `Matthew Rocklin`_
Updates DataFrame.to_hdf docstring for returned values (3992) `James Bourbeau`_
- apply_gufunc implements automatic infer of functions output dtypes ( dask#3936 ) Markus Gonser
apply_gufunc implements automatic infer of functions output dtypes ( dask#3936 ) Markus Gonser
Fix array histogram range error when array has nans ( dask#3980 ) James Bourbeau
Issue 3937 follow up, int type checks. ( dask#3956 ) Yu Feng
from_array: add @martindurant’s explaining of how hashing is done for an array. ( dask#3965 ) Mark Harfouche
Support gradient with coordinate ( dask#3949 ) Keisuke Fujii
Fix use of has_keyword with partial in Python 2.7 ( dask#3966 ) Mark Harfouche
Set pyarrow as default for HDFS ( dask#3957 ) Matthew Rocklin
Use dask_sphinx_theme ( dask#3963 ) Matthew Rocklin
Use JupyterLab in Binder links from main page Matthew Rocklin
DOC: fixed sphinx syntax ( dask#3960 ) Tom Augspurger
apply_gufunc implements automatic infer of functions output dtypes (3936) `Markus Gonser`_
Fix array histogram range error when array has nans (3980) `James Bourbeau`_
Issue 3937 follow up, int type checks. (3956) `Yu Feng`_
from_array: add @martindurant's explaining of how hashing is done for an array. (3965) `Mark Harfouche`_
Support gradient with coordinate (3949) `Keisuke Fujii`_
Fix use of has_keyword with partial in Python 2.7 (3966) `Mark Harfouche`_
Set pyarrow as default for HDFS (3957) `Matthew Rocklin`_
Use dask_sphinx_theme (3963) `Matthew Rocklin`_
Use JupyterLab in Binder links from main page `Matthew Rocklin`_
DOC: fixed sphinx syntax (3960) `Tom Augspurger`_
- Fix NumPy issubtype deprecation warning ( dask#3939 ) Bruce Merry
Don’t enforce dtype if result has no dtype ( dask#3928 ) Matthew Rocklin
Fix NumPy issubtype deprecation warning ( dask#3939 ) Bruce Merry
Fix arg reduction tokens to be unique with different arguments ( dask#3955 ) Tobias de Jong
Coerce numpy integers to ints in slicing code ( dask#3944 ) Yu Feng
Linalg.norm ndim along axis partial fix ( dask#3933 ) Tobias de Jong
Deterministic DataFrame.set_index ( dask#3867 ) George Sakkis
Fix divisions in read_parquet when dealing with filters #3831 #3930 ( dask#3923 ) ( dask#3931 ) @andrethrill
Fixing returning type in categorical.as_known ( dask#3888 ) Sriharsha Hatwar
Fix DataFrame.assign for callables ( dask#3919 ) Tom Augspurger
Include partitions with no width in repartition ( dask#3941 ) Matthew Rocklin
Don’t constrict stage/k dtype in dataframe shuffle ( dask#3942 ) Matthew Rocklin
DOC: Add hint on how to render task graphs horizontally ( dask#3922 ) Uwe Korn
Add try-now button to main landing page ( dask#3924 ) Matthew Rocklin
Don't enforce dtype if result has no dtype (3928) `Matthew Rocklin`_
Fix NumPy issubtype deprecation warning (3939) `Bruce Merry`_
Fix arg reduction tokens to be unique with different arguments (3955) `Tobias de Jong`_
Coerce numpy integers to ints in slicing code (3944) `Yu Feng`_
Linalg.norm ndim along axis partial fix (3933) `Tobias de Jong`_
Deterministic DataFrame.set_index (3867) `George Sakkis`_
Fix divisions in read_parquet when dealing with filters #3831 #3930 (3923) (3931) `@andrethrill`_
Fixing returning type in categorical.as_known (3888) `Sriharsha Hatwar`_
Fix DataFrame.assign for callables (3919) `Tom Augspurger`_
Include partitions with no width in repartition (3941) `Matthew Rocklin`_
Don't constrict stage/k dtype in dataframe shuffle (3942) `Matthew Rocklin`_
DOC: Add hint on how to render task graphs horizontally (3922) `Uwe Korn`_
Add try-now button to main landing page (3924) `Matthew Rocklin`_
- Fix numpy deprecation warning on tuple indexing ( dask#3851 ) Tobias de Jong
Support coordinate in gradient ( dask#3949 ) Keisuke Fujii
Fix argtopk split_every bug ( dask#3810 ) crusaderky
Ensure result computing dask.array.isnull() always gives a numpy array ( dask#3825 ) Stephan Hoyer
Support concatenate for scipy.sparse in dask array ( dask#3836 ) Matthew Rocklin
Fix argtopk on 32-bit systems. ( dask#3823 ) Elliott Sales de Andrade
Normalize keys in rechunk ( dask#3820 ) Matthew Rocklin
Allow shape of dask.array to be a numpy array ( dask#3844 ) Mark Harfouche
Fix numpy deprecation warning on tuple indexing ( dask#3851 ) Tobias de Jong
Rename ghost module to overlap ( dask#3830 ) Robert Sare
Re-add the ghost import to da init ( dask#3861 ) Jim Crist
Ensure copy preserves masked arrays ( dask#3852 ) Tobias de Jong
Added dtype and sparse keywords to dask.dataframe.get_dummies() ( dask#3792 ) Tom Augspurger
Added dask.dataframe.to_dask_array() for converting a Dask Series or DataFrame to a Dask Array, possibly with known chunk sizes ( dask#3884 ) Tom Augspurger
Changed the behavior for dask.array.asarray() for dask dataframe and series inputs. Previously, the series was eagerly converted to an in-memory NumPy array before creating a dask array with known chunks sizes. This caused unexpectedly high memory usage. Now, no intermediate NumPy array is created, and a Dask array with unknown chunk sizes is returned ( dask#3884 ) Tom Augspurger
DataFrame.iloc ( dask#3805 ) Tom Augspurger
When reading multiple paths, expand globs. ( dask#3828 ) Irina Truong
Added index column name after resample ( dask#3833 ) Eric Bonfadini
Add (lazy) shape property to dataframe and series ( dask#3212 ) Henrique Ribeiro
Fix failing hdfs test [test-hdfs] ( dask#3858 ) Jim Crist
Fixes for pyarrow 0.10.0 release ( dask#3860 ) Jim Crist
Rename to_csv keys for diagnostics ( dask#3890 ) Matthew Rocklin
Match pandas warnings for concat sort ( dask#3897 ) Tom Augspurger
Include filename in read_csv ( dask#3908 ) Julia Signell
Better error message on import when missing common dependencies ( dask#3771 ) Danilo Horta
Drop Python 3.4 support ( dask#3840 ) Jim Crist
Remove expired deprecation warnings ( dask#3841 ) Jim Crist
Add DASK_ROOT_CONFIG environment variable ( dask#3849 ) Joe Hamman
Don’t cull in local scheduler, do cull in delayed ( dask#3856 ) Jim Crist
Increase conda download retries ( dask#3857 ) Jim Crist
Add python_requires and Trove classifiers ( dask#3855 ) @hugovk
Fix collections.abc deprecation warnings in Python 3.7.0 ( dask#3876 ) Jan Margeta
Allow dot jpeg to xfail in visualize tests ( dask#3896 ) Matthew Rocklin
Add Python 3.7 to travis.yml ( dask#3894 ) Matthew Rocklin
Add expand_environment_variables to dask.config ( dask#3893 ) Joe Hamman
Fix typo in import statement of diagnostics ( dask#3826 ) John Mrziglod
Add link to YARN docs ( dask#3838 ) Jim Crist
fix of minor typos in landing page index.html ( dask#3746 ) Christoph Moehl
Update delayed-custom.rst ( dask#3850 ) Anderson Banihirwe
DOC: clarify delayed docstring ( dask#3709 ) Scott Sievert
Add new presentations ( dask#3880 ) Javad
Add dask array normalize_chunks to documentation ( dask#3878 ) Daniel Rothenberg
Docs: Fix link to snakeviz ( dask#3900 ) Hans Moritz Günther
Add missing ` to docstring ( dask#3915 ) @rtobar
Support coordinate in gradient (3949) `Keisuke Fujii`_
Fix argtopk split_every bug (3810) `crusaderky`_
Ensure result computing dask.array.isnull() always gives a numpy array (3825) `Stephan Hoyer`_
Support concatenate for scipy.sparse in dask array (3836) `Matthew Rocklin`_
Fix argtopk on 32-bit systems. (3823) `Elliott Sales de Andrade`_
Normalize keys in rechunk (3820) `Matthew Rocklin`_
Allow shape of dask.array to be a numpy array (3844) `Mark Harfouche`_
Fix numpy deprecation warning on tuple indexing (3851) `Tobias de Jong`_
Rename ghost module to overlap (3830) `Robert Sare`_
Re-add the ghost import to da __init__ (3861) `Jim Crist`_
Ensure copy preserves masked arrays (3852) `Tobias de Jong`_
Added dtype and sparse keywords to dask.dataframe.get_dummies (3792) `Tom Augspurger`_
Added dask.dataframe.to_dask_array for converting a Dask Series or DataFrame to a Dask Array, possibly with known chunk sizes (3884) Tom Augspurger
Changed the behavior for dask.array.asarray for dask dataframe and series inputs. Previously, the series was eagerly converted to an in-memory NumPy array before creating a dask array with known chunks sizes. This caused unexpectedly high memory usage. Now, no intermediate NumPy array is created, and a Dask array with unknown chunk sizes is returned (3884) Tom Augspurger
DataFrame.iloc (3805) `Tom Augspurger`_
When reading multiple paths, expand globs. (3828) `Irina Truong`_
Added index column name after resample (3833) `Eric Bonfadini`_
Add (lazy) shape property to dataframe and series (3212) `Henrique Ribeiro`_
Fix failing hdfs test [test-hdfs] (3858) `Jim Crist`_
Fixes for pyarrow 0.10.0 release (3860) `Jim Crist`_
Rename to_csv keys for diagnostics (3890) `Matthew Rocklin`_
Match pandas warnings for concat sort (3897) `Tom Augspurger`_
Include filename in read_csv (3908) `Julia Signell`_
Better error message on import when missing common dependencies (3771) `Danilo Horta`_
Drop Python 3.4 support (3840) `Jim Crist`_
Remove expired deprecation warnings (3841) `Jim Crist`_
Add DASK_ROOT_CONFIG environment variable (3849) `Joe Hamman`_
Don't cull in local scheduler, do cull in delayed (3856) `Jim Crist`_
Increase conda download retries (3857) `Jim Crist`_
Add python_requires and Trove classifiers (3855) `@hugovk`_
Fix collections.abc deprecation warnings in Python 3.7.0 (3876) `Jan Margeta`_
Allow dot jpeg to xfail in visualize tests (3896) `Matthew Rocklin`_
Add Python 3.7 to travis.yml (3894) `Matthew Rocklin`_
Add expand_environment_variables to dask.config (3893) `Joe Hamman`_
Fix typo in import statement of diagnostics (3826) `John Mrziglod`_
Add link to YARN docs (3838) `Jim Crist`_
fix of minor typos in landing page index.html (3746) `Christoph Moehl`_
Update delayed-custom.rst (3850) `Anderson Banihirwe`_
DOC: clarify delayed docstring (3709) `Scott Sievert`_
Add new presentations (3880) `Javad`_
Add dask array normalize_chunks to documentation (3878) `Daniel Rothenberg`_
Docs: Fix link to snakeviz (3900) `Hans Moritz Günther`_
Add missing ` to docstring (3915) `@rtobar`_
- Reimplemented argtopk to make it release the GIL ( dask#3610 ) crusaderky
Reimplemented argtopk to make it release the GIL ( dask#3610 ) crusaderky
Don’t overlap on non-overlapped dimensions in map_overlap ( dask#3653 ) Matthew Rocklin
Fix linalg.tsqr for dimensions of uncertain length ( dask#3662 ) Jeremy Chen
Break apart uneven array-of-int slicing to separate chunks ( dask#3648 ) Matthew Rocklin
Align auto chunks to provided chunks, rather than shape ( dask#3679 ) Matthew Rocklin
Adds endpoint and retstep support for linspace ( dask#3675 ) James Bourbeau
Implement .blocks accessor ( dask#3689 ) Matthew Rocklin
Add block_info keyword to map_blocks functions ( dask#3686 ) Matthew Rocklin
Slice by dask array of ints ( dask#3407 ) crusaderky
Support dtype in arange ( dask#3722 ) crusaderky
Fix argtopk with uneven chunks ( dask#3720 ) crusaderky
Raise error when replace=False in da.choice ( dask#3765 ) James Bourbeau
Update chunks in Array.setitem ( dask#3767 ) Itamar Turner-Trauring
Add a chunksize convenience property ( dask#3777 ) Jacob Tomlinson
Fix and simplify array slicing behavior when step < 0 ( dask#3702 ) Ziyao Wei
Ensure to_zarr with return_stored True returns a Dask Array ( dask#3786 ) John A Kirkham
Add last_endline optional parameter in to_textfiles ( dask#3745 ) George Sakkis
Add aggregate function for rolling objects ( dask#3772 ) Gerome Pistre
Properly tokenize cumulative groupby aggregations ( dask#3799 ) Cloves Almeida
Add the @ operator to the delayed objects ( dask#3691 ) Mark Harfouche
Add delayed best practices to documentation ( dask#3737 ) Matthew Rocklin
Fix @delayed decorator for methods and add tests ( dask#3757 ) Ziyao Wei
Fix extra progressbar ( dask#3669 ) Mike Neish
Allow tasks back onto ordering stack if they have one dependency ( dask#3652 ) Matthew Rocklin
Prefer end-tasks with low numbers of dependencies when ordering ( dask#3588 ) Tom Augspurger
Add assert_eq to top-level modules ( dask#3726 ) Matthew Rocklin
Test that dask collections can hold scipy.sparse arrays ( dask#3738 ) Matthew Rocklin
Fix setup of lz4 decompression functions ( dask#3782 ) Elliott Sales de Andrade
Add datasets module ( dask#3780 ) Matthew Rocklin
Reimplemented argtopk to make it release the GIL (3610) `crusaderky`_
Don't overlap on non-overlapped dimensions in map_overlap (3653) `Matthew Rocklin`_
Fix linalg.tsqr for dimensions of uncertain length (3662) `Jeremy Chen`_
Break apart uneven array-of-int slicing to separate chunks (3648) `Matthew Rocklin`_
Align auto chunks to provided chunks, rather than shape (3679) `Matthew Rocklin`_
Adds endpoint and retstep support for linspace (3675) `James Bourbeau`_
Implement .blocks accessor (3689) `Matthew Rocklin`_
Add block_info keyword to map_blocks functions (3686) `Matthew Rocklin`_
Slice by dask array of ints (3407) `crusaderky`_
Support dtype in arange (3722) `crusaderky`_
Fix argtopk with uneven chunks (3720) `crusaderky`_
Raise error when replace=False in da.choice (3765) `James Bourbeau`_
Update chunks in Array.__setitem__ (3767) `Itamar Turner-Trauring`_
Add a chunksize convenience property (3777) `Jacob Tomlinson`_
Fix and simplify array slicing behavior when step < 0 (3702) `Ziyao Wei`_
Ensure to_zarr with return_stored True returns a Dask Array (3786) `John A Kirkham`_
Add last_endline optional parameter in to_textfiles (3745) `George Sakkis`_
Add aggregate function for rolling objects (3772) `Gerome Pistre`_
Properly tokenize cumulative groupby aggregations (3799) `Cloves Almeida`_
Add the @ operator to the delayed objects (3691) `Mark Harfouche`_
Add delayed best practices to documentation (3737) `Matthew Rocklin`_
Fix @delayed decorator for methods and add tests (3757) `Ziyao Wei`_
Fix extra progressbar (3669) `Mike Neish`_
Allow tasks back onto ordering stack if they have one dependency (3652) `Matthew Rocklin`_
Prefer end-tasks with low numbers of dependencies when ordering (3588) `Tom Augspurger`_
Add assert_eq to top-level modules (3726) `Matthew Rocklin`_
Test that dask collections can hold scipy.sparse arrays (3738) `Matthew Rocklin`_
Fix setup of lz4 decompression functions (3782) `Elliott Sales de Andrade`_
Add datasets module (3780) `Matthew Rocklin`_
- from_array now supports scalar types and nested lists/tuples in input, just like all numpy functions do; it also produces a simpler graph when the i
from_array now supports scalar types and nested lists/tuples in input, just like all numpy functions do; it also produces a simpler graph when the input is a plain ndarray ( dask#3568 ) crusaderky
Fix slicing of big arrays due to cumsum dtype bug ( dask#3620 ) Marco Rossi
Add Dask Array implementation of pad ( dask#3578 ) John A Kirkham
Fix array random API examples ( dask#3625 ) James Bourbeau
Add average function to dask array ( dask#3640 ) James Bourbeau
Tokenize ghost_internal with axes ( dask#3643 ) Matthew Rocklin
Add outer for Dask Arrays ( dask#3658 ) John A Kirkham
Add Index.to_series method ( dask#3613 ) Henrique Ribeiro
Fix missing partition columns in pyarrow-parquet ( dask#3636 ) Martin Durant
Minor tweaks to CI ( dask#3629 ) crusaderky
Add back dask.utils.effective_get ( dask#3642 ) Matthew Rocklin
DASK_CONFIG dictates config write location ( dask#3621 ) Jim Crist
Replace ‘collections’ key in unpack_collections with unique key ( dask#3632 ) Yu Feng
Avoid deepcopy in dask.config.set ( dask#3649 ) Matthew Rocklin
from_array now supports scalar types and nested lists/tuples in input, just like all numpy functions do; it also produces a simpler graph when the input is a plain ndarray (3568) `crusaderky`_
Fix slicing of big arrays due to cumsum dtype bug (3620) `Marco Rossi`_
Add Dask Array implementation of pad (3578) `John A Kirkham`_
Fix array random API examples (3625) `James Bourbeau`_
Add average function to dask array (3640) `James Bourbeau`_
Tokenize ghost_internal with axes (3643) `Matthew Rocklin`_
Add outer for Dask Arrays (3658) `John A Kirkham`_
Add Index.to_series method (3613) `Henrique Ribeiro`_
Fix missing partition columns in pyarrow-parquet (3636) `Martin Durant`_
Minor tweaks to CI (3629) `crusaderky`_
Add back dask.utils.effective_get (3642) `Matthew Rocklin`_
DASK_CONFIG dictates config write location (3621) `Jim Crist`_
Replace 'collections' key in unpack_collections with unique key (3632) `Yu Feng`_
Avoid deepcopy in dask.config.set (3649) `Matthew Rocklin`_
- Add to/from_zarr for Zarr-format datasets and arrays ( dask#3460 ) Martin Durant
Add to/from_zarr for Zarr-format datasets and arrays ( dask#3460 ) Martin Durant
Experimental addition of generalized ufunc support, apply_gufunc , gufunc , and as_gufunc ( dask#3109 ) ( dask#3526 ) ( dask#3539 ) Markus Gonser
Avoid unnecessary rechunking tasks ( dask#3529 ) Matthew Rocklin
Compute dtypes at runtime for fft ( dask#3511 ) Matthew Rocklin
Generate UUIDs for all da.store operations ( dask#3540 ) Martin Durant
Correct internal dimension of Dask’s SVD ( dask#3517 ) John A Kirkham
BUG: do not raise IndexError for identity slice in array.vindex ( dask#3559 ) Scott Sievert
Adds isneginf and isposinf ( dask#3581 ) John A Kirkham
Drop Dask Array’s learn module ( dask#3580 ) John A Kirkham
added sfqr (short-and-fat) as a counterpart to tsqr… ( dask#3575 ) Jeremy Chen
Allow 0-width chunks in dask.array.rechunk ( dask#3591 ) Marc Pfister
Document Dask Array’s nan_to_num in public API ( dask#3599 ) John A Kirkham
Show block example ( dask#3601 ) John A Kirkham
Replace token= keyword with name= in map_blocks ( dask#3597 ) Matthew Rocklin
Disable locking in to_zarr (needed for using to_zarr in a distributed context) ( dask#3607 ) John A Kirkham
Support Zarr Arrays in to_zarr / from_zarr ( dask#3561 ) John A Kirkham
Added recursion to array/linalg/tsqr to better manage the single core bottleneck ( dask#3586 ) Jeremy Chan ( dask#3396 ) crusaderky
Add to/read_json ( dask#3494 ) Martin Durant
Adds index to unsupported arguments for DataFrame.rename method ( dask#3522 ) James Bourbeau
Adds support to subset Dask DataFrame columns using numpy.ndarray , pandas.Series , and pandas.Index objects ( dask#3536 ) James Bourbeau
Raise error if meta columns do not match dataframe ( dask#3485 ) Christopher Ren
Add index to unsupprted argument for DataFrame.rename ( dask#3522 ) James Bourbeau
Adds support for subsetting DataFrames with pandas Index/Series and numpy ndarrays ( dask#3536 ) James Bourbeau
Dataframe sample method docstring fix ( dask#3566 ) James Bourbeau
fixes dd.read_json to infer file compression ( dask#3594 ) Matt Lee
Adds n to sample method ( dask#3606 ) James Bourbeau
Add fastparquet ParquetFile object support ( dask#3573 ) @andrethrill
Rename method= keyword to shuffle= in bag.groupby ( dask#3470 ) Matthew Rocklin
Replace get= keyword with scheduler= keyword ( dask#3448 ) Matthew Rocklin
Add centralized dask.config module to handle configuration for all Dask subprojects ( dask#3432 ) ( dask#3513 ) ( dask#3520 ) Matthew Rocklin
Add dask-ssh CLI Options and Description. ( dask#3476 ) @beomi
Read whole files fix regardless of header for HTTP ( dask#3496 ) Martin Durant
Adds synchronous scheduler syntax to debugging docs ( dask#3509 ) James Bourbeau
Replace dask.set_options with dask.config.set ( dask#3502 ) Matthew Rocklin
Update sphinx readthedocs-theme ( dask#3516 ) Matthew Rocklin
Introduce “auto” value for normalize_chunks ( dask#3507 ) Matthew Rocklin
Fix check in configuration with env=None ( dask#3562 ) Simon Perkins
Update sizeof definitions ( dask#3582 ) Matthew Rocklin
Remove –verbose flag from travis-ci ( dask#3477 ) Matthew Rocklin
Remove “da.random” from random array keys ( dask#3604 ) Matthew Rocklin
Add to/from_zarr for Zarr-format datasets and arrays (3460) `Martin Durant`_
Experimental addition of generalized ufunc support, apply_gufunc, gufunc, and as_gufunc (3109) (3526) (3539) `Markus Gonser`_
Avoid unnecessary rechunking tasks (3529) `Matthew Rocklin`_
Compute dtypes at runtime for fft (3511) `Matthew Rocklin`_
Generate UUIDs for all da.store operations (3540) `Martin Durant`_
Correct internal dimension of Dask's SVD (3517) `John A Kirkham`_
BUG: do not raise IndexError for identity slice in array.vindex (3559) `Scott Sievert`_
Adds isneginf and isposinf (3581) `John A Kirkham`_
Drop Dask Array's learn module (3580) `John A Kirkham`_
added sfqr (short-and-fat) as a counterpart to tsqr… (3575) `Jeremy Chen`_
Allow 0-width chunks in dask.array.rechunk (3591) `Marc Pfister`_
Document Dask Array's nan_to_num in public API (3599) `John A Kirkham`_
Show block example (3601) `John A Kirkham`_
Replace token= keyword with name= in map_blocks (3597) `Matthew Rocklin`_
Disable locking in to_zarr (needed for using to_zarr in a distributed context) (3607) `John A Kirkham`_
Support Zarr Arrays in to_zarr/from_zarr (3561) `John A Kirkham`_
Added recursion to array/linalg/tsqr to better manage the single core bottleneck (3586) `Jeremy Chan`_ (3396) `crusaderky`_
Add to/read_json (3494) `Martin Durant`_
Adds index to unsupported arguments for DataFrame.rename method (3522) `James Bourbeau`_
Adds support to subset Dask DataFrame columns using numpy.ndarray, pandas.Series, and pandas.Index objects (3536) `James Bourbeau`_
Raise error if meta columns do not match dataframe (3485) `Christopher Ren`_
Add index to unsupprted argument for DataFrame.rename (3522) `James Bourbeau`_
Adds support for subsetting DataFrames with pandas Index/Series and numpy ndarrays (3536) `James Bourbeau`_
Dataframe sample method docstring fix (3566) `James Bourbeau`_
fixes dd.read_json to infer file compression (3594) `Matt Lee`_
Adds n to sample method (3606) `James Bourbeau`_
Add fastparquet ParquetFile object support (3573) `@andrethrill`_
Rename method= keyword to shuffle= in bag.groupby (3470) `Matthew Rocklin`_
Replace get= keyword with scheduler= keyword (3448) `Matthew Rocklin`_
Add centralized dask.config module to handle configuration for all Dask subprojects (3432) (3513) (3520) `Matthew Rocklin`_
Add dask-ssh CLI Options and Description. (3476) `@beomi`_
Read whole files fix regardless of header for HTTP (3496) `Martin Durant`_
Adds synchronous scheduler syntax to debugging docs (3509) `James Bourbeau`_
Replace dask.set_options with dask.config.set (3502) `Matthew Rocklin`_
Update sphinx readthedocs-theme (3516) `Matthew Rocklin`_
Introduce "auto" value for normalize_chunks (3507) `Matthew Rocklin`_
Fix check in configuration with env=None (3562) `Simon Perkins`_
Update sizeof definitions (3582) `Matthew Rocklin`_
Remove --verbose flag from travis-ci (3477) `Matthew Rocklin`_
Remove "da.random" from random array keys (3604) `Matthew Rocklin`_
- Fix rechunk with chunksize of -1 in a dict ( dask#3469 ) Stephan Hoyer
Fix rechunk with chunksize of -1 in a dict ( dask#3469 ) Stephan Hoyer
einsum now accepts the split_every parameter ( dask#3471 ) crusaderky
Improved slicing performance ( dask#3479 ) Yu Feng
Compatibility with pandas 0.23.0 ( dask#3499 ) Tom Augspurger
Fix rechunk with chunksize of -1 in a dict (3469) `Stephan Hoyer`_
einsum now accepts the split_every parameter (3471) `crusaderky`_
Improved slicing performance (3479) `Yu Feng`_
Compatibility with pandas 0.23.0 (3499) `Tom Augspurger`_
- Add support for indexing Dask DataFrames with string subclasses ( dask#3461 ) James Bourbeau
Add support for indexing Dask DataFrames with string subclasses ( dask#3461 ) James Bourbeau
Allow using both sorted_index and chunksize in read_hdf ( dask#3463 ) Pierre Bartet
Pass filesystem to arrow piece reader ( dask#3466 ) Martin Durant
Switches to using dask.compat string_types ( dask#3462 ) James Bourbeau
Add support for indexing Dask DataFrames with string subclasses (3461) `James Bourbeau`_
Allow using both sorted_index and chunksize in read_hdf (3463) `Pierre Bartet`_
Pass filesystem to arrow piece reader (3466) `Martin Durant`_
Switches to using dask.compat string_types (3462) `James Bourbeau`_
- The topk API has changed from topk(k, array) to the more conventional topk(array, k). The legacy API still works but is now deprecated. ( dask#2965…
Add einsum for Dask Arrays ( dask#3412 ) Simon Perkins
Add piecewise for Dask Arrays ( dask#3350 ) John A Kirkham
Fix handling of nan in broadcast_shapes ( dask#3356 ) John A Kirkham
Add isin for dask arrays ( dask#3363 ). Stephan Hoyer
Overhauled topk for Dask Arrays: faster algorithm, particularly for large k’s; added support for multiple axes, recursive aggregation, and an option to pick the bottom k elements instead. ( dask#3395 ) crusaderky
The topk API has changed from topk(k, array) to the more conventional topk(array, k). The legacy API still works but is now deprecated. ( dask#2965 ) crusaderky
New function argtopk for Dask Arrays ( dask#3396 ) crusaderky
Fix handling partial depth and boundary in map_overlap ( dask#3445 ) John A Kirkham
Add gradient for Dask Arrays ( dask#3434 ) John A Kirkham
Allow t as shorthand for table in to_hdf for pandas compatibility ( dask#3330 ) Jörg Dietrich
Added top level isna method for Dask DataFrames ( dask#3294 ) Christopher Ren
Fix selection on partition column on read_parquet for engine="pyarrow" ( dask#3207 ) Uwe Korn
Added DataFrame.squeeze method ( dask#3366 ) Christopher Ren
Added infer_divisions option to read_parquet to specify whether read engines should compute divisions ( dask#3387 ) Jon Mease
Added support for inferring division for engine="pyarrow" ( dask#3387 ) Jon Mease
Provide more informative error message for meta= errors ( dask#3343 ) Matthew Rocklin
add orc reader ( dask#3284 ) Martin Durant
Default compression for parquet now always Snappy, in line with pandas ( dask#3373 ) Martin Durant
Fixed bug in Dask DataFrame and Series comparisons with NumPy scalars ( dask#3436 ) James Bourbeau
Remove outdated requirement from repartition docstring ( dask#3440 ) Jörg Dietrich
Fixed bug in aggregation when only a Series is selected ( dask#3446 ) Jörg Dietrich
Add default values to make_timeseries ( dask#3421 ) Matthew Rocklin
Support traversing collections in persist, visualize, and optimize ( dask#3410 ) Jim Crist
Add schedule= keyword to compute and persist. This replaces common use of the get= keyword ( dask#3448 ) Matthew Rocklin
Add einsum for Dask Arrays (3412) `Simon Perkins`_
Add piecewise for Dask Arrays (3350) `John A Kirkham`_
Fix handling of nan in broadcast_shapes (3356) `John A Kirkham`_
Add isin for dask arrays (3363). `Stephan Hoyer`_
Overhauled topk for Dask Arrays: faster algorithm, particularly for large k's; added support for multiple axes, recursive aggregation, and an option to pick the bottom k elements instead. (3395) `crusaderky`_
The topk API has changed from topk(k, array) to the more conventional topk(array, k). The legacy API still works but is now deprecated. (2965) `crusaderky`_
New function argtopk for Dask Arrays (3396) `crusaderky`_
Fix handling partial depth and boundary in map_overlap (3445) `John A Kirkham`_
Add gradient for Dask Arrays (3434) `John A Kirkham`_
Allow t as shorthand for table in to_hdf for pandas compatibility (3330) `Jörg Dietrich`_
Added top level isna method for Dask DataFrames (3294) `Christopher Ren`_
Fix selection on partition column on read_parquet for engine="pyarrow" (3207) `Uwe Korn`_
Added DataFrame.squeeze method (3366) `Christopher Ren`_
Added infer_divisions option to read_parquet to specify whether read engines should compute divisions (3387) `Jon Mease`_
Added support for inferring division for engine="pyarrow" (3387) `Jon Mease`_
Provide more informative error message for meta= errors (3343) `Matthew Rocklin`_
add orc reader (3284) `Martin Durant`_
Default compression for parquet now always Snappy, in line with pandas (3373) `Martin Durant`_
Fixed bug in Dask DataFrame and Series comparisons with NumPy scalars (3436) `James Bourbeau`_
Remove outdated requirement from repartition docstring (3440) `Jörg Dietrich`_
Fixed bug in aggregation when only a Series is selected (3446) `Jörg Dietrich`_
Add default values to make_timeseries (3421) `Matthew Rocklin`_
Support traversing collections in persist, visualize, and optimize (3410) `Jim Crist`_
Add schedule= keyword to compute and persist. This replaces common use of the get= keyword (3448) `Matthew Rocklin`_
- Add broadcast_arrays for Dask Arrays ( dask#3217 ) John A Kirkham
Add broadcast_arrays for Dask Arrays ( dask#3217 ) John A Kirkham
Add bitwise_* ufuncs ( dask#3219 ) John A Kirkham
Add optional axis argument to squeeze ( dask#3261 ) John A Kirkham
Validate inputs to atop ( dask#3307 ) Matthew Rocklin
Avoid calls to astype in concatenate if all parts have the same dtype ( dask#3301 ) Martin Durant
Fixed bug in shuffle due to aggressive truncation ( dask#3201 ) Matthew Rocklin
Support specifying categorical columns on read_parquet with categories=[…] for engine="pyarrow" ( dask#3177 ) Uwe Korn
Add dd.tseries.Resampler.agg ( dask#3202 ) Richard Postelnik
Support operations that mix dataframes and arrays ( dask#3230 ) Matthew Rocklin
Support extra Scalar and Delayed args in dd.groupby._Groupby.apply ( dask#3256 ) Gabriele Lanaro
Support joining against single-partitioned bags and delayed objects ( dask#3254 ) Matthew Rocklin
Fixed bug when using unexpected but hashable types for keys ( dask#3238 ) Daniel Collins
Fix bug in task ordering so that we break ties consistently with the key name ( dask#3271 ) Matthew Rocklin
Avoid sorting tasks in order when the number of tasks is very large ( dask#3298 ) Matthew Rocklin
Add broadcast_arrays for Dask Arrays (3217) `John A Kirkham`_
Add bitwise_* ufuncs (3219) `John A Kirkham`_
Add optional axis argument to squeeze (3261) `John A Kirkham`_
Validate inputs to atop (3307) `Matthew Rocklin`_
Avoid calls to astype in concatenate if all parts have the same dtype (3301) `Martin Durant`_
Fixed bug in shuffle due to aggressive truncation (3201) `Matthew Rocklin`_
Support specifying categorical columns on read_parquet with categories=[…] for engine="pyarrow" (3177) `Uwe Korn`_
Add dd.tseries.Resampler.agg (3202) `Richard Postelnik`_
Support operations that mix dataframes and arrays (3230) `Matthew Rocklin`_
Support extra Scalar and Delayed args in dd.groupby._Groupby.apply (3256) `Gabriele Lanaro`_
Support joining against single-partitioned bags and delayed objects (3254) `Matthew Rocklin`_
Fixed bug when using unexpected but hashable types for keys (3238) `Daniel Collins`_
Fix bug in task ordering so that we break ties consistently with the key name (3271) `Matthew Rocklin`_
Avoid sorting tasks in order when the number of tasks is very large (3298) `Matthew Rocklin`_
- Corrected dimension chunking in indices ( dask#3166 , dask#3167 ) Simon Perkins
Corrected dimension chunking in indices ( dask#3166 , dask#3167 ) Simon Perkins
Inline store_chunk calls for store ’s return_stored option ( dask#3153 ) John A Kirkham
Compatibility with struct dtypes for NumPy 1.14.1 release ( dask#3187 ) Matthew Rocklin
Bugfix to allow column assignment of pandas datetimes( dask#3164 ) Max Epstein
New file-system for HTTP(S), allowing direct loading from specific URLs ( dask#3160 ) Martin Durant
Fix bug when tokenizing partials with no keywords ( dask#3191 ) Matthew Rocklin
Use more recent LZ4 API ( dask#3157 ) Thrasibule
Introduce output stream parameter for progress bar ( dask#3185 ) Dieter Weber
Corrected dimension chunking in indices (3166, 3167) `Simon Perkins`_
Inline store_chunk calls for store's return_stored option (3153) `John A Kirkham`_
Compatibility with struct dtypes for NumPy 1.14.1 release (3187) `Matthew Rocklin`_
Bugfix to allow column assignment of pandas datetimes(3164) `Max Epstein`_
New file-system for HTTP(S), allowing direct loading from specific URLs (3160) `Martin Durant`_
Fix bug when tokenizing partials with no keywords (3191) `Matthew Rocklin`_
Use more recent LZ4 API (3157) `Thrasibule`_
Introduce output stream parameter for progress bar (3185) `Dieter Weber`_
- Deprecates the dd.to_delayed function in favor of the existing method ( dask#3126 ) Jim Crist
Added a support object-type arrays for nansum, nanmin, and nanmax ( dask#3133 ) Keisuke Fujii
Update error handling when len is called with empty chunks ( dask#3058 ) Xander Johnson
Fixes a metadata bug with store ’s return_stored option ( dask#3064 ) John A Kirkham
Fix a bug in optimization.fuse_slice to properly handle when first input is None ( dask#3076 ) James Bourbeau
Support arrays with unknown chunk sizes in percentile ( dask#3107 ) Matthew Rocklin
Tokenize scipy.sparse arrays and np.matrix ( dask#3060 ) Roman Yurchak
Support month timedeltas in repartition(freq=…) ( dask#3110 ) Matthew Rocklin
Avoid mutation in dataframe groupby tests ( dask#3118 ) Matthew Rocklin
read_csv , read_table , and read_parquet accept iterables of paths ( dask#3124 ) Jim Crist
Deprecates the dd.to_delayed function in favor of the existing method ( dask#3126 ) Jim Crist
Return dask.arrays from df.map_partitions calls when the UDF returns a numpy array ( dask#3147 ) Matthew Rocklin
Change handling of columns and index in dd.read_parquet to be more consistent, especially in handling of multi-indices ( dask#3149 ) Jim Crist
fastparquet append=True allowed to create new dataset ( dask#3097 ) Martin Durant
dtype rationalization for sql queries ( dask#3100 ) Martin Durant
Document bag.map_paritions function may receive either a list or generator. ( dask#3150 ) Nir
Change default task ordering to prefer nodes with few dependents and then many downstream dependencies ( dask#3056 ) Matthew Rocklin
Add color= option to visualize to color by task order ( dask#3057 ) ( dask#3122 ) Matthew Rocklin
Deprecate dask.bytes.open_text_files ( dask#3077 ) Jim Crist
Remove short-circuit hdfs reads handling due to maintenance costs. May be re-added in a more robust manner later ( dask#3079 ) Jim Crist
Add dask.base.optimize for optimizing multiple collections without computing. ( dask#3071 ) Jim Crist
Rename dask.optimize module to dask.optimization ( dask#3071 ) Jim Crist
Change task ordering to do a full traversal ( dask#3066 ) Matthew Rocklin
Adds an optimize_graph keyword to all to_delayed methods to allow controlling whether optimizations occur on conversion. ( dask#3126 ) Jim Crist
Support using pyarrow for hdfs integration ( dask#3123 ) Jim Crist
Move HDFS integration and tests into dask repo ( dask#3083 ) Jim Crist
Remove write_bytes ( dask#3116 ) Jim Crist
Added a support object-type arrays for nansum, nanmin, and nanmax (3133) `Keisuke Fujii`_
Update error handling when len is called with empty chunks (3058) `Xander Johnson`_
Fixes a metadata bug with store's return_stored option (3064) `John A Kirkham`_
Fix a bug in optimization.fuse_slice to properly handle when first input is None (3076) `James Bourbeau`_
Support arrays with unknown chunk sizes in percentile (3107) `Matthew Rocklin`_
Tokenize scipy.sparse arrays and np.matrix (3060) `Roman Yurchak`_
Support month timedeltas in repartition(freq=...) (3110) `Matthew Rocklin`_
Avoid mutation in dataframe groupby tests (3118) `Matthew Rocklin`_
read_csv, read_table, and read_parquet accept iterables of paths (3124) `Jim Crist`_
Deprecates the dd.to_delayed function in favor of the existing method (3126) `Jim Crist`_
Return dask.arrays from df.map_partitions calls when the UDF returns a numpy array (3147) `Matthew Rocklin`_
Change handling of columns and index in dd.read_parquet to be more consistent, especially in handling of multi-indices (3149) `Jim Crist`_
fastparquet append=True allowed to create new dataset (3097) `Martin Durant`_
dtype rationalization for sql queries (3100) `Martin Durant`_
Document bag.map_paritions function may receive either a list or generator. (3150) `Nir`_
Change default task ordering to prefer nodes with few dependents and then many downstream dependencies (3056) `Matthew Rocklin`_
Add color= option to visualize to color by task order (3057) (3122) `Matthew Rocklin`_
Deprecate dask.bytes.open_text_files (3077) `Jim Crist`_
Remove short-circuit hdfs reads handling due to maintenance costs. May be re-added in a more robust manner later (3079) `Jim Crist`_
Add dask.base.optimize for optimizing multiple collections without computing. (3071) `Jim Crist`_
Rename dask.optimize module to dask.optimization (3071) `Jim Crist`_
Change task ordering to do a full traversal (3066) `Matthew Rocklin`_
Adds an optimize_graph keyword to all to_delayed methods to allow controlling whether optimizations occur on conversion. (3126) `Jim Crist`_
Support using pyarrow for hdfs integration (3123) `Jim Crist`_
Move HDFS integration and tests into dask repo (3083) `Jim Crist`_
Remove write_bytes (3116) `Jim Crist`_
- Removed the deprecated dd.rolling* methods, in preparation for their removal in the next pandas release ( dask#2995 ) Tom Augspurger
Fix handling of scalar percentile values in percentile ( dask#3021 ) James Bourbeau
Prevent bool() coercion from calling compute ( dask#2958 ) Albert DeFusco
Add matmul ( dask#2904 ) John A Kirkham
Support N-D arrays with matmul ( dask#2909 ) John A Kirkham
Add vdot ( dask#2910 ) John A Kirkham
Explicit chunks argument for broadcast_to ( dask#2943 ) Stephan Hoyer
Add meshgrid ( dask#2938 ) John A Kirkham and ( dask#3001 ) Markus Gonser
Preserve singleton chunks in fftshift / ifftshift ( dask#2733 ) John A Kirkham
Fix handling of negative indexes in vindex and raise errors for out of bounds indexes ( dask#2967 ) Stephan Hoyer
Add flip , flipud , fliplr ( dask#2954 ) John A Kirkham
Add float_power ufunc ( dask#2962 ) ( dask#2969 ) John A Kirkham
Compatibility for changes to structured arrays in the upcoming NumPy 1.14 release ( dask#2964 ) Tom Augspurger
Add block ( dask#2650 ) John A Kirkham
Add frompyfunc ( dask#3030 ) Jim Crist
Add the return_stored option to store for chaining stored results ( dask#2980 ) John A Kirkham
Fixed naming bug in cumulative aggregations ( dask#3037 ) Martijn Arts
Fixed dd.read_csv when names is given but header is not set to None ( dask#2976 ) Martijn Arts
Fixed dd.read_csv so that passing instances of CategoricalDtype in dtype will result in known categoricals ( dask#2997 ) Tom Augspurger
Prevent bool() coercion from calling compute ( dask#2958 ) Albert DeFusco
DataFrame.read_sql() ( dask#2928 ) to an empty database tables returns an empty dask dataframe Apostolos Vlachopoulos
Compatibility for reading Parquet files written by PyArrow 0.8.0 ( dask#2973 ) Tom Augspurger
Correctly handle the column name ( df.columns.name ) when reading in dd.read_parquet ( dask#2973 ) Tom Augspurger
Fixed dd.concat losing the index dtype when the data contained a categorical ( dask#2932 ) Tom Augspurger
Add dd.Series.rename ( dask#3027 ) Jim Crist
DataFrame.merge() now supports merging on a combination of columns and the index ( dask#2960 ) Jon Mease
Removed the deprecated dd.rolling* methods, in preparation for their removal in the next pandas release ( dask#2995 ) Tom Augspurger
Fix metadata inference bug in which single-partition series were mistakenly special cased ( dask#3035 ) Jim Crist
Add support for Series.str.cat ( dask#3028 ) Jim Crist
Improve 32-bit compatibility ( dask#2937 ) Matthew Rocklin
Change task prioritization to avoid upwards branching ( dask#3017 ) Matthew Rocklin
Fix handling of scalar percentile values in percentile (3021) `James Bourbeau`_
Prevent bool() coercion from calling compute (2958) `Albert DeFusco`_
Add matmul (2904) `John A Kirkham`_
Support N-D arrays with matmul (2909) `John A Kirkham`_
Add vdot (2910) `John A Kirkham`_
Explicit chunks argument for broadcast_to (2943) `Stephan Hoyer`_
Add meshgrid (2938) `John A Kirkham`_ and (3001) `Markus Gonser`_
Preserve singleton chunks in fftshift/ifftshift (2733) `John A Kirkham`_
Fix handling of negative indexes in vindex and raise errors for out of bounds indexes (2967) `Stephan Hoyer`_
Add flip, flipud, fliplr (2954) `John A Kirkham`_
Add float_power ufunc (2962) (2969) `John A Kirkham`_
Compatibility for changes to structured arrays in the upcoming NumPy 1.14 release (2964) `Tom Augspurger`_
Add block (2650) `John A Kirkham`_
Add frompyfunc (3030) `Jim Crist`_
Add the return_stored option to store for chaining stored results (2980) `John A Kirkham`_
Fixed naming bug in cumulative aggregations (3037) `Martijn Arts`_
Fixed dd.read_csv when names is given but header is not set to None (2976) `Martijn Arts`_
Fixed dd.read_csv so that passing instances of CategoricalDtype in dtype will result in known categoricals (2997) `Tom Augspurger`_
Prevent bool() coercion from calling compute (2958) `Albert DeFusco`_
DataFrame.read_sql() (2928) to an empty database tables returns an empty dask dataframe `Apostolos Vlachopoulos`_
Compatibility for reading Parquet files written by PyArrow 0.8.0 (2973) `Tom Augspurger`_
Correctly handle the column name (df.columns.name) when reading in dd.read_parquet (2973) `Tom Augspurger`_
Fixed dd.concat losing the index dtype when the data contained a categorical (2932) `Tom Augspurger`_
Add dd.Series.rename (3027) `Jim Crist`_
DataFrame.merge() now supports merging on a combination of columns and the index (2960) `Jon Mease`_
Removed the deprecated dd.rolling* methods, in preparation for their removal in the next pandas release (2995) `Tom Augspurger`_
Fix metadata inference bug in which single-partition series were mistakenly special cased (3035) `Jim Crist`_
Add support for Series.str.cat (3028) `Jim Crist`_
Improve 32-bit compatibility (2937) `Matthew Rocklin`_
Change task prioritization to avoid upwards branching (3017) `Matthew Rocklin`_
This is a major release. It includes breaking changes, new protocols, and a large number of bug fixes.
This is a major release. It includes breaking changes, new protocols, and a large number of bug fixes.
Add atleast_1d , atleast_2d , and atleast_3d ( dask#2760 ) ( dask#2765 ) John A Kirkham
Add allclose ( dask#2771 ) by John A Kirkham
Remove random.different_seeds from Dask Array API docs ( dask#2772 ) John A Kirkham
Deprecate vnorm in favor of dask.array.linalg.norm ( dask#2773 ) John A Kirkham
Reimplement unique to be lazy ( dask#2775 ) John A Kirkham
Support broadcasting of Dask Arrays with 0-length dimensions ( dask#2784 ) John A Kirkham
Add asarray and asanyarray to Dask Array API docs ( dask#2787 ) James Bourbeau
Support unique ’s return_* arguments ( dask#2779 ) John A Kirkham
Simplify _unique_internal ( dask#2850 ) ( dask#2855 ) John A Kirkham
Avoid removing some getter calls in array optimizations ( dask#2826 ) Jim Crist
Support pyarrow in dd.to_parquet ( dask#2868 ) Jim Crist
Fixed DataFrame.quantile and Series.quantile returning nan when missing values are present ( dask#2791 ) Tom Augspurger
Fixed DataFrame.quantile losing the result .name when q is a scalar ( dask#2791 ) Tom Augspurger
Fixed dd.concat return a dask.Dataframe when concatenating a single series along the columns, matching pandas’ behavior ( dask#2800 ) James Munroe
Fixed default inplace parameter for DataFrame.eval to match the pandas defualt for pandas >= 0.21.0 ( dask#2838 ) Tom Augspurger
Fix exception when calling DataFrame.set_index on text column where one of the partitions was empty ( dask#2831 ) Jesse Vogt
Do not raise exception when calling DataFrame.set_index on empty dataframe ( dask#2827 ) Jesse Vogt
Fixed bug in Dataframe.fillna when filling with a Series value ( dask#2810 ) Tom Augspurger
Deprecate old argument ordering in dd.to_parquet to better match convention of putting the dataframe first ( dask#2867 ) Jim Crist
df.astype(categorical_dtype -> known categoricals ( dask#2835 ) Jim Crist
Test against Pandas release candidate ( dask#2814 ) Tom Augspurger
Add more tests for read_parquet(engine=’pyarrow’) ( dask#2822 ) Uwe Korn
Remove unnecessary map_partitions in aggregate ( dask#2712 ) Christopher Prohm
Fix bug calling sample on empty partitions ( dask#2818 ) @xwang777
Error nicely when parsing dates in read_csv ( dask#2863 ) Jim Crist
Cleanup handling of passing filesystem objects to PyArrow readers ( dask#2527 ) @fjetter
Support repartitioning even if there are no divisions ( dask#2873 ) @Ced4
Support reading/writing to hdfs using pyarrow in dd.to_parquet ( dask#2894 , dask#2881 ) Jim Crist
Allow tuples as sharedict keys ( dask#2763 ) Matthew Rocklin
Calling compute within a dask.distributed task defaults to distributed scheduler ( dask#2762 ) Matthew Rocklin
Auto-import gcsfs when gcs:// protocol is used ( dask#2776 ) Matthew Rocklin
Fully remove dask.async module, use dask.local instead ( dask#2828 ) Thomas Caswell
Compatibility with bokeh 0.12.10 ( dask#2844 ) Tom Augspurger
Reduce test memory usage ( dask#2782 ) Jim Crist
Add Dask collection interface ( dask#2748 ) Jim Crist
Update Dask collection interface during XArray integration ( dask#2847 ) Matthew Rocklin
Close resource profiler process on exit ( dask#2871 ) Jim Crist
Fix S3 tests ( dask#2875 ) Jim Crist
Fix port for bokeh dashboard in docs ( dask#2889 ) Ian Hopkinson
Wrap Dask filesystems for PyArrow compatibility ( dask#2881 ) Jim Crist
This is a major release. It includes breaking changes, new protocols, and a large number of bug fixes.
Add atleast_1d, atleast_2d, and atleast_3d (2760) (2765) `John A Kirkham`_
Add allclose (2771) by `John A Kirkham`_
Remove random.different_seeds from Dask Array API docs (2772) `John A Kirkham`_
Deprecate vnorm in favor of dask.array.linalg.norm (2773) `John A Kirkham`_
Reimplement unique to be lazy (2775) `John A Kirkham`_
Support broadcasting of Dask Arrays with 0-length dimensions (2784) `John A Kirkham`_
Add asarray and asanyarray to Dask Array API docs (2787) `James Bourbeau`_
Support unique's return_* arguments (2779) `John A Kirkham`_
Simplify _unique_internal (2850) (2855) `John A Kirkham`_
Avoid removing some getter calls in array optimizations (2826) `Jim Crist`_
Support pyarrow in dd.to_parquet (2868) `Jim Crist`_
Fixed DataFrame.quantile and Series.quantile returning nan when missing values are present (2791) `Tom Augspurger`_
Fixed DataFrame.quantile losing the result .name when q is a scalar (2791) `Tom Augspurger`_
Fixed dd.concat return a dask.Dataframe when concatenating a single series along the columns, matching pandas' behavior (2800) `James Munroe`_
Fixed default inplace parameter for DataFrame.eval to match the pandas defualt for pandas >= 0.21.0 (2838) `Tom Augspurger`_
Fix exception when calling DataFrame.set_index on text column where one of the partitions was empty (2831) `Jesse Vogt`_
Do not raise exception when calling DataFrame.set_index on empty dataframe (2827) `Jesse Vogt`_
Fixed bug in Dataframe.fillna when filling with a Series value (2810) `Tom Augspurger`_
Deprecate old argument ordering in dd.to_parquet to better match convention of putting the dataframe first (2867) `Jim Crist`_
df.astype(categorical_dtype -> known categoricals (2835) `Jim Crist`_
Test against Pandas release candidate (2814) `Tom Augspurger`_
Add more tests for read_parquet(engine='pyarrow') (2822) `Uwe Korn`_
Remove unnecessary map_partitions in aggregate (2712) `Christopher Prohm`_
Fix bug calling sample on empty partitions (2818) `@xwang777`_
Error nicely when parsing dates in read_csv (2863) `Jim Crist`_
Cleanup handling of passing filesystem objects to PyArrow readers (2527) `@fjetter`_
Support repartitioning even if there are no divisions (2873) `@Ced4`_
Support reading/writing to hdfs using pyarrow in dd.to_parquet (2894, 2881) `Jim Crist`_
Allow tuples as sharedict keys (2763) `Matthew Rocklin`_
Calling compute within a dask.distributed task defaults to distributed scheduler (2762) `Matthew Rocklin`_
Auto-import gcsfs when gcs:// protocol is used (2776) `Matthew Rocklin`_
Fully remove dask.async module, use dask.local instead (2828) `Thomas Caswell`_
Compatibility with bokeh 0.12.10 (2844) `Tom Augspurger`_
Reduce test memory usage (2782) `Jim Crist`_
Add Dask collection interface (2748) `Jim Crist`_
Update Dask collection interface during XArray integration (2847) `Matthew Rocklin`_
Close resource profiler process on __exit__ (2871) `Jim Crist`_
Fix S3 tests (2875) `Jim Crist`_
Fix port for bokeh dashboard in docs (2889) `Ian Hopkinson`_
Wrap Dask filesystems for PyArrow compatibility (2881) `Jim Crist`_
- da.random.choice now works with array arguments ( dask#2781 )
da.random.choice now works with array arguments ( dask#2781 )
Support indexing in arrays with np.int (fixes regression) ( dask#2719 )
Handle zero dimension with rechunking ( dask#2747 )
Support -1 as an alias for “size of the dimension” in chunks ( dask#2749 )
Call mkdir in array.to_npy_stack ( dask#2709 )
Added the .str accessor to Categoricals with string categories ( dask#2743 )
Support int96 (spark) datetimes in parquet writer ( dask#2711 )
Pass on file scheme to fastparquet ( dask#2714 )
Support Pandas 0.21 ( dask#2737 )
Add tree reduction support for foldby ( dask#2710 )
Drop s3fs from pip install dask[complete] ( dask#2750 )
da.random.choice now works with array arguments (2781)
Support indexing in arrays with np.int (fixes regression) (2719)
Handle zero dimension with rechunking (2747)
Support -1 as an alias for "size of the dimension" in chunks (2749)
Call mkdir in array.to_npy_stack (2709)
Added the .str accessor to Categoricals with string categories (2743)
Support int96 (spark) datetimes in parquet writer (2711)
Pass on file scheme to fastparquet (2714)
Support Pandas 0.21 (2737)
Add tree reduction support for foldby (2710)
Drop s3fs from pip install dask[complete] (2750)
- Add masked arrays ( dask#2301 )
Add masked arrays ( dask#2301 )
Add *_like array creation functions ( dask#2640 )
Indexing with unsigned integer array ( dask#2647 )
Improved slicing with boolean arrays of different dimensions ( dask#2658 )
Support literals in top and atop ( dask#2661 )
Optional axis argument in cumulative functions ( dask#2664 )
Improve tests on scalars with assert_eq ( dask#2681 )
Fix norm keepdims ( dask#2683 )
Add ptp ( dask#2691 )
Add apply_along_axis ( dask#2690 ) and apply_over_axes ( dask#2702 )
Added Series.str[index] ( dask#2634 )
Allow the groupby by param to handle columns and index levels ( dask#2636 )
DataFrame.to_csv and Bag.to_textfiles now return the filenames to which they have written ( dask#2655 )
Fix combination of partition_on and append in to_parquet ( dask#2645 )
Fix for parquet file schemes ( dask#2667 )
Repartition works with mixed categoricals ( dask#2676 )
python setup.py test now runs tests ( dask#2641 )
Added new cheatsheet ( dask#2649 )
Remove resize tool in Bokeh plots ( dask#2688 )
Add masked arrays (2301)
Add *_like array creation functions (2640)
Indexing with unsigned integer array (2647)
Improved slicing with boolean arrays of different dimensions (2658)
Support literals in top and atop (2661)
Optional axis argument in cumulative functions (2664)
Improve tests on scalars with assert_eq (2681)
Fix norm keepdims (2683)
Add ptp (2691)
Add apply_along_axis (2690) and apply_over_axes (2702)
Added Series.str[index] (2634)
Allow the groupby by param to handle columns and index levels (2636)
which they have written (2655)
Fix combination of partition_on and append in to_parquet (2645)
Fix for parquet file schemes (2667)
Repartition works with mixed categoricals (2676)
python setup.py test now runs tests (2641)
Added new cheatsheet (2649)
Remove resize tool in Bokeh plots (2688)
- Remove deprecated Bag behaviors ( dask#2525 )
Remove spurious keys from map_overlap graph ( dask#2520 )
where works with non-bool condition and scalar values ( dask#2543 ) ( dask#2549 )
Improve compress ( dask#2541 ) ( dask#2545 ) ( dask#2555 )
Add argwhere, _nonzero, and where(cond) ( dask#2539 )
Generalize vindex in dask.array to handle multi-dimensional indices ( dask#2573 )
Add choose method ( dask#2584 )
Split code into reorganized files ( dask#2595 )
Add linalg.norm ( dask#2597 )
Add diff, ediff1d ( dask#2607 ), ( dask#2609 )
Improve dtype inference and reflection ( dask#2571 )
Remove deprecated Bag behaviors ( dask#2525 )
Support callables in assign ( dask#2513 )
better error messages for read_csv ( dask#2522 )
Add dd.to_timedelta ( dask#2523 )
Verify metadata in from_delayed ( dask#2534 ) ( dask#2591 )
Add DataFrame.isin ( dask#2558 )
Read_hdf supports iterables of files ( dask#2547 )
Remove bare except: blocks everywhere ( dask#2590 )
Remove spurious keys from map_overlap graph (2520)
where works with non-bool condition and scalar values (2543) (2549)
Improve compress (2541) (2545) (2555)
Add argwhere, _nonzero, and where(cond) (2539)
Generalize vindex in dask.array to handle multi-dimensional indices (2573)
Add choose method (2584)
Split code into reorganized files (2595)
Add linalg.norm (2597)
Add diff, ediff1d (2607), (2609)
Improve dtype inference and reflection (2571)
Remove deprecated Bag behaviors (2525)
Support callables in assign (2513)
better error messages for read_csv (2522)
Add dd.to_timedelta (2523)
Verify metadata in from_delayed (2534) (2591)
Add DataFrame.isin (2558)
Read_hdf supports iterables of files (2547)
Remove bare except: blocks everywhere (2590)
- Add storage_options to to_textfiles and to_csv ( dask#2466 )
Add storage_options to to_textfiles and to_csv ( dask#2466 )
Rechunk and simplify rfftfreq ( dask#2473 ), ( dask#2475 )
Better support ndarray subclasses ( dask#2486 )
Import star in dask.distributed ( dask#2503 )
Threadsafe cache handling with tokenization ( dask#2511 )
Add storage_options to to_textfiles and to_csv (2466)
Rechunk and simplify rfftfreq (2473), (2475)
Better support ndarray subclasses (2486)
Import star in dask.distributed (2503)
Threadsafe cache handling with tokenization (2511)
- Add dask.array.stats submodule ( dask#2269 )
Add dask.array.stats submodule ( dask#2269 )
Support ufunc.outer ( dask#2345 )
Optimize fancy indexing by reducing graph overhead ( dask#2333 ) ( dask#2394 )
Faster array tokenization using alternative hashes ( dask#2377 )
Added the matmul @ operator ( dask#2349 )
Improved coverage of the numpy.fft module ( dask#2320 ) ( dask#2322 ) ( dask#2327 ) ( dask#2323 )
Support NumPy’s array_ufunc protocol ( dask#2438 )
Fix bug where reductions on bags with no partitions would fail ( dask#2324 )
Add broadcasting and variadic db.map top-level function. Also remove auto-expansion of tuples as map arguments ( dask#2339 )
Rename Bag.concat to Bag.flatten ( dask#2402 )
Parquet improvements ( dask#2277 ) ( dask#2422 )
Move dask.async module to dask.local ( dask#2318 )
Support callbacks with nested scheduler calls ( dask#2397 )
Support pathlib.Path objects as uris ( dask#2310 )
Add dask.array.stats submodule (2269)
Support ufunc.outer (2345)
Optimize fancy indexing by reducing graph overhead (2333) (2394)
Faster array tokenization using alternative hashes (2377)
Added the matmul @ operator (2349)
Improved coverage of the numpy.fft module (2320) (2322) (2327) (2323)
Support NumPy's __array_ufunc__ protocol (2438)
Fix bug where reductions on bags with no partitions would fail (2324)
Add broadcasting and variadic db.map top-level function. Also remove auto-expansion of tuples as map arguments (2339)
Rename Bag.concat to Bag.flatten (2402)
Parquet improvements (2277) (2422)
Move dask.async module to dask.local (2318)
Support callbacks with nested scheduler calls (2397)
Support pathlib.Path objects as uris (2310)
### DataFrame # - Pandas 0.20.0 support
Pandas 0.20.0 support
- Add da.indices ( dask#2268 ), da.tile ( dask#2153 ), da.roll ( dask#2135 )
Add da.indices ( dask#2268 ), da.tile ( dask#2153 ), da.roll ( dask#2135 )
Simultaneously support drop_axis and new_axis in da.map_blocks ( dask#2264 )
Rechunk and concatenate work with unknown chunksizes ( dask#2235 ) and ( dask#2251 )
Support non-numpy container arrays, notably sparse arrays ( dask#2234 )
Tensordot contracts over multiple axes ( dask#2186 )
Allow delayed targets in da.store ( dask#2181 )
Support interactions against lists and tuples ( dask#2148 )
Constructor plugins for debugging ( dask#2142 )
Multi-dimensional FFTs (single chunk) ( dask#2116 )
to_dataframe enforces consistent types ( dask#2199 )
Set_index always fully sorts the index ( dask#2290 )
Support compatibility with pandas 0.20.0 ( dask#2249 ), ( dask#2248 ), and ( dask#2246 )
Support Arrow Parquet reader ( dask#2223 )
Time-based rolling windows ( dask#2198 )
Repartition can now create more partitions, not just less ( dask#2168 )
Always use absolute paths when on POSIX file system ( dask#2263 )
Support user provided graph optimizations ( dask#2219 )
Refactor path handling ( dask#2207 )
Improve fusion performance ( dask#2129 ), ( dask#2131 ), and ( dask#2112 )
Add da.indices (2268), da.tile (2153), da.roll (2135)
Simultaneously support drop_axis and new_axis in da.map_blocks (2264)
Rechunk and concatenate work with unknown chunksizes (2235) and (2251)
Support non-numpy container arrays, notably sparse arrays (2234)
Tensordot contracts over multiple axes (2186)
Allow delayed targets in da.store (2181)
Support interactions against lists and tuples (2148)
Constructor plugins for debugging (2142)
Multi-dimensional FFTs (single chunk) (2116)
to_dataframe enforces consistent types (2199)
Set_index always fully sorts the index (2290)
Support compatibility with pandas 0.20.0 (2249), (2248), and (2246)
Support Arrow Parquet reader (2223)
Time-based rolling windows (2198)
Repartition can now create more partitions, not just less (2168)
Always use absolute paths when on POSIX file system (2263)
Support user provided graph optimizations (2219)
Refactor path handling (2207)
Improve fusion performance (2129), (2131), and (2112)
- Micro-optimize optimizations ( dask#2058 )
Micro-optimize optimizations ( dask#2058 )
Change slicing optimizations to avoid fusing raw numpy arrays ( dask#2075 ) ( dask#2080 )
Dask.array operations now work on numpy arrays ( dask#2079 )
Reshape now works in a much broader set of cases ( dask#2089 )
Support deepcopy python protocol ( dask#2090 )
Allow user-provided FFT implementations in da.fft ( dask#2093 )
Fix to_parquet with empty partitions ( dask#2020 )
Optional npartitions='auto' mode in set_index ( dask#2025 )
Optimize shuffle performance ( dask#2032 )
Support efficient repartitioning along time windows like repartition(freq='12h') ( dask#2059 )
Improve speed of categorize ( dask#2010 )
Support single-row dataframe arithmetic ( dask#2085 )
Automatically avoid shuffle when setting index with a sorted column ( dask#2091 )
Improve handling of integer-na handling in read_csv ( dask#2098 )
Repeated attribute access on delayed objects uses the same key ( dask#2084 )
Improve naming of nodes in dot visuals to avoid generic apply ( dask#2070 )
Ensure that worker processes have different random seeds ( dask#2094 )
Micro-optimize optimizations (2058)
Change slicing optimizations to avoid fusing raw numpy arrays (2075) (2080)
Dask.array operations now work on numpy arrays (2079)
Reshape now works in a much broader set of cases (2089)
Support deepcopy python protocol (2090)
Allow user-provided FFT implementations in da.fft (2093)
Fix to_parquet with empty partitions (2020)
Optional npartitions='auto' mode in set_index (2025)
Optimize shuffle performance (2032)
Support efficient repartitioning along time windows like repartition(freq='12h') (2059)
Improve speed of categorize (2010)
Support single-row dataframe arithmetic (2085)
Automatically avoid shuffle when setting index with a sorted column (2091)
Improve handling of integer-na handling in read_csv (2098)
Repeated attribute access on delayed objects uses the same key (2084)
Improve naming of nodes in dot visuals to avoid generic apply (2070)
Ensure that worker processes have different random seeds (2094)
- Fix corner cases with zero shape and misaligned values in arange ( dask#1902 ), ( dask#1904 ), ( dask#1935 ), ( dask#1955 ), ( dask#1956 )
Fix corner cases with zero shape and misaligned values in arange ( dask#1902 ), ( dask#1904 ), ( dask#1935 ), ( dask#1955 ), ( dask#1956 )
Improve concatenation efficiency ( dask#1923 )
Avoid hashing in from_array if name is provided ( dask#1972 )
Repartition can now increase number of partitions ( dask#1934 )
Fix bugs in some reductions with empty partitions ( dask#1939 ), ( dask#1950 ), ( dask#1953 )
Support non-uniform categoricals ( dask#1877 ), ( dask#1930 )
Groupby cumulative reductions ( dask#1909 )
DataFrame.loc indexing now supports lists ( dask#1913 )
Improve multi-level groupbys ( dask#1914 )
Improved HTML and string repr for DataFrames ( dask#1637 )
Parquet append ( dask#1940 )
Add dd.demo.daily_stock function for teaching ( dask#1992 )
Add traverse= keyword to delayed to optionally avoid traversing nested data structures ( dask#1899 )
Support Futures in from_delayed functions ( dask#1961 )
Improve serialization of decorated delayed functions ( dask#1969 )
Improve windows path parsing in corner cases ( dask#1910 )
Rename tasks when fusing ( dask#1919 )
Add top level persist function ( dask#1927 )
Propagate errors= keyword in byte handling ( dask#1954 )
Dask.compute traverses Python collections ( dask#1975 )
Structural sharing between graphs in dask.array and dask.delayed ( dask#1985 )
Fix corner cases with zero shape and misaligned values in arange (1902), (1904), (1935), (1955), (1956)
Improve concatenation efficiency (1923)
Avoid hashing in from_array if name is provided (1972)
Repartition can now increase number of partitions (1934)
Fix bugs in some reductions with empty partitions (1939), (1950), (1953)
Support non-uniform categoricals (1877), (1930)
Groupby cumulative reductions (1909)
DataFrame.loc indexing now supports lists (1913)
Improve multi-level groupbys (1914)
Improved HTML and string repr for DataFrames (1637)
Parquet append (1940)
Add dd.demo.daily_stock function for teaching (1992)
Add traverse= keyword to delayed to optionally avoid traversing nested data structures (1899)
Support Futures in from_delayed functions (1961)
Improve serialization of decorated delayed functions (1969)
Improve windows path parsing in corner cases (1910)
Rename tasks when fusing (1919)
Add top level persist function (1927)
Propagate errors= keyword in byte handling (1954)
Dask.compute traverses Python collections (1975)
Structural sharing between graphs in dask.array and dask.delayed (1985)
- Mandatory dtypes on dask.array. All operations maintain dtype information and UDF functions like map_blocks now require a dtype= keyword if it can n
Mandatory dtypes on dask.array. All operations maintain dtype information and UDF functions like map_blocks now require a dtype= keyword if it can not be inferred. ( dask#1755 )
Support arrays without known shapes, such as arises when slicing arrays with arrays or converting dataframes to arrays ( dask#1838 )
Support mutation by setting one array with another ( dask#1840 )
Tree reductions for covariance and correlations. ( dask#1758 )
Add SerializableLock for better use with distributed scheduling ( dask#1766 )
Improved atop support ( dask#1800 )
Rechunk optimization ( dask#1737 ), ( dask#1827 )
Avoid wrong results when recomputing the same groupby twice ( dask#1867 )
Add map_overlap for custom rolling operations ( dask#1769 )
Add shift ( dask#1773 )
Add Parquet support ( dask#1782 ) ( dask#1792 ) ( dask#1810 ), ( dask#1843 ), ( dask#1859 ), ( dask#1863 )
Add missing methods combine, abs, autocorr, sem, nsmallest, first, last, prod, ( dask#1787 )
Approximate nunique ( dask#1807 ), ( dask#1824 )
Reductions with multiple output partitions (for operations like drop_duplicates) ( dask#1808 ), ( dask#1823 ) ( dask#1828 )
Add delitem and copy to DataFrames, increasing mutation support ( dask#1858 )
Changed behaviour for delayed(nout=0) and delayed(nout=1) : delayed(nout=1) does not default to out=None anymore, and delayed(nout=0) is also enabled. I.e. functions with return tuples of length 1 or 0 can be handled correctly. This is especially handy, if functions with a variable amount of outputs are wrapped by delayed . E.g. a trivial example: delayed(lambda *args: args, nout=len(vals))(*vals)
Refactor core byte ingest ( dask#1768 ), ( dask#1774 )
Improve import time ( dask#1833 )
Mandatory dtypes on dask.array. All operations maintain dtype information and UDF functions like map_blocks now require a dtype= keyword if it can not be inferred. (1755)
Support arrays without known shapes, such as arises when slicing arrays with arrays or converting dataframes to arrays (1838)
Support mutation by setting one array with another (1840)
Tree reductions for covariance and correlations. (1758)
Add SerializableLock for better use with distributed scheduling (1766)
Improved atop support (1800)
Rechunk optimization (1737), (1827)
Avoid wrong results when recomputing the same groupby twice (1867)
Add map_overlap for custom rolling operations (1769)
Add shift (1773)
Add Parquet support (1782) (1792) (1810), (1843), (1859), (1863)
Add missing methods combine, abs, autocorr, sem, nsmallest, first, last, prod, (1787)
Approximate nunique (1807), (1824)
Reductions with multiple output partitions (for operations like drop_duplicates) (1808), (1823) (1828)
Add delitem and copy to DataFrames, increasing mutation support (1858)
Changed behaviour for delayed(nout=0) and delayed(nout=1): delayed(nout=1) does not default to out=None anymore, and delayed(nout=0) is also enabled. I.e. functions with return tuples of length 1 or 0 can be handled correctly. This is especially handy, if functions with a variable amount of outputs are wrapped by delayed. E.g. a trivial example: delayed(lambda *args: args, nout=len(vals))(*vals)
Refactor core byte ingest (1768), (1774)
Improve import time (1833)
Nothing published for this version
- Return a series when functions given to dataframe.map_partitions return scalars ( dask#1515 )
Return a series when functions given to dataframe.map_partitions return scalars ( dask#1515 )
Fix type size inference for series ( dask#1513 )
dataframe.DataFrame.categorize no longer includes missing values in the categories . This is for compatibility with a pandas change ( dask#1565 )
Fix head parser error in dataframe.read_csv when some lines have quotes ( dask#1495 )
Add dataframe.reduction and series.reduction methods to apply generic row-wise reduction to dataframes and series ( dask#1483 )
Add dataframe.select_dtypes , which mirrors the pandas method ( dask#1556 )
dataframe.read_hdf now supports reading Series ( dask#1564 )
Support Pandas 0.19.0 ( dask#1540 )
Implement select_dtypes ( dask#1556 )
String accessor works with indexes ( dask#1561 )
Add pipe method to dask.dataframe ( dask#1567 )
Add indicator keyword to merge ( dask#1575 )
Support Series in read_hdf ( dask#1575 )
Support Categories with missing values ( dask#1578 )
Support inplace operators like df.x += 1 ( dask#1585 )
Str accessor passes through args and kwargs ( dask#1621 )
Improved groupby support for single-machine multiprocessing scheduler ( dask#1625 )
Tree reductions ( dask#1663 )
Pivot tables ( dask#1665 )
Add clip ( dask#1667 ), align ( dask#1668 ), combine_first ( dask#1725 ), and any/all ( dask#1724 )
Improved handling of divisions on dask-pandas merges ( dask#1666 )
Add groupby.aggregate method ( dask#1678 )
Add dd.read_table function ( dask#1682 )
Improve support for multi-level columns ( dask#1697 ) ( dask#1712 )
Support 2d indexing in loc ( dask#1726 )
Extend resample to include DataFrames ( dask#1741 )
Support dask.array ufuncs on dask.dataframe objects ( dask#1669 )
Add information about how dask.array chunks argument work ( dask#1504 )
Fix field access with non-scalar fields in dask.array ( dask#1484 )
Add concatenate= keyword to atop to concatenate chunks of contracted dimensions
Optimized slicing performance ( dask#1539 ) ( dask#1731 )
Extend atop with a concatenate= ( dask#1609 ) new_axes= ( dask#1612 ) and adjust_chunks= ( dask#1716 ) keywords
Add clip ( dask#1610 ) swapaxes ( dask#1611 ) round ( dask#1708 ) repeat
Automatically align chunks in atop -backed operations ( dask#1644 )
Cull dask.arrays on slicing ( dask#1709 )
Fix issue with callables in bag.from_sequence being interpreted as tasks ( dask#1491 )
Avoid non-lazy memory use in reductions ( dask#1747 )
Added changelog ( dask#1526 )
Create new threadpool when operating from thread ( dask#1487 )
Unify example documentation pages into one ( dask#1520 )
Add versioneer for git-commit based versions ( dask#1569 )
Pass through node_attr and edge_attr keywords in dot visualization ( dask#1614 )
Add continuous testing for Windows with Appveyor ( dask#1648 )
Remove use of multiprocessing.Manager ( dask#1653 )
Add global optimizations keyword to compute ( dask#1675 )
Micro-optimize get_dependencies ( dask#1722 )
Return a series when functions given to dataframe.map_partitions return scalars (1515)
Fix type size inference for series (1513)
dataframe.DataFrame.categorize no longer includes missing values in the categories. This is for compatibility with a pandas change (1565)
Fix head parser error in dataframe.read_csv when some lines have quotes (1495)
Add dataframe.reduction and series.reduction methods to apply generic row-wise reduction to dataframes and series (1483)
Add dataframe.select_dtypes, which mirrors the pandas method (1556)
dataframe.read_hdf now supports reading Series (1564)
Support Pandas 0.19.0 (1540)
Implement select_dtypes (1556)
String accessor works with indexes (1561)
Add pipe method to dask.dataframe (1567)
Add indicator keyword to merge (1575)
Support Series in read_hdf (1575)
Support Categories with missing values (1578)
Support inplace operators like df.x += 1 (1585)
Str accessor passes through args and kwargs (1621)
Improved groupby support for single-machine multiprocessing scheduler (1625)
Tree reductions (1663)
Pivot tables (1665)
Add clip (1667), align (1668), combine_first (1725), and any/all (1724)
Improved handling of divisions on dask-pandas merges (1666)
Add groupby.aggregate method (1678)
Add dd.read_table function (1682)
Improve support for multi-level columns (1697) (1712)
Support 2d indexing in loc (1726)
Extend resample to include DataFrames (1741)
Support dask.array ufuncs on dask.dataframe objects (1669)
Add information about how dask.array chunks argument work (1504)
Fix field access with non-scalar fields in dask.array (1484)
Add concatenate= keyword to atop to concatenate chunks of contracted dimensions
Optimized slicing performance (1539) (1731)
Extend atop with a concatenate= (1609) new_axes= (1612) and adjust_chunks= (1716) keywords
Add clip (1610) swapaxes (1611) round (1708) repeat
Automatically align chunks in atop-backed operations (1644)
Cull dask.arrays on slicing (1709)
Fix issue with callables in bag.from_sequence being interpreted as tasks (1491)
Avoid non-lazy memory use in reductions (1747)
Added changelog (1526)
Create new threadpool when operating from thread (1487)
Unify example documentation pages into one (1520)
Add versioneer for git-commit based versions (1569)
Pass through node_attr and edge_attr keywords in dot visualization (1614)
Add continuous testing for Windows with Appveyor (1648)
Remove use of multiprocessing.Manager (1653)
Add global optimizations keyword to compute (1675)
Micro-optimize get_dependencies (1722)
Nothing published for this version
DataFrames now enforce knowing full metadata (columns, dtypes) everywhere. Previously we would operate in an ambiguous state when functions lost dtype
DataFrames now enforce knowing full metadata (columns, dtypes) everywhere. Previously we would operate in an ambiguous state when functions lost dtype information (such as apply ). Now all dataframes always know their dtypes and raise errors asking for information if they are unable to infer (which they usually can). Some internal attributes like _pd and _pd_nonempty have been moved.
The internals of the distributed scheduler have been refactored to transition tasks between explicit states. This improves resilience, reasoning about scheduling, plugin operation, and logging. It also makes the scheduler code easier to understand for newcomers.
The distributed.s3 and distributed.hdfs namespaces are gone. Use protocols in normal methods like read_text('s3://...' instead.
Dask.array.reshape now errs in some cases where previously it would have create a very large number of tasks
- More Dataframe shuffles now work in distributed settings, ranging from setting-index to hash joins, to sorted joins and groupbys.
More Dataframe shuffles now work in distributed settings, ranging from setting-index to hash joins, to sorted joins and groupbys.
Dask passes the full test suite when run when under in Python’s optimized-OO mode.
On-disk shuffles were found to produce wrong results in some highly-concurrent situations, especially on Windows. This has been resolved by a fix to the partd library.
Fixed a growth of open file descriptors that occurred under large data communications
Support ports in the --bokeh-whitelist option ot dask-scheduler to better routing of web interface messages behind non-trivial network settings
Some improvements to resilience to worker failure (though other known failures persist)
You can now start an IPython kernel on any worker for improved debugging and analysis
Improvements to dask.dataframe.read_hdf , especially when reading from multiple files and docs
Nothing published for this version
- This version drops support for Python 2.6
This version drops support for Python 2.6
Conda packages are built and served from conda-forge
The dask.distributed executables have been renamed from dfoo to dask-foo. For example dscheduler is renamed to dask-scheduler
Both Bag and DataFrame include a preliminary distributed shuffle.
Add task-based shuffle for distributed groupbys
Add accumulate for cumulative reductions
Add a task-based shuffle suitable for distributed joins, groupby-applys, and set_index operations. The single-machine shuffle remains untouched (and much more efficient.)
Add support for new Pandas rolling API with improved communication performance on distributed systems.
Add groupby.std/var
Pass through S3/HDFS storage options in read_csv
Improve categorical partitioning
Add eval, info, isnull, notnull for dataframes
Rename executables like dscheduler to dask-scheduler
Improve scheduler performance in the many-fast-tasks case (important for shuffling)
Improve work stealing to be aware of expected function run-times and data sizes. The drastically increases the breadth of algorithms that can be efficiently run on the distributed scheduler without significant user expertise.
Support maximum buffer sizes in streaming queues
Improve Windows support when using the Bokeh diagnostic web interface
Support compression of very-large-bytestrings in protocol
Support clean cancellation of submitted futures in Joblib interface
All dask-related projects (dask, distributed, s3fs, hdfs, partd) are now building conda packages on conda-forge.
Change credential handling in s3fs to only pass around delegated credentials if explicitly given secret/key. The default now is to rely on managed environments. This can be changed back by explicitly providing a keyword argument. Anonymous mode must be explicitly declared if desired.
- dask.do and dask.value have been renamed to dask.delayed
dask.do and dask.value have been renamed to dask.delayed
dask.bag.from_filenames has been renamed to dask.bag.read_text
All S3/HDFS data ingest functions like db.from_s3 or distributed.s3.read_csv have been moved into the plain read_text , read_csv functions , which now support protocols, like dd.read_csv('s3://bucket/keys*.csv')
Add support for scipy.LinearOperator
Improve optional locking to on-disk data structures
Change rechunk to expose the intermediate chunks
Rename from_filename s to read_text
Remove from_s3 in favor of read_text('s3://...')
Fixed numerical stability issue for correlation and covariance
Allow no-hash from_pandas for speedy round-trips to and from-pandas objects
Generally reengineered read_csv to be more in line with Pandas behavior
Support fast set_index operations for sorted columns
Rename do/value to delayed
Rename to/from_imperative to to/from_delayed
Move s3 and hdfs functionality into the dask repository
Adaptively oversubscribe workers for very fast tasks
Improve PyPy support
Improve work stealing for unbalanced workers
Scatter data efficiently with tree-scatters
Add lzma/xz compression support
Raise a warning when trying to split unsplittable compression types, like gzip or bz2
Improve hashing for single-machine shuffle operations
Add new callback method for start state
General performance tuning
Nothing published for this version
- Bugfix for range slicing that could periodically lead to incorrect results.
Bugfix for range slicing that could periodically lead to incorrect results.
Improved support and resiliency of arg reductions ( argmin , argmax , etc.)
Add zip function
Add corr and cov functions
Add melt function
Bugfixes for io to bcolz and hdf5
Bugfix for range slicing that could periodically lead to incorrect results.
Improved support and resiliency of arg reductions (argmin, argmax, etc.)
Add zip function
Add corr and cov functions
Add melt function
Bugfixes for io to bcolz and hdf5
- Changed default array reduction split from 32 to 4
Changed default array reduction split from 32 to 4
Linear algebra, tril , triu , LU , inv , cholesky , solve , solve_triangular , eye , lstsq , diag , corrcoef .
Add tree reductions
Add range function
drop from_hdfs function (better functionality now exists in hdfs3 and distributed projects)
Refactor dask.dataframe to include a full empty pandas dataframe as metadata. Drop the .columns attribute on Series
Add Series categorical accessor, series.nunique, drop the .columns attribute for series.
read_csv fixes (multi-column parse_dates, integer column names, etc. )
Internal changes to improve graph serialization
Documentation updates
Add from_imperative and to_imperative functions for all collections
Aesthetic changes to profiler plots
Moved the dask project to a new dask organization
- Add view , compress , hstack , dstack , vstack methods
Improve thread safety
Tree reductions
Add view , compress , hstack , dstack , vstack methods
map_blocks can now remove and add dimensions
Improve thread safety
Extend sampling to include replacement options
Removed optimization passes that fused results.
Removed dask.distributed
Improved performance of blocked file reading
Serialization improvements
Test Python 3.5
Improve thread safety
Tree reductions
Add view, compress, hstack, dstack, vstack methods
map_blocks can now remove and add dimensions
Improve thread safety
Extend sampling to include replacement options
Removed optimization passes that fused results.
Removed dask.distributed
Improved performance of blocked file reading
Serialization improvements
Test Python 3.5
Nothing published for this version
This release also includes a deprecation warning for dask.distributed , which will be removed in the next version.
This was mostly a bugfix release. Some notable changes:
Fix minor bugs associated with the release of numpy 1.10 and pandas 0.17
Fixed a bug with random number generation that would cause repeated blocks due to the birthday paradox
Use locks in dask.dataframe.read_hdf by default to avoid concurrency issues
Change dask.get to point to dask.async.get_sync by default
Allow visualization functions to accept general graphviz graph options like rankdir=’LR’
Add reshape and ravel to dask.array
Support the creation of dask.arrays from dask.imperative objects
This release also includes a deprecation warning for dask.distributed , which will be removed in the next version.
Future development in distributed computing for dask is happening here: https://distributed.dask.org . General feedback on that project is most welcome from this community.
- A utility for profiling memory and cpu usage has been added to the dask.diagnostics module.
A utility for profiling memory and cpu usage has been added to the dask.diagnostics module.
This release improves coverage of the pandas API. Among other things it includes nunique , nlargest , quantile . Fixes encoding issues with reading non-ascii csv files. Performance improvements and bug fixes with resample. More flexible read_hdf with globbing. And many more. Various bug fixes in dask.imperative and dask.bag .
Nothing published for this version
Nothing published for this version
This release includes significant bugfixes and alignment with the Pandas API. This has resulted both from use and from recent involvement by Pandas co
This release includes significant bugfixes and alignment with the Pandas API. This has resulted both from use and from recent involvement by Pandas core developers.
New operations: query, rolling operations, drop
Improved operations: quantiles, arithmetic on full dataframes, dropna, constructor logic, merge/join, elemwise operations, groupby aggregations
Fixed a bug in fold where with a null default argument
New operations: da.fft module, da.image.imread
The array and dataframe collections create graphs with deterministic keys. These tend to be longer (hash strings) but should be consistent between computations. This will be useful for caching in the future.
All collections (Array, Bag, DataFrame) inherit from common subclass
- Improved (though not yet sufficient) resiliency for dask.distributed when workers die
Improved (though not yet sufficient) resiliency for dask.distributed when workers die
Improved writing to various formats, including to_hdf, to_castra, and to_csv
Improved creation of dask DataFrames from dask Arrays and Bags
Improved support for categoricals and various other methods
Various bug fixes
Histogram function
Added tie-breaking ordering of tasks within parallel workloads to better handle and clear intermediate results
Added the dask.do function for explicit construction of graphs with normal python code
Traded pydot for graphviz library for graph printing to support Python3
There is also a gitter chat room and a stackoverflow tag
Contents
Improved (though not yet sufficient) resiliency for dask.distributed when workers die
Improved writing to various formats, including to_hdf, to_castra, and to_csv
Improved creation of dask DataFrames from dask Arrays and Bags
Improved support for categoricals and various other methods
Various bug fixes
Histogram function
Added tie-breaking ordering of tasks within parallel workloads to better handle and clear intermediate results
Added the dask.do function for explicit construction of graphs with normal python code
Traded pydot for graphviz library for graph printing to support Python3
There is also a gitter chat room and a stackoverflow tag
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Your coding agent can read these notes before it upgrades. Set up the MCP server →