NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #978 most downloaded on PyPI
Ray provides a simple, universal API for building distributed applications.
Latest stable
2.60.0
Last release 15 days ago
04 Nov 2026
Ships fairly regularly
a new release about every 3 weeks
Nearly every release is documented
notes for 59 of the last 60 stable releases
1 version withdrawn
withdrawn after publishing
9 years old
137 releases · first in 2017
Drag across the ruler to compare, or tap a release to open it.
Add per worker process group and deprecate process subreaper in favor of cleanup using process group.
Ray Data: This release offers many updates to Ray Data, including:
with_column, and column aliasing for more powerful data transformationsRay Core:
Alpha release of Ray Direct Transport (formerly GPU objects) - simply enable it by adding the tensor_transport parameter to the existing native Ray Core API. This keeps GPU data in GPU memory until a transfer is needed, avoiding expensive serialization and copies to and from the Ray object store. It uses efficient data transports such as collective communication libraries (GLOO or NCCL) or point-to-point RDMA (via NVIDIA’s NIXL) to transfer data directly between devices, including both CPUs and GPUs.
Ray Train:
Local mode support for multi-process training with torchrun, enhanced checkpoint management with new upload modes and validation functions
Ray Serve:
celery and DLQ.RAY_SERVE_THROUGHPUT_OPTIMIZED environment variable.RLLib:
Add StepFailedRecreateEnv exception for users with unsatisfiable environments
Ray Serve/Data LLM:
Improvements to multi node serving, loading models from remote storages, and sharing resources for efficiency (fractional gpus, sharing gpus on a data pipeline with shared stages)
🎉 New Features:
explain() API provides insights into dataset execution plans (#55482)streaming_train_test_split to avoid materialization for train/test splits (#56803)chat_template_kwargs parameter for customizing chat templates (#56490)max_task_concurrency and resource allocation options (#56370, #56381)💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
🎉 New Features:
💫 Enhancements:
📖 Documentation:
💫 Enhancements:
Thank you to everyone who contributed to this release!
@alexeykudinkin, @richardliaw, @nrghosh, @ljstrnadiii, @Daraan, @kouroshHakha, @Bye-legumes, @kamil-kaczmarek, @jugalshah291, @sampan-s-nayak, @jjyao, @Evelynn-V, @gangsf, @omatthew98, @TimothySeah, @kshanmol, @goutamvenkat-anyscale, @axreldable, @jiangwu300, @simonsays1980, @400Ping, @JasonLi1909, @chuang0221, @weiliango, @Myasuka, @win5923, @liulehui, @khluu, @ok-scale, @eicherseiji, @tianyi-ge, @MengjinYan, @kevin85421, @Yevet, @orangeQWJ, @vie-serendipity, @edoakes, @wyhong3103, @israbbani, @vickytsang, @HassamSheikh, @acrewdson, @czgdp1807, @daiping8, @carolynwang, @thc1006, @jeffreyjeffreywang, @Stack-Attack, @Catch-Bull, @elliot-barn, @Levi080513, @BestVIncent, @dragongu, @jmajety-dev, @jcarlson212, @tohtana, @abrarsheikh, @crypdick, @Yicheng-Lu-llll, @ZacAttack, @justinvyu, @lk-chen, @alanwguo, @mcoder6425, @my-vegetable-has-exploded, @yancanmao, @arcyleung, @rjpower, @codope, @harshit-anyscale, @dayshah, @stephanie-wang, @KaisennHu, @ryanaoleary, @saihaj, @mattip, @rueian, @Kunchd, @pavitrabhalla, @owenowenisme, @Aydin-ab, @gvspraveen, @minerharry, @JackGammack, @jpatra72, @coqian, @zcin, @dstrodtman, @aslonnie, @ahao-anyscale, @GuyStone, @iamjustinhsu, @seanlaii, @ruisearch42, @akyang-anyscale, @ArturNiederfahrenhorst, @bveeramani, @OneSizeFitsQuorum, @xinyuangui2, @sb-hakunamatata, @22quinn, @Sparks0219, @sven1977, @snehachhabria, @dioptre, @nadongjun, @eric-higgins-ai, @marosset, @MatthewCWeston, @pcmoritz, @can-anyscale, @pimdh, @roshankathawate, @matthewdeng, @martinbomio, @GokuMohandas, @alimaazamat, @ali-corpo, @landscapepainter, @Qiaolin-Yu, @vaishdho1, @avigyabb, @srinathk10, @tannerdwood
Your coding agent can read these notes before it upgrades. Set up the MCP server →
There is no difference between 2.49.2 and 2.49.1, though we needed a patch version for other out of band reasons. To fill the awkward blankness, here
There is no difference between 2.49.2 and 2.49.1, though we needed a patch version for other out of band reasons. To fill the awkward blankness, here is a haiku about Ray:
Summit drawing near Ray advances, step by step Scaling without end
Ray Dashboard: Fix issue where GPU metrics are missing
Autoscaling ergonomics. Marked per-deployment autoscaling metrics push interval config as deprecated for consistency. #55102
Ray Data:
Ray Core:
Ray Train:
Ray Serve:
Ray Serve/Data LLM:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
iter_torch_batches. (#54277)🔨 Fixes:
TensorType handling. (#55694)ImportError in Atari examples. (#54967)TorchMultiCategorical.to_deterministic when having different number of categories and logits with time dimension. (#54414)SACConfig's training(). (#53918)restore_from_path such that connector states are also restored on remote EnvRunners. (#54672)config.count_steps_by = "agent_steps". (#54885)CUBLAS_WORKSPACE_CONFIG. (#53913)rllib_contrib completely from RLlib. (#55182)🏗 Architecture refactoring:
RLModule. (#55141)--enable-new-api-stack flag from all scripts. (#54853, #54702)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
💫 Enhancements:
RayNodeType label on for nodes. (#55493, #55192)🔨 Fixes:
🎉 New Features:
💫 Enhancements:
💫 Enhancements:
🔨 Fixes:
Thank you to everyone who contributed to this release! @pavitrabhalla, @Daraan, @Sparks0219, @daiping8, @abrarsheikh, @sven1977, @Toshaksha, @bveeramani, @MengjinYan, @GokuMohandas, @codope, @nadongjun, @SolitaryThinker, @matthewdeng, @elliot-barn, @isimluk, @avibasnet31, @OneSizeFitsQuorum, @Future-Outlier, @marosset, @jackfrancis, @kshanmol, @eicherseiji, @dayshah, @iamjustinhsu, @Qiaolin-Yu, @goutamvenkat-anyscale, @Yicheng-Lu-llll, @yantarou, @rclough, @zcin, @NeilGirdhar, @VarunBhandary, @400Ping, @akshay-anyscale, @vickytsang, @xushiyan, @JasonLi1909, @n-elia, @simonsays1980, @dragongu, @Kishanthan, @ruisearch42, @jectpro7, @TimothySeah, @liulehui, @rueian, @HollowMan6, @akyang-anyscale, @axreldable, @czgdp1807, @alanwguo, @justinvyu, @ok-scale, @my-vegetable-has-exploded, @landscapepainter, @fscnick, @machichima, @mpashkovskii, @ZacAttack, @gvspraveen, @sword865, @lmsh7, @Ziy1-Tan, @rebel-scottlee, @sampan-s-nayak, @coqian, @can-anyscale, @Bye-legumes, @win5923, @MortalHappiness, @angelinalg, @khluu, @aslonnie, @krishnakalyan3, @minosvasilias, @x-tong, @xinyuangui2, @raulchen, @Yangruipis, @edoakes, @kevin85421, @wingkitlee0, @Fokko, @cristianjd, @srinathk10, @owenowenisme, @JoshKarpel, @MengqingCao, @leopardracer, @westonpace, @LeslieWongCV, @VassilisVassiliadis, @crypdick, @alexeykudinkin, @mjacar, @kunling-anyscale, @saihaj, @kouroshHakha, @ema-pe, @markjm, @avigyabb, @dshepelev15, @mauvilsa, @omatthew98, @nrghosh, @ryanaoleary, @Aydin-ab, @lk-chen, @stephanie-wang, @harshit-anyscale, @jjyao, @bullgom, @Yevet, @israbbani
Removed deprecated ray.workflow package
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features
💫 Enhancements
🔨 Fixes
📖 Documentation
🏗 Architecture refactoring
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
Docs 🎉 New Features:
💫 Enhancements:
Breaking Changes
Dependencies & Build
Thank you to everyone who contributed to this release! @kouroshHakha, @davidwagnerkc, @MengjinYan, @minerharry, @simonsays1980, @Myasuka, @noemotiovon, @goutamvenkat-anyscale, @harshit-anyscale, @jugalshah291, @tianyi-ge, @sven1977, @crypdick, @JohnsonKuan, @lk-chen, @richardsliu, @alexeykudinkin, @EagleLo, @soffer-anyscale, @zcin, @AdrienVannson, @nilsmelchert, @raulchen, @jujipotle, @DrehanM, @vigneshka, @Ziy1-Tan, @Blaze-DSP, @ArthurBook, @GokuMohandas, @walkoss, @bveeramani, @edoakes, @omatthew98, @SeanQuant, @CheyuWu, @cszhu, @win5923, @kevin85421, @angelinalg, @iamjustinhsu, @eicherseiji, @kunling-anyscale, @vickytsang, @MortalHappiness, @aslonnie, @psr-ai, @sbhat98, @anyadontfly, @marwan116, @cristianjd, @2niuhe, @codope, @fscnick, @ryanaoleary, @srinathk10, @TimothySeah, @han-steve, @Future-Outlier, @Syulin7, @Qiaolin-Yu, @elliot-barn, @JoshKarpel, @dayshah, @can-anyscale, @ok-scale, @mattip, @SolitaryThinker, @owenowenisme, @nehiljain, @GeneDer, @rnkrtt, @israbbani, @DriverSong, @sinalallsite, @pcmoritz, @akyang-anyscale, @xinyuangui2, @nrghosh, @davidxia, @rueian, @stephanie-wang, @jjyao, @chris-ray-zhang, @czgdp1807, @justinvyu, @Daraan, @landscapepainter, @troychiu, @khluu, @hipudding, @ruisearch42, @robertnishihara, @ArturNiederfahrenhorst, @abrarsheikh, @alanwguo, @HollowMan6, @ran1995data, @matthewdeng
Ray 2.47.1 fixed an issue where Ray failed to start on Mac
Ray 2.47.1 fixed an issue where Ray failed to start on Mac (https://github.com/ray-project/ray/pull/53807)
Prefill disaggregation is now supported in initial support in Ray Serve LLM (#53092). This is critical for production LLM serving use cases.
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
from_torch respect Dataset len (#52804)on_exit hook (#53249)move_tensors_to_device utility for the list/tuple[tensor] case (#53109)ActorPool scaling to avoid scaling down when the input queue is empty (#53009)FileBasedDatasource. This fixes potential OOMs for workloads using FileBasedDatasources (#52852)📖 Documentation:
🎉 New Features:
TrainControllerState to enhance observability. (#52805)💫 Enhancements:
Noop scaling decisions for smoother scaling logic. (#53180)🔨 Fixes:
move_tensors_to_device utility to correctly handle list / tuple of tensors. (#53109)test_torch_device_manager to reduce flakiness. (#52917)📖 Documentation:
🏗 Architecture refactoring:
PARALLEL_CI blocks and combined imports. (#53087, #52742)💫 Enhancements:
test_train_v2_integration to use the correct RunConfig. (#52882)📖 Documentation:
session.report with tune.report and corrected import paths. (#52801)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
runtime_env validation for py_modules. (#53186)📖 Documentation:
🎉 New Features:
serve.llm API (#52719)💫 Enhancements:
name_prefix in build_llm_deployment (#53316)repetition_penalty vLLM sampling parameter (#53222)wait_for_min_actors_s🔨 Fixes:
LLMRouter.check_health() should check LLMServer.check_health() (#53358)check_health return type (#53114)<bos> token (#52853)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
split_and_zero_pad utility function (related to complex structures vs simple values or np.arrays). (#52818)💫 Enhancements:
uv run integration is now enabled by default, so you don't need to set the RAY_RUNTIME_ENV_HOOK any more (#53060). If you rely on the previous behavior where uv run only runs the Ray driver but not the workers in the uv environment, you can switch back to the old behavior by setting the RAY_ENABLE_UV_RUN_RUNTIME_ENV=0 environment variable.🔨 Fixes:
RuntimeEnv in the Job Submission API. (#52704)serialize_to_numpy_or_scalar (#53160)RestartActor rpc is ignored (#53330)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
h11 (#53361), requests, starlette, jinja2 (#52951), pyopenssl and cryptography (#52941)🎉 New Features:
💫 Enhancements:
Thank you to everyone who contributed to this release!
@NeilGirdhar, @ok-scale, @JiangJiaWei1103, @brandonscript, @eicherseiji, @ktyxx, @MichalPitr, @GeneDer, @rueian, @khluu, @bveeramani, @ArturNiederfahrenhorst, @c8ef, @lk-chen, @alanwguo, @simonsays1980, @codope, @ArthurBook, @kouroshHakha, @Yicheng-Lu-llll, @jujipotle, @aslonnie, @justinvyu, @machichima, @pcmoritz, @saihaj, @wingkitlee0, @omatthew98, @can-anyscale, @nadongjun, @chris-ray-zhang, @dizer-ti, @matthewdeng, @ryanaoleary, @janimo, @crypdick, @srinathk10, @cszhu, @TimothySeah, @iamjustinhsu, @mimiliaogo, @angelinalg, @gvspraveen, @kevin85421, @jjyao, @elliot-barn, @xingyu-long, @LeoLiao123, @thomasdesr, @ishaan-mehta, @noemotiovon, @hipudding, @davidxia, @omahs, @MengjinYan, @dengwxn, @MortalHappiness, @alhparsa, @emmanuel-ferdman, @alexeykudinkin, @KunWuLuan, @dev-goyal, @sven1977, @akyang-anyscale, @GokuMohandas, @raulchen, @abrarsheikh, @edoakes, @JoshKarpel, @bhmiller, @seanlaii, @ruisearch42, @dayshah, @Bye-legumes, @petern48, @richardliaw, @rclough, @israbbani, @jiwq
New custom_data attribute for SingleAgentEpisode and MultiAgentEpisode to store custom metrics. Deprecates add|get_temporary_timestep_data()
The 2.46 Ray release comes with a couple core highlights:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
on_offline_evaluate_start, on_offline_evaluate_end, on_offline_eval_runners_recreated (#52308)💫 Enhancements:
custom_data attribute for SingleAgentEpisode and MultiAgentEpisode to store custom metrics. Deprecates add|get_temporary_timestep_data() (#52603)💫 Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
🎉 New Features:
Thank you to everyone who contributed to this release! @kevin85421, @edoakes, @wingkitlee0, @alexeykudinkin, @chris-ray-zhang, @sophie0730, @zcin, @raulchen, @matthewdeng, @abrarsheikh, @popojk, @Jay-ju, @ruisearch42, @eicherseiji, @lk-chen, @justinvyu, @dayshah, @kouroshHakha, @NeilGirdhar, @omatthew98, @ishaan-mehta, @davidxia, @ArthurBook, @GeneDer, @srinathk10, @dependabot[bot], @JoshKarpel, @aslonnie, @khluu, @can-anyscale, @israbbani, @saihaj, @MortalHappiness, @alanwguo, @bveeramani, @iamjustinhsu, @Ziy1-Tan, @xingyu-long, @simonsays1980, @fscnick, @chuang0221, @sven1977, @jjyao
Make Object Store Fallback Directory configurable (#51189).
💫 Enhancements
with_tensor_transport(transport='shm') (#51872).🔨 Fixes
KillActor RPC with force_kill=True can actually kill the threaded actor (#51414).CoreWorker::Shutdown instead of CoreWorker::Disconnect (#52374).🏗 Architecture refactoring
🎉 New Features
Dataset.write_clickhouse() (#50377)ray_remote_args_fn in Dataset.groupby().map_groups() to set per-group runtime env and resource hints (#51236)Dataset.name / set_name as a public API for easier lineage tracking (#51076)Dataset.flat_map() (#51180)read_json() (#52083)Dataset.export_metadata() for schema & stats snapshots (#52227)💫 Enhancements
RefBundle.get_cached_location() lookup (#52097)PandasBlock.size_bytes() (#52510)BlockColumnAccessor utilities and ops (#51326, #51571)🔨 Fixes
MapTransformFn.__eq__ equality check (#51434)FileBasedDataSource (#51424)_expand_paths (#50178)Dataset.random_sample() (#51401)RandomAccessDataset.multiget() return values (#51421)ResourceManager (#52226)📖 Documentation
🎉 New Features
v2.LightGBMTrainer API into the public trainer class as an alternate constructor (#51265).💫 Enhancements
test_telemetry to medium size (#52178).Trainer initialization (#50966).🔨 Fixes
OutputSplitter._locality_hints from actor_locality_enabled and locality_with_output (#52005).RunAttempt workers as dead after completion to avoid stale states (#51540).setup_wandb rank_zero_only logic (#52381).📖 Documentation
🏗 Architecture refactoring
HIP_VISIBLE_DEVICES (#51104).📖 Documentation
pbt_ppo_example.ipynb (#51626).🎉 New Features
ray.llm support custom accelerators (#51359).💫 Enhancements
🔨 Fixes
RAY_SERVE_ENABLE_QUEUE_LENGTH_CACHE flag (#51649).RAY_SERVE_EAGERLY_START_REPLACEMENT_REPLICAS flag (#51722).ServeReplica deployment failure for DeepSeek (#51989).GPUType enum value rather than enum itself (#52037).📖 Documentation
tokenizer_pool_size (#52356).🎉 New Features
💫 Enhancements
MetricsLogger and Stats (#52334).duration="auto" (#51637).on_episode_end (#52252).🔨 Fixes
🏗 Architecture refactoring
EnvRunner (optional) (#52091).💫 Enhancements
🔨 Fixes
DurationText component (#52395).Many thanks to all those who contributed to this release! @samhallam-reverb, @vickytsang, @anyadontfly, @zhaoch23, @bryant1410, @khluu, @akyang-anyscale, @angelinalg, @RocketRider, @wingkitlee0, @robertnishihara, @liuxsh9, @KepingYan, @SumanthRH, @emmanuel-ferdman, @ashwinsnambiar, @ArturNiederfahrenhorst, @KPCOFGS, @Bye-legumes, @400Ping, @dayshah, @aslonnie, @justinvyu, @rugggg, @zhiqiwangebay, @comaniac, @thusoy, @JDarDagran, @chuang0221, @davidxia, @tnixon, @israbbani, @win5923, @leibovitzgil, @simonsays1980, @machichima, @VamshikShetty, @zcin, @lk-chen, @abrarsheikh, @edoakes, @alexeykudinkin, @ruisearch42, @tespent, @jecsand838, @sijieamoy, @can-anyscale, @JonDum, @jyakaranda, @nadongjun, @d-miketa, @MortalHappiness, @kevin85421, @Ziy1-Tan, @matthewdeng, @crypdick, @hongpeng-guo, @richardliaw, @Qiaolin-Yu, @bhmiller, @soffer-anyscale, @kenchung285, @nishi-t, @Drice1999, @ryanaoleary, @chris-ray-zhang, @MengjinYan, @saihaj, @jjyao, @jaganmolleti7, @iamjustinhsu, @fscnick, @pcmoritz, @Jay-ju, @westonpace, @han-steve, @GeneDer, @denadai2, @thomasdesr, @jaychia, @raulchen, @omatthew98, @srinathk10, @alanwguo, @rueian, @akshay-anyscale, @bveeramani, @dentiny, @dhakshin32, @kouroshHakha, @sven1977
There is no difference between 2.44.1 and 2.44.0, though we needed a patch version for other out of band reasons. To fill the awkward blankness, here
There is no difference between 2.44.1 and 2.44.0, though we needed a patch version for other out of band reasons. To fill the awkward blankness, here is a haiku about Ray:
Under screen-lit skies A ray of bliss in each patch Joy at any scale
The experimental Ray Workflows library has been deprecated and will be removed in a future version of Ray. Ray Workflows has been marked experimental…
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
override_num_blocks when reading from a HuggingFace Dataset (#50998)StandardScaler to handle NaN stats (#51281)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
additional_log_standard_attrs to serve logging config (#51144)asyncache and cachetools from dependencies (#50806)backoff dependency (#50822)asyncio_timeout from ray[llm] deps on python<3.11 (#50815)jsonref packages lazy imported (#50821)AutoscalingConfig and DeploymentConfig from Serve (#50871)pyarrow FS for cloud remote storage interaction (#50820)serve.llm (#51221)🔨 Fixes:
device_capability issue in vllm on quantized models (#51007)gen-config related data file to the package (#51347)📖 Documentation:
build_openai_app to include yaml example (#51283)💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
uv support (#51233)💫 Enhancements:
🔨 Fixes:
ray.wait on object store objects (#50680)ray.actor.exit_actor() from within an async background thread (#49451)📖 Documentation:
jemalloc profiling doc (#51031)🎉 New Features:
💫 Enhancements:
ray status -v (#51192)🔨 Fixes:
🏗 Architecture refactoring:
CoordinatorSenderNodeProvider (#51292)🎉 New Features:
🔨 Fixes:
Many thanks to all those who contributed to this release! @crypdick, @rueian, @justinvyu, @MortalHappiness, @CheyuWu, @GeneDer, @dayshah, @lk-chen, @matthewdeng, @co63oc, @win5923, @sven1977, @akshay-anyscale, @ShaochenYu-YW, @gvspraveen, @bveeramani, @jakac, @VamshikShetty, @raulchen, @PaulFenton, @elimelt, @comaniac, @qinyiyan, @ruisearch42, @nadongjun, @AndyUB, @israbbani, @hongpeng-guo, @laysfire, @alexeykudinkin, @Drice1999, @harborn, @scottsun94, @abrarsheikh, @martinbomio, @MengjinYan, @HollowMan6, @orcahmlee, @kenchung285, @csy1204, @noemotiovon, @jujipotle, @davidxia, @kevin85421, @hcc429, @edoakes, @kouroshHakha, @omatthew98, @alanwguo, @farridav, @aslonnie, @simonsays1980, @pcmoritz, @terraflops1048576, @JoshKarpel, @SumanthRH, @sijieamoy, @zcin, @can-anyscale, @akyang-anyscale, @angelinalg, @saihaj, @jjyao, @anmscale, @ryanaoleary, @dentiny, @jimmyxie-figma, @stephanie-wang, @khluu, @maofagui
These APIs are marked as alpha -- meaning they may change in future releases without a deprecation period.
ray.data.llm and ray.serve.llm. See the below notes for more details. These APIs are marked as alpha -- meaning they may change in future releases without a deprecation period.RAY_TRAIN_V2_ENABLED=1 environment variable. See the migration guide for more information.uv run that allows easily specifying Python dependencies for both driver and workers in a consistent way and enables quick iterations for development of Ray applications (#50160, 50462), check out our blog post🎉 New Features:
Processor abstraction that interoperates with existing Ray Data pipelines. This abstraction can be configured two ways:
vLLMEngineProcessorConfig, which configures vLLM to load model replicas for high throughput model inferenceHttpRequestProcessorConfig, which sends HTTP requests to an OpenAI-compatible endpoint for inference.UnionOperator (#50436)💫 Enhancements:
ShufflingBatcher onto try_combine_chunked_columns (#50296)ArrowBlockAccessor, PandasBlockAccessor (#50498)AggregateFn with AggregateFnV2, cleaning up Aggregation infrastructure (#50585)TaskDurationStats and on_execution_step callback (#50766)🔨 Fixes:
grouped_data.py docstrings (#50392)test_map_batches_async_generator (#50459)pyarrow.infer_type on datetime arrays (#50403)📖 Documentation:
🎉 New Features:
RAY_TRAIN_V2_ENABLED=1 environment variable. See the migration guide for more information.💫 Enhancements:
ray[train] extra install (#46682)🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
VLLMService: A prebuilt deployment that offers a full-featured vLLM engine integration, with support for features such as LoRA multiplexing and multimodal language models.LLMRouter: An out-of-the-box OpenAI compatible model router that can route across multiple LLM deployments.💫 Enhancements:
required_resources to REST API (#50058)🔨 Fixes:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
on_workers/env_runners_recreated callback would be called twice. (#50172)default_resource_request: aggregator actors missing in placement group for local Learner. (#50219, #50475)📖 Documentation:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
Thank you to everyone who contributed to this release! 🥳 @liuxsh9, @justinrmiller, @CheyuWu, @400Ping, @scottsun94, @bveeramani, @bhmiller, @tylerfreckmann, @hefeiyun, @pcmoritz, @matthewdeng, @dentiny, @erictang000, @gvspraveen, @simonsays1980, @aslonnie, @shorbaji, @LeoLiao123, @justinvyu, @israbbani, @zcin, @ruisearch42, @khluu, @kouroshHakha, @sijieamoy, @SergeCroise, @raulchen, @anson627, @bluenote10, @allenyin55, @martinbomio, @rueian, @rynewang, @owenowenisme, @Betula-L, @alexeykudinkin, @crypdick, @jujipotle, @saihaj, @EricWiener, @kevin85421, @MengjinYan, @chris-ray-zhang, @SumanthRH, @chiayi, @comaniac, @angelinalg, @kenchung285, @tanmaychimurkar, @andrewsykim, @MortalHappiness, @sven1977, @richardliaw, @omatthew98, @fscnick, @akyang-anyscale, @cristianjd, @Jay-ju, @spencer-p, @win5923, @wxsms, @stfp, @letaoj, @JDarDagran, @jjyao, @srinathk10, @edoakes, @vincent0426, @dayshah, @davidxia, @DmitriGekhtman, @GeneDer, @HYLcool, @gameofby, @can-anyscale, @ryanaoleary, @eddyxu
## Ray Data 🔨 Fixes: - Fixes incorrect assertion
🔨 Fixes:
Deprecated num_rows_per_file in favor of min_rows_per_file
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🗑️ Deprecations:
💫 Enhancements:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
AddTimeDimToBatchAndZeroPad and AddStatesFromEpisodesToBatch) (#49835)🔨 Fixes:
replay-ratio=0 (fixes a memory leak). (#49964)📖 Documentation:
training_step(). (#49976)TargetNetAPI) (#49825)💫 Enhancements:
🔨 Fixes:
🔨 Fixes:
Thank you to everyone who contributed to this release! 🥳 @wingkitlee0, @saihaj, @win5923, @justinvyu, @kevin85421, @edoakes, @cristianjd, @rynewang, @richardliaw, @LeoLiao123, @alexeykudinkin, @simonsays1980, @aslonnie, @ruisearch42, @pcmoritz, @fscnick, @bveeramani, @mattip, @till-m, @tswast, @ujjawal-khare, @wadhah101, @nikitavemuri, @akshay-anyscale, @srinathk10, @zcin, @dayshah, @dentiny, @LydiaXwQ, @matthewdeng, @JoshKarpel, @MortalHappiness, @sven1977, @omatthew98
Major update of RLlib docs and example scripts for the new API stack.
🎉 New Features:
partition_cols in write_parquet (#49411)💫 Enhancements:
ValueError when the data sort key is None (#48969)hudi version to 0.2.0 (#48875)webdataset: expand JSON objects into individual samples (#48673)ExecutionCallback interface (#49205)select_columns and rename_columns use Project operator (#49393)🔨 Fixes:
map_groups (#48907)read_sql (#48923)webdataset: flatten return args (#48674)numpy > 2.0.0 behaviour in _create_possibly_ragged_ndarray (#48064)DataContext sealing for multiple datasets. (#49096)to_tf for List types (#49139)on_write_completes (#49251)groupby hang when value contains np.nan (#49420)file_extensions doesn't work with compound extensions (#49244)🎉 New Features:
💫 Enhancements:
🏗 Architecture refactoring:
get_network_params implementation (#49019)🎉 New Features:
optuna_search to allow users to configure optuna storage (#48547)🏗 Architecture refactoring:
💫 Enhancements:
pickle.dumps for faster serialization from proxy to replica (#49539)🔨 Fixes:
ray.init() is called multiple times with different runtime_envs (#49074)🗑️ Deprecations:
RAY_SERVE_RUN_SYNC_IN_THREADPOOL=1. (#48897)🎉 New Features:
💫 Enhancements:
EpisodeReplayBuffer. (#48116)SampleBatch data and fully compressed observations. (#48699)OfflineData. (#49015)AggregatorActors per Learner. (#49284)tuned_examples). (#49068)📖 Documentation:
RLModule page. (#49387)package_ref page for algo configs. (#49464)🔨 Fixes:
on_episode_created callback to SingleAgentEnvRunner. (#49487)train_batch_size_per_learner problems. (#49715)🏗 Architecture refactoring:
Default[algo]RLModule classes (#49366, #49368)ormsgpack (#49489)🗑️ Deprecations:
💫 Enhancements:
task_name, task_function_name and actor_name in Structured Logging (#48703)nsight.nvtx profiling (#49392)🔨 Fixes:
WORKER_OBJECT_EVICTION when the object is out of scope or manually freed (#47990).whl file (#48560)💫 Enhancements:
📖 Documentation:
DaemonSet and Grafana Loki to "Persist KubeRay Operator Logs" (#48725)Dashboard
💫 Enhancements:
RAY_PROMETHEUS_HEADERS env for carrying additional headers to Prometheus (#49353)RAY_PROMETHEUS_HEADERS env for carrying additional headers to Prometheus (#49700)🏗 Architecture refactoring:
memray dependency from default to observability (#47763)StateHead's methods into free functions. (#49388)@raulchen, @alanwguo, @omatthew98, @xingyu-long, @tlinkin, @yantzu, @alexeykudinkin, @andrewsykim, @win5923, @csy1204, @dayshah, @richardliaw, @stephanie-wang, @gueraf, @rueian, @davidxia, @fscnick, @wingkitlee0, @KPostOffice, @GeneDer, @MengjinYan, @simonsays1980, @pcmoritz, @petern48, @kashiwachen, @pfldy2850, @zcin, @scottjlee, @Akhil-CM, @Jay-ju, @JoshKarpel, @edoakes, @ruisearch42, @gorloffslava, @jimmyxie-figma, @bthananjeyan, @sven1977, @bnorick, @jeffreyjeffreywang, @ravi-dalal, @matthewdeng, @angelinalg, @ivanthewebber, @rkooo567, @srinathk10, @maresb, @gvspraveen, @akyang-anyscale, @mimiliaogo, @bveeramani, @ryanaoleary, @kevin85421, @richardsliu, @hartikainen, @coltwood93, @mattip, @Superskyyy, @justinvyu, @hongpeng-guo, @ArturNiederfahrenhorst, @jecsand838, @Bye-legumes, @hcc429, @WeichenXu123, @martinbomio, @HollowMan6, @MortalHappiness, @dentiny, @zhe-thoughts, @anyadontfly, @smanolloff, @richo-anyscale, @khluu, @xushiyan, @rynewang, @japneet-anyscale, @jjyao, @sumanthratna, @saihaj, @aslonnie
Many thanks to all those who contributed to this release!
Deprecated read_parquet_bulk https://github.com/ray-project/ray/pull/48691
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🗑️ Deprecations:
🔨 Fixes:
📖 Documentation:
🔨 Fixes:
clear_checkpoint function during Trial restoration error handling. (#48532)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
rllib_contrib from repo. (#48565)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🔨 Fixes:
💫 Enhancements:
🔨 Fixes:
Thanks to all those who contributed to this release! @rynewang, @rickyyx, @bveeramani, @marwan116, @simonsays1980, @dayshah, @dentiny, @KepingYan, @mimiliaogo, @kevin85421, @SeaOfOcean, @stephanie-wang, @mohitjain2504, @azayz, @xushiyan, @richardliaw, @can-anyscale, @xingyu-long, @kanwang, @aslonnie, @MortalHappiness, @jjyao, @SumanthRH, @matthewdeng, @alexeykudinkin, @sven1977, @raulchen, @andrewsykim, @zcin, @nadongjun, @hongpeng-guo, @miguelteixeiraa, @saihaj, @khluu, @ArturNiederfahrenhorst, @ryanaoleary, @ltbringer, @pcmoritz, @JoshKarpel, @akyang-anyscale, @frances720, @BeingGod, @edoakes, @Bye-legumes, @Superskyyy, @liuxsh9, @MengjinYan, @ruisearch42, @scottjlee, @angelinalg
Removed long-deprecated set_progress_bars
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🗑 Deprecations:
🔨 Fixes:
pyarrow.fs.S3FileSystem (#48216)🔨 Fixes:
pyarrow.fs.S3FileSystem (#48216)💫 Enhancements:
🔨 Fixes:
📖 Documentation:
💫 Enhancements:
📖 Documentation:
EnvRunners (using MetricsLogger API on the new stack). (#47969)🏗 Architecture refactoring:
recreate_failed_env_runners=False to True). (#48286)🔨 Fixes:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🔨 Fixes:
Many thanks to all those who contributed to this release!
@akyang-anyscale, @rkooo567, @bveeramani, @dayshah, @martinbomio, @khluu, @justinvyu, @slfan1989, @alexeykudinkin, @simonsays1980, @vigneshka, @ruisearch42, @rynewang, @scottjlee, @jjyao, @JoshKarpel, @win5923, @MengjinYan, @MortalHappiness, @ujjawal-khare-27, @zcin, @ccoulombe, @Bye-legumes, @dentiny, @stephanie-wang, @LeoLiao123, @dengwxn, @richo-anyscale, @pcmoritz, @sven1977, @omatthew98, @GeneDer, @srinathk10, @can-anyscale, @edoakes, @kevin85421, @aslonnie, @jeffreyjeffreywang, @ArturNiederfahrenhorst
Remove deprecated mosaic and sklearn trainer code
🎉 New Features:
Dataset.rename_columns (#47906)💫 Enhancements:
partitioning parameter to read_parquet (#47553)SERVICE_UNAVAILABLE to list of retried transient errors (#47673)OpRuntimeMetrics to support properties (#47800)plan_write_op and Datasinks (#47942)PhysicalOperator to its LogicalOperator (#47986)num_cpus and num_gpus for map APIs (#47995)Rules (#48039)🔨 Fixes:
map_batches (#47696)num_gpus provide to Ray Data is appropriately passed to ray.remote call (#47768)write_xxx APIs (#48096)📖 Documentation:
🏗 Architecture refactoring:
🔨 Fixes:
🔨 Fixes:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
ObjectRef (#47544)🔨 Fixes:
ray_tasks{State="PENDING_ARGS_FETCH"} metric counting (#47770)sync_reactors_.find(reactor->GetRemoteNodeID()) == sync_reactors_.end() (#47861)RAY_CHECK(it != current_tasks_.end()); (#47659)📖 Documentation:
💫 Enhancements:
🔨 Fixes:
Many thanks to all those who contributed to this release! @GeneDer, @rkooo567, @dayshah, @saihaj, @nikitavemuri, @bill-oconnor-anyscale, @WeichenXu123, @can-anyscale, @jjyao, @edoakes, @kekulai-fredchang, @bveeramani, @alexeykudinkin, @raulchen, @khluu, @sven1977, @ruisearch42, @dentiny, @MengjinYan, @Mark2000, @simonsays1980, @rynewang, @PatricYan, @zcin, @sofianhnaide, @matthewdeng, @dlwh, @scottjlee, @MortalHappiness, @kevin85421, @win5923, @aslonnie, @prithvi081099, @richardsliu, @milesvant, @omatthew98, @Superskyyy, @pcmoritz
Simplify custom metadata provider API
💫 Enhancements:
🔨 Fixes:
plan_read_op (#47456)💫 Enhancements:
TrainRunInfo (#46875)💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
GeneralAdvantageEstimation connector in learner pipeline. (#47532)SelfSupervisedLossAPI for RLModules that bring their own loss and InferenceOnlyAPI. (#47581, #47572)💫 Enhancements:
🔨 Fixes:
📖 Documentation:
Many thanks to all those who contributed to this release! @ruisearch42, @andrewsykim, @timkpaine, @rkooo567, @WeichenXu123, @GeneDer, @sword865, @simonsays1980, @angelinalg, @sven1977, @jjyao, @woshiyyya, @aslonnie, @zcin, @omatthew98, @rueian, @khluu, @justinvyu, @bveeramani, @nikitavemuri, @chris-ray-zhang, @liuxsh9, @xingyu-long, @peytondmurray, @rynewang
Fix broken dashboard cluster page when there are dead nodes
🔨 Fixes:
Remove limit on number of tasks launched per scheduling step
💫 Enhancements:
🔨 Fixes:
arrow_parquet_args aren't used (#47161)read_json() (#47378)Datasource in read_datasource() (#47467)from_*_operator modules (#47457)AWS ACCESS_DENIED as retryable exception for multi-node Data+Train benchmarks (#47232)read_images_comparison_microbenchmark_single_node release test (#47228)📖 Documentation:
Dataset.deserialize_lineage (#47203)map_batches with default batch_size (#47433)💫 Enhancements:
🔨 Fixes:
📖 Documentation:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
📖 Documentation:
🏗 Architecture refactoring:
🔨 Fixes:
💫 Enhancements:
🔨 Fixes:
🔨 Fixes:
💫 Enhancements:
make local.Many thanks to all those who contributed to this release! @GeneDer, @Bye-legumes, @nikitavemuri, @kevin85421, @MortalHappiness, @LeoLiao123, @saihaj, @rmcsqrd, @bveeramani, @zcin, @matthewdeng, @raulchen, @mattip, @jjyao, @ruisearch42, @scottjlee, @can-anyscale, @khluu, @aslonnie, @rynewang, @edoakes, @zhanluxianshen, @venkatram-dev, @c21, @allenyin55, @alexeykudinkin, @snehakottapalli, @BitPhinix, @hongchaodeng, @dengwxn, @liuxsh9, @simonsays1980, @peytondmurray, @KepingYan, @bryant1410, @woshiyyya, @sven1977
Deprecate passing arguments that contain DeploymentResponses in nested objects to downstream deployment handle calls
Notice: Starting from this release, pip install ray[all] will not include ray[cpp], and will not install the respective ray-cpp package. To install everything that includes ray-cpp, one can use pip install ray[cpp-all] instead.
🎉 New Features:
💫 Enhancements:
size_bytes from metadata and consolidate metadata methods (#46862)_internal subpackage (#46825)🔨 Fixes:
DataContext.retried_io_errors from tuple to list (#46884)Object Store Memory metrics on Ray Data Dashboard (#47170)📖 Documentation:
Rule.plan (#47094)💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
🏗 Architecture refactoring:
DeploymentResponses in nested objects to downstream deployment handle calls (#46806)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
esbonio section🔨 Fixes:
Many thanks to all those who contributed to this release! @simonsays1980, @bveeramani, @tungh2, @zcin, @xingyu-long, @WeichenXu123, @aslonnie, @MaxVanDijck, @can-anyscale, @galenhwang, @omatthew98, @matthewdeng, @raulchen, @sven1977, @shrekris-anyscale, @deepyaman, @alexeykudinkin, @stephanie-wang, @kevin85421, @ruisearch42, @hongchaodeng, @khluu, @alanwguo, @hongpeng-guo, @saihaj, @Superskyyy, @tespent, @slfan1989, @justinvyu, @rynewang, @nikitavemuri, @amogkam, @mattip, @dev-goyal, @ryanaoleary, @peytondmurray, @edoakes, @venkatajagannath, @jjyao, @cristianjd, @scottjlee, @Bye-legumes
Move DQN into the TargetNetworkAPI (and deprecate RLModuleWithTargetNetworksInterface).
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🔨 Fixes:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
RLModuleWithTargetNetworksInterface). (#46752)🔨 Fixes:
📖 Documentation:
🏗 Architecture refactoring:
🏗 Architecture refactoring:
Many thanks to all those who contributed to this release! @KyleKoon, @ruisearch42, @rynewang, @sven1977, @saihaj, @aslonnie, @bveeramani, @akshay-anyscale, @kevin85421, @omatthew98, @anyscalesam, @MaxVanDijck, @justinvyu, @simonsays1980, @can-anyscale, @peytondmurray, @scottjlee
Deprecate Dataset.get_internal_block_refs()
💫 Enhancements:
🔨 Fixes:
🎉 New Features:
💫 Enhancements:
BlockRefs in-memory (#46369)ProgressBar totals (#46601)🔨 Fixes:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🔨 Fixes:
🎉 New Features:
target_num_ongoing_requests_per_replica and max_concurrent_queries, respectively replaced by max_ongoing_requests and target_ongoing_requests (#46392 and #46427)💫 Enhancements:
batch_mode=complete_episodes to synchronous_parallel_sample. (#46321)🏗 Architecture refactoring:
🔨 Fixes:
📖 Documentation:
🔨 Fixes:
Many thanks to all those who contributed to this release!
@alanwguo, @hongchaodeng, @anyscalesam, @brucebismarck, @bt2513, @woshiyyya, @terraflops1048576, @lorenzoritter, @omrishiv, @davidxia, @cchen777, @nono-Sang, @jackhumphries, @aslonnie, @JoshKarpel, @zjregee, @bveeramani, @khluu, @Superskyyy, @liuxsh9, @jjyao, @ruisearch42, @sven1977, @harborn, @saihaj, @zcin, @can-anyscale, @veekaybee, @chungen04, @WeichenXu123, @GeneDer, @sergey-serebryakov, @Bye-legumes, @scottjlee, @rynewang, @kevin85421, @cristianjd, @peytondmurray, @MortalHappiness, @MaxVanDijck, @simonsays1980, @mjovanovic9999
This is a new Ray Core specific feature called Ray accelerated DAGs (aDAGs).
This is a new Ray Core specific feature called Ray accelerated DAGs (aDAGs).
💫 Enhancements:
map_batches() (#46129)🔨 Fixes:
InputDataBuffer doesn't free block references (#46191)MapOperator.num_active_tasks should exclude pending actors (#46364)📖 Documentation:
read_api.py docstring (#45690)tfrecords_datasource (#46171)README and in ray.data.Dataset (#45345)📖 Documentation:
💫 Enhancements:
ServeController.get_app_config() (#45878)DeploymentDetails.deployment_route_prefix_not_set() (#46305)🎉 New Features:
EnvRunners). (#46216)💫 Enhancements:
EnvRunners (and callbacks). (#46294)env- and agent_steps to custom evaluation function. (#45652)🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
psutil process attr num_fds is not available on Windows (#46329)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🔨 Fixes:
📖 Documentation:
Many thanks to all those who contributed to this release!
@stephanie-wang, @MortalHappiness, @aslonnie, @ryanaoleary, @jjyao, @jackhumphries, @nikitavemuri, @woshiyyya, @JoshKarpel, @ruisearch42, @sven1977, @alanwguo, @GeneDer, @saihaj, @raulchen, @liuxsh9, @khluu, @cristianjd, @scottjlee, @bveeramani, @zcin, @simonsays1980, @SumanthRH, @davidxia, @can-anyscale, @peytondmurray, @kevin85421
Nothing published for this version
Fixed bug where preserve_order doesn’t work with file reads
🔨 Fixes:
preserve_order doesn’t work with file reads (#46135)📖 Documentation:
dataset.Schema (#46170)💫 Enhancements:
💫 Enhancements:
📖 Documentation:
WARNING: the following default values will change in Ray 2.32:
max_ongoing_requests will change from 100 to 5.target_ongoing_requests will change from 1 to 2.💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
Many thanks to all those who contributed to this release!
@jjyao, @kevin85421, @vincent-pli, @khluu, @simonsays1980, @sven1977, @rynewang, @can-anyscale, @richardsliu, @jackhumphries, @alexeykudinkin, @bveeramani, @ruisearch42, @shrekris-anyscale, @stephanie-wang, @matthewdeng, @zcin, @hongchaodeng, @ryanaoleary, @liuxsh9, @GeneDer, @aslonnie, @peytondmurray, @Bye-legumes, @woshiyyya, @scottjlee, @JoshKarpel
Improve fractional CPU/GPU formatting
💫 Enhancements:
💫 Enhancements:
💫 Enhancements:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
Many thanks to all those who contributed to this release: @liuxsh9, @peytondmurray, @pcmoritz, @GeneDer, @saihaj, @khluu, @aslonnie, @yucai, @vickytsang, @can-anyscale, @bthananjeyan, @raulchen, @hongchaodeng, @x13n, @simonsays1980, @peterghaddad, @kevin85421, @rynewang, @angelinalg, @jjyao, @BenWilson2, @jackhumphries, @zcin, @chris-ray-zhang, @c21, @shrekris-anyscale, @alanwguo, @stephanie-wang, @Bye-legumes, @sven1977, @WeichenXu123, @bveeramani, @nikitavemuri
Improve excessive syncing warning and deprecate TUNE_RESULT_DIR, RAY_AIR_LOCAL_CACHE_DIR, local_dir
🎉 New Features:
💫 Enhancements:
📖 Documentation:
🏗 Architecture refactoring:
💫 Enhancements:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
--object-store-memory to describe how the default value is set (#45301)🔨 Fixes:
Many thanks to all those who contributed to this release: @maxliuofficial, @simonsays1980, @GeneDer, @dudeperf3ct, @khluu, @justinvyu, @andrewsykim, @Catch-Bull, @zcin, @bveeramani, @rynewang, @angelinalg, @matthewdeng, @jjyao, @kira-lin, @harborn, @hongchaodeng, @peytondmurray, @aslonnie, @timkpaine, @982945902, @maxpumperla, @stephanie-wang, @ruisearch42, @alanwguo, @can-anyscale, @c21, @Atry, @KamenShah, @sven1977, @raulchen
Fix result dict “spam” (duplicate, deprecated keys, e.g. “sampler_results” dumped into top level).
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🔨 Fixes:
🔨 Fixes:
💫 Enhancements:
tuned_examples learning test for new API stack are now “self-executable” (don’t require a third-party script anymore to run them). + WandB support. (#45023)🔨 Fixes:
📖 Documentation:
💫 Enhancements:
ray.util.collective support torch.bfloat16 (#39845)🔨 Fixes:
Many thanks to all those who contributed to this release: @hongchaodeng, @khluu, @antoni-jamiolkowski, @ameroyer, @bveeramani, @can-anyscale, @WeichenXu123, @peytondmurray, @jackhumphries, @kevin85421, @jjyao, @robcaulk, @rynewang, @scottsun94, @swang, @GeneDer, @zcin, @ruisearch42, @aslonnie, @angelinalg, @raulchen, @ArthurBook, @sven1977, @wuxibin89
Add function to dynamically generate ray_remote_args for Map APIs
🎉 New Features:
ray_remote_args for Map APIs (#45143)💫 Enhancements:
SplitCoordinator (#45226)🔨 Fixes:
AllToAllOperator progress bar if the disable flag is set (#45136)PyExtensionType by default (#45084)num_gpus=0 (#45202)💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
Many thanks to all those who contributed to this release: @justinvyu, @simonsays1980, @chris-ray-zhang, @kevin85421, @angelinalg, @rynewang, @brycehuang30, @alanwguo, @jjyao, @shaikhismail, @khluu, @can-anyscale, @bveeramani, @jrosti, @WeichenXu123, @MortalHappiness, @raulchen, @scottjlee, @ruisearch42, @aslonnie, @alexeykudinkin
Remove deprecated ray.air.callbacks modules
🎉 New features:
read_lance API to read Lance Dataset (#45106)🔨 Fixes:
📖 Documentation:
📖 Documentation:
📖 Documentation:
🏗 Architecture refactoring:
ray.air.callbacks modules (#45104)💫 Enhancements:
🔨 Fixes:
🎉 New Features:
💫 Enhancements:
EnvRunnerGroup.foreach_worker… methods to new defaults: mark_healthy=True (used to be False) and healthy_only=True (used to be False). (#44993)get_state()/from_state() methods in SingleAgent- and MultiAgentEpisodes. (#45012)🔨 Fixes:
📖 Documentation:
🔨 Fixes:
ray.init(logging_format) argument is ignored (#45037)🔨 Fixes:
Many thanks to all those who contributed to this release: @rynewang, @can-anyscale, @scottsun94, @bveeramani, @ceddy4395, @GeneDer, @zcin, @JoshKarpel, @nikitavemuri, @stephanie-wang, @jackhumphries, @matthewdeng, @yash97, @simonsays1980, @peytondmurray, @evalaiyc98, @c21, @alanwguo, @shrekris-anyscale, @kevin85421, @hongchaodeng, @sven1977, @st--, @khluu
Deprecate prefetch_batches arg of iter_rows and change default value
💫 Enhancements:
ParquetDatasource metadata prefetching (#44750)map_groups implementation to better handle large outputs (#44862)prefetch_batches arg of iter_rows and change default value (#44982)name a required argument for AggregateFn (#44880)📖 Documentation:
💫 Enhancements:
CommunicatorContext automatically (#44883)TrainStateActor (#44585)📖 Documentation:
accelerator_type (#44882)💫 Enhancements:
📖 Documentation:
💫 Enhancements:
🔨 Fixes:
🎉 New Features:
MetricsLogger, a unified API for users of RLlib to log custom metrics and stats in all of RLlib’s components (Algorithm, EnvRunners, and Learners). Rolled out for new API stack for Algorithm (training_step) and EnvRunners (custom callbacks). Learner (custom loss functions) support in progress. #44888, #44442💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
🔨 Fixes:
Thanks @can-anyscale, @hongchaodeng, @zcin, @marwan116, @khluu, @bewestphal, @scottjlee, @andrewsykim, @anyscalesam, @MortalHappiness, @justinvyu, @JoshKarpel, @woshiyyya, @rynewang, @Abirdcfly, @omatthew98, @sven1977, @marcelocarmona, @rueian, @mattip, @angelinalg, @aslonnie, @matthewdeng, @abizjakpro, @simonsays1980, @jjyao, @terraflops1048576, @hongpeng-guo, @stephanie-wang, @bw-matthew, @bveeramani, @ruisearch42, @kevin85421, @Tongruizhe
Many thanks to all those who contributed to this release!
Clarify deprecated Datasource docstrings
🎉 New Features:
💫 Enhancements:
local_read option to from_torch (#44752)🔨 Fixes:
📖 Documentation:
🔨 Fixes:
RayFSDPStrategy for lightning>2.1 (#44569)💫 Enhancements:
🔨 Fixes:
🎉 New Features:
💫 Enhancements:
model_config_dict in new API stack. (#44263)RLModule in single-agent fashion, then bring checkpoint into multi-agent setup and continue training. (#44674)examples scripts got translated from the old- to the new API stack: Curriculum learning, custom-gym-env, etc..: (#44706, #44707, #44735, #44841)🔨 Fixes:
is_running_tasks is not returning the correct value when driver starts ray (#44459)Many thanks to all those who contributed to this release! @can-anyscale, @hongpeng-guo, @sven1977, @zcin, @shrekris-anyscale, @liuxsh9, @jackhumphries, @GeneDer, @woshiyyya, @simonsays1980, @omatthew98, @andrewsykim, @n30111, @architkulkarni, @bveeramani, @aslonnie, @alexeykudinkin, @WeichenXu123, @rynewang, @matthewdeng, @angelinalg, @c21
Log a deprecation warning for local_dir and related environment variables
ray.data.read_avro🎉 New Features:
ray.data.read_avro (#43663)💫 Enhancements:
ipywidgets==7.7.2 to enable Data progress bars in VSCode Web (#44398)🔨 Fixes:
numpy.ndarray (#44236)📖 Documentation:
TFPRedictor in batch inference example (#44434)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
BatchPredictor (#43934)💫 Enhancements:
🏗 Architecture refactoring:
🔨 Fixes:
_to_object_ref memory leak (#43763)max_ongoing_requests if max_batch_size is less than max_ongoing_requests (#43840)ModuleNotFoundError in Ray 3.10 (#44329)
sys.path behavior. Revert "[core] If there's working_dir, don't set _py_driver_sys_path." (#44435)batch_queue_cls parameter is removed from the @serve.batch decorator (#43935)🎉 New Features:
PrioritizedEpisodeReplayBuffer is available for off-policy learning using the EnvRunner API (SingleAgentEnvRunner) and supports random n-step sampling (#42832, #43258, #43458, #43496, #44262)💫 Enhancements:
examples/ folder; started moving example scripts to the new API stack (#44559, #44067, #44603)enable_async_evaluation option (in favor of existing evaluation_parallel_to_training setting). (#43787)module_for API to MultiAgentEpisode (analogous to policy_for API of the old Episode classes). (#44241)rllib_contrib old stack algorithms have been removed from rllib/algorithms (#43656)🔨 Fixes:
📖 Documentation:
🎉 New Features:
💫 Enhancements:
RayActorError to distinguish between actor died (ActorDiedError) and actor temporarily unavailable (ActorUnavailableError) cases.🔨 Fixes:
ModuleNotFound issued introduced in 2.10 (#44435)💫 Enhancements:
🔨 Fixes:
💫 Enhancements:
Many thanks to all those who contributed to this release!
@aslonnie, @brycehuang30, @MortalHappiness, @astron8t-voyagerx, @edoakes, @sven1977, @anyscalesam, @scottjlee, @hongchaodeng, @slfan1989, @hebiao064, @fishbone, @zcin, @GeneDer, @shrekris-anyscale, @kira-lin, @chappidim, @raulchen, @c21, @WeichenXu123, @marian-code, @bveeramani, @can-anyscale, @mjd3, @justinvyu, @jackhumphries, @Bye-legumes, @ashione, @alanwguo, @Dreamsorcerer, @KamenShah, @jjyao, @omatthew98, @autolisis, @Superskyyy, @stephanie-wang, @simonsays1980, @davidxia, @angelinalg, @architkulkarni, @chris-ray-zhang, @kevin85421, @rynewang, @peytondmurray, @zhangyilun, @khluu, @matthewdeng, @ruisearch42, @pcmoritz, @mattip, @jerome-habana, @alexeykudinkin
Deprecate legacy components and classes (#43575, #43178, #43347, #43349, #43342, #43341, #42936, #43144, #43022, #43023)
Ray 2.10 release brings important stability improvements and enhancements to Ray Data, with Ray Data becoming generally available (GA).
num_replicas=”auto” (#42613).max_queued_requests (#42950).max_ongoing_requests (max_concurrent_queries) is also now strictly enforced (#42947).RAY_SERVE_ENABLE_QUEUE_LENGTH_CACHE=0.max_concurrent_queries -> max_ongoing_requeststarget_num_ongoing_requests_per_replica -> target_ongoing_requestsdownscale_smoothing_factor -> downscaling_factorupscale_smoothing_factor -> upscaling_factorScalingConfig(accelerator_type).XGBoostTrainer and LightGBMTrainer to no longer depend on xgboost_ray and lightgbm_ray. A new, more flexible API will be released in a future release.local_dir and RAY_AIR_LOCAL_CACHE_DIR.🎉 New Features:
num_rows_per_file parameter to file-based writes (#42694)DataIterator.materialize (#43210)DataIterator.to_tf if tf.TypeSpec is provided (#42917)Dataset.write_bigquery (#42584)💫 Enhancements:
ImageDatasource to use Image.BILINEAR as the default image resampling filter (#43484)ray.data.from_huggingface (#42599)Stage class and related usages (#42685)🔨 Fixes:
OutputSplitter (#43740)OpBufferQueue (#43015)Limit operators. (#42958)Dataset.streaming_split for job hanging (#42601)📖 Documentation:
🎉 New Features:
ScalingConfig(accelerator_type) for improved worker scheduling (#43090)💫 Enhancements:
train_func for setup/teardown logic (#43209)DEFAULT_NCCL_SOCKET_IFNAME to simplify network configuration (#42808)🔨 Fixes:
memory resource requirements (#42999)Path.as_posix over os.path.join (#42037)RayFSDPStrategy (#43594)RayTrainReportCallback (#42751)get_latest_checkpoint returns None (#42953)📖 Documentation:
train_loop_config (#43691)ray.train.report docstring that it is not a barrier (#42422)prepare_data_loader shuffle behavior and set_epoch (#41807)🏗 Architecture refactoring:
XGBoostTrainer and LightGBMTrainer as DataParallelTrainer. Removed dependency on xgboost_ray and lightgbm_ray. (#42111, #42767, #43244, #43424)local_dir and RAY_AIR_LOCAL_CACHE_DIR. Add isolation between driver and distributed worker artifacts so that large files written by workers are not uploaded implicitly. Results are now only written to storage_path, rather than having another copy in the user’s home directory (~/ray_results). (#43369, #43403, #43689)ray.train.torch.get_device into another get_devices API for multi-GPU worker setup (#42314)storage_path (#42853, #43179)SyncConfig (#42909)preprocessor argument from Trainers (#43146, #43234)MosaicTrainer and remove SklearnTrainer (#42814)💫 Enhancements:
TBXLogger for logging images (#37822)Experiment(config) to handle RLlib AlgorithmConfig (#42816, #42116)🔨 Fixes:
reuse_actors error on actor cleanup for function trainables (#42951)os.path.join (#42037)📖 Documentation:
🏗 Architecture refactoring:
local_dir and RAY_AIR_LOCAL_CACHE_DIR. Add isolation between driver and distributed worker artifacts so that large files written by workers are not uploaded implicitly. Results are now only written to storage_path, rather than having another copy in the user’s home directory (~/ray_results). (#43369, #43403, #43689)SyncConfig and chdir_to_trial_dir (#42909)storage_path (#42853, #43179)NevergradSearch (#42305)checkpoint_dir and reporter deprecation notices (#42698)🎉 New Features:
max_queued_requests (#42950).num_replicas=”auto” (#42613).🏗 API Changes:
max_concurrent_queries to max_ongoing_requeststarget_num_ongoing_requests_per_replica to target_ongoing_requestsdownscale_smoothing_factor to downscaling_factorupscale_smoothing_factor to upscaling_factormax_ongoing_requests will change from 100 to 5.target_ongoing_requests will change from 1 to 2.💫 Enhancements:
RAY_SERVE_LOG_ENCODING env to set the global logging behavior for Serve (#42781).max_ongoing_requests (max_concurrent_queries) is also now strictly enforced (#42947).RAY_SERVE_ENABLE_QUEUE_LENGTH_CACHE=0.max_ongoing_requests=1 for autoscaling deployments and still upscale properly, because requests queued at handles are properly taken into account for autoscaling.RAY_SERVE_COLLECT_AUTOSCALING_METRICS_ON_HANDLE=0RAY_SERVE_EAGERLY_START_REPLACEMENT_REPLICAS=0🔨 Fixes:
KeyError on disconnects (#43713).📖 Documentation:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
policy_to_train logic (#41529), fix multi-APU for PPO on the new API stack. (#44001), Issue 40347: (#42090)📖 Documentation:
🎉 New Features:
💫 Enhancements:
get_task() now accepts ObjectRef (#43507)🔨 Fixes:
📖 Documentation:
💫 Enhancements:
heap_memory param for setup_ray_cluster API, and change default value of per ray worker node config, and change default value of ray head node config for global Ray cluster (#42604)🔨 Fixes:
Many thanks to all those who contributed to this release!
@ronyw7, @xsqian, @justinvyu, @matthewdeng, @sven1977, @thomasdesr, @veryhannibal, @klebster2, @can-anyscale, @simran-2797, @stephanie-wang, @simonsays1980, @kouroshHakha, @Zandew, @akshay-anyscale, @matschaffer-roblox, @WeichenXu123, @matthew29tang, @vitsai, @Hank0626, @anmyachev, @kira-lin, @ericl, @zcin, @sihanwang41, @peytondmurray, @raulchen, @aslonnie, @ruisearch42, @vszal, @pcmoritz, @rickyyx, @chrislevn, @brycehuang30, @alexeykudinkin, @vonsago, @shrekris-anyscale, @andrewsykim, @c21, @mattip, @hongchaodeng, @dabauxi, @fishbone, @scottjlee, @justina777, @surenyufuz, @robertnishihara, @nikitavemuri, @Yard1, @huchen2021, @shomilj, @architkulkarni, @liuxsh9, @Jocn2020, @liuyang-my, @rkooo567, @alanwguo, @KPostOffice, @woshiyyya, @n30111, @edoakes, @y-abe, @martinbomio, @jiwq, @arunppsg, @ArturNiederfahrenhorst, @kevin85421, @khluu, @JingChen23, @masariello, @angelinalg, @jjyao, @omatthew98, @jonathan-anyscale, @sjoshi6, @gaborgsomogyi, @rynewang, @ratnopamc, @chris-ray-zhang, @ijrsvt, @scottsun94, @raychen911, @franklsf95, @GeneDer, @madhuri-rai07, @scv119, @bveeramani, @anyscalesam, @zen-xu, @npuichigo
Fix protobuf breaking change by adding a compat layer.
This patch release contains fixes for Ray Core, Ray Data, and Ray Serve.
🔨 Fixes:
🔨 Fixes:
schema call in to_tf if tf.TypeSpec is provided (#42917)🔨 Fixes:
Many thanks to all those who contributed to this release!
@rynewang, @GeneDer, @alexeykudinkin, @edoakes, @c21, @rkooo567
This patch release contains fixes for Ray Core, Ray Data, and Ray Serve.
This patch release contains fixes for Ray Core, Ray Data, and Ray Serve.
🔨 Fixes:
🔨 Fixes:
ParquetDatasource._estimate_files_encoding_ratio() (https://github.com/ray-project/ray/pull/42759) (https://github.com/ray-project/ray/pull/42774)🔨 Fixes:
Many thanks to all those who contributed to this release!
@c21, @raulchen, @can-anyscale, @edoakes, @peytondmurray, @scottjlee, @aslonnie, @architkulkarni, @GeneDer, @Zandew, @sihanwang41
This patch release contains fixes for Ray Core, Ray Data, and Ray Serve.
This patch release contains fixes for Ray Core, Ray Data, and Ray Serve.
🔨 Fixes:
🔨 Fixes:
🔨 Fixes:
Upgrade grpc from 1.50.2 to 1.57.1 to include security fixes
🎉 New Features:
concurrency argument to replace ComputeStrategy in map-like APIs (#41461)map_groups (#40778)💫 Enhancements:
OpState.outqueue_num_blocks (#41748)StreamingOutputsBackpressurePolicy (#41637)ConcurrencyCapBackpressurePolicy._cap_multiplier to be set to 1.0 (#41222)StatsManager to manage _StatsActor remote calls (#40913)max_retry_cnt parameter for BigQuery Write (#41163)🔨 Fixes:
Dataset.context not being sealed after creation (#41569)DataContext is not propagated when using streaming_split (#41473)BigQueryDatasource fault tolerance bugs (#40986)📖 Documentation:
ray.data.read_databricks_tables doc (#41366)read_json docs example for setting PyArrow block size when reading large files (#40533)AllToAllAPI to dataset methods (#40842)🎉 New Features:
Result from cloud storage (#40622)💫 Enhancements:
Result.from_path (#40684)ReportCheckpointCallback to delete temporary directory (#41033)🔨 Fixes:
RayTrainReportCallback to ensure synchronous reporting. (#40875)Results properly from moved storage path (#40647)📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
Result from cloud storage (#40622)💫 Enhancements:
🔨 Fixes:
Results properly from moved storage path (#40647)📖 Documentation:
MLflowLoggerCallback and setup_mlflow (#37854)🏗 Architecture refactoring:
TuneClient/TuneServer APIs (#41469)Searchers (#41414)air.remote_storage, etc.) (#40207)🎉 New Features:
💫 Enhancements:
__del__ in the deployment to execute custom clean up steps.🔨 Fixes:
🎉 New Features:
MultiAgentEpisode class introduced. Basis for upcoming multi-agent EnvRunner, which will replace RolloutWorker APIs. (#40263, #40799)SingleAgentEnvRunner (w/o Policy/RolloutWorker APIs). CI learning tests added. (#39732, #41074, #41075)on_workers_recreated callback to Algorithm, which is triggered after workers have failed and been restarted. (#40354)💫 Enhancements:
rllib_contrib cleanups: #40939, #40744, #40789, #40444, #37271🔨 Fixes:
AlgorithmConfig.rl_module_spec was NOT a “@property” yet) breaks when trying to load from this checkpoint. (#41157)📖 Documentation:
🎉 New Features:
ObjectRefGenerator -> “DynamicObjectRefGenerator”💫 Enhancements:
__ray_call__ default actor method (#41534)🔨 Fixes:
💫 Enhancements:
🔨 Fixes:
run_init for TPU command runner📖Documentation:
💫 Enhancements:
🎉 New Features:
Many thanks to all those who contributed to this release!
@justinvyu, @zcin, @avnishn, @jonathan-anyscale, @shrekris-anyscale, @LeonLuttenberger, @c21, @JingChen23, @liuyang-my, @ahmed-mahran, @huchen2021, @raulchen, @scottjlee, @jiwq, @z4y1b2, @jjyao, @JoshTanke, @marxav, @ArturNiederfahrenhorst, @SongGuyang, @jerome-habana, @rickyyx, @rynewang, @batuhanfaik, @can-anyscale, @allenwang28, @wingkitlee0, @angelinalg, @peytondmurray, @rueian, @KamenShah, @stephanie-wang, @bryanjuho, @sihanwang41, @ericl, @sofianhnaide, @RaffaGonzo, @xychu, @simonsays1980, @pcmoritz, @aslonnie, @WeichenXu123, @architkulkarni, @matthew29tang, @larrylian, @iycheng, @hongchaodeng, @rudeigerc, @rkooo567, @robertnishihara, @alanwguo, @emmyscode, @kevin85421, @alexeykudinkin, @michaelhly, @ijrsvt, @ArkAung, @mattip, @harborn, @sven1977, @liuxsh9, @woshiyyya, @hahahannes, @GeneDer, @vitsai, @Zandew, @evalaiyc98, @edoakes, @matthewdeng, @bveeramani
Additional context can be found here: https://www.anyscale.com/blog/update-on-ray-cves-cve-2023-6019-cve-2023-6020-cve-2023-6021-cve-2023-48022-cve-20…
The Ray 2.8.1 patch release contains fixes for the Ray Dashboard.
Additional context can be found here: https://www.anyscale.com/blog/update-on-ray-cves-cve-2023-6019-cve-2023-6020-cve-2023-6021-cve-2023-48022-cve-2023-48023
🔨 Fixes:
[core][state][log] Cherry pick changes to prevent state API from reading files outside the Ray log directory (#41520) [Dashboard] Migrate Logs page to use state api. (#41474) (#41522)
In Ray Serve, we are deprecating the previously experimental DAG API for deployment graphs. Model composition will be supported through deployment han…
This release features stability improvements and API clean-ups across the Ray libraries.
rllib_contrib (still available within RLlib for Ray 2.8).🎉 New Features:
Dataset.map and Dataset.flat_map (#40010)💫Enhancements:
DatasetPipeline (#40129)BulkExecutor code path (#40200)Dataset parameters and methods (#40385)_StatsActor (#40118)Dataset.unique() (#40016)sample_boundaries in SortTaskSpec (#39581)🔨 Fixes:
_StatsActor errors with PandasBlock (#40481)do_write (#40422)get_object_locations for metrics (#39884).pieces with updated .fragments (#39523)Preprocessor that have been fit in older versions (#39173)convert_udf_returns_to_numpy (#39188)RefBundles (#39016)📖Documentation:
🎉 New Features:
💫Enhancements:
pytorch_lightning and lightning (#39841, #40266)DataContext to RayTrainWorkers (#40116)🔨 Fixes:
📖Documentation:
🏗 Architecture refactoring:
LightningTrainer, AccelerateTrainer, `TransformersTrainer (#40163)DatasetConfig (#39963)DatasetPipeline (#40159)💫Enhancements:
Tuner.restore() is called on an instance (#39676)
🏗 Architecture refactoring:💫Enhancements:
8265.52365) is deprecated. The support will be removed in a future version.InputNode and DAGDriverDeployment.deploy(), Deployment.delete(), Deployment.get_handle()serve.get_deployment and serve.list_deployments🔨 Fixes:
dedicated_cpu and detached options in serve.start() have been fully disallowed.grpc_options on serve.start() was only allowing a gRPCOptions object in Ray 2.7.0. Dictionaries are now allowed to be used asgrpc_options in the serve.start() call.💫Enhancements:
rllib_contrib algorithms (A2C, A3C, AlphaStar #36584, AlphaZero #36736, ApexDDPG #36596, ApexDQN #36591, ARS #36607, Bandits #36612, CRR #36616, DDPG, DDPPO #36620, Dreamer(V1), DT #36623, ES #36625, LeelaChessZero #36627, MA-DDPG #36628, MAML, MB-MPO #36662, PG #36666, QMix #36682, R2D2, SimpleQ #36688, SlateQ #36710, and TD3 #36726) all produce warnings now if used. See here for more information on the rllib_contrib efforts. (36620, 36628, 3🔨 Fixes:
🎉 New Features:
ray start --runtime-env-agent-port is officially supported. (#39919)🔨 Fixes:
📖Documentation:
💫Enhancements:
📖Documentation:
🔨 Fixes:
🎉 New Features:
Many thanks to all who contributed to this release!
@scottjlee, @chappidim, @alexeykudinkin, @ArturNiederfahrenhorst, @stephanie-wang, @chaowanggg, @peytondmurray, @maxpumperla, @arvind-chandra, @iycheng, @JalinWang, @matthewdeng, @wfangchi, @z4y1b2, @alanwguo, @Zandew, @kouroshHakha, @justinvyu, @yuanchen8911, @vitsai, @hongchaodeng, @allenwang28, @caozy623, @ijrsvt, @omus, @larrylian, @can-anyscale, @joncarter1, @ericl, @lejara, @jjyao, @Ox0400, @architkulkarni, @edoakes, @raulchen, @bveeramani, @sihanwang41, @WeichenXu123, @zcin, @Codle, @dimakis, @simonsays1980, @cadedaniel, @angelinalg, @luv003, @JingChen23, @xwjiang2010, @rynewang, @Yicheng-Lu-llll, @scrivy, @michaelhly, @shrekris-anyscale, @xxnwj, @avnishn, @woshiyyya, @aslonnie, @amogkam, @krfricke, @pcmoritz, @liuyang-my, @jonathan-anyscale, @rickyyx, @scottsun94, @richardliaw, @rkooo567, @stefanbschneider, @kevin85421, @c21, @sven1977, @GeneDer, @matthew29tang, @RocketRider, @LaynePeng, @samhallam-reverb, @scv119, @huchen2021
Nothing published for this version
Added an application tag to the ray_serve_num_http_error_requests metric
application tag to the ray_serve_num_http_error_requests metricError QPS per Application panel in the Ray DashboardTrial.node_ip property (#40028)ray start would occasionally fail with ValueError: acceleratorType should match v(generation)-(cores/chips).🔨 Fixes:
Error QPS per Application panel in the Ray Dashboard🔨 Fixes:
🔨 Fixes:
Thanks
Many thanks to all those who contributed to this release!
@chaowanggg, @allenwang28, @shrekris-anyscale, @GeneDer, @justinvyu, @can-anyscale, @edoakes, @architkulkarni, @rkooo567, @rynewang, @rickyyx, @sven1977
[Breaking change] ray job submit now exits with 1 if the job fails instead of 0. To get the old behavior back, you may use ray job submit ... || true…
Ray 2.7 release brings important stability improvements and enhancements to Ray libraries, with Ray Train and Ray Serve becoming generally available. Ray 2.7 is accompanied with a GA release of KubeRay.
DeploymentHandle API to unify various existing Handle APIs, a high performant gRPC proxy to serve gRPC requests through Ray Serve, along with various stability and usability improvements.Take a look at our refreshed documentation and the Ray 2.7 migration guide and let us know your feedback!
🏗 Architecture refactoring:
🎉 New Features:
Read and Map operator (zero-copy fusion) (#38789)Dataset.write_images to write images (#38228)Dataset.write_sql() to write SQL databases (#38544)Dataset.map() and flat_map() (#38606)💫Enhancements:
FileBasedDataSource (#39493)ArrowBlock building time for blocks of size 1 (#38988)partition_filter parameter to read_parquet (#38479)Dataset.take() and related methods (#38677)reader.get_read_tasks until execution (#38373)iter_batches an Iterable (#37881)Dataset.to_pandas() (#37420)Dataset.to_dask() parameter to toggle consistent metadata check (#37163)Datasource.on_write_start (#38298)DatasetDict as input into from_huggingface() (#37555)🔨 Fixes:
Preprocessor that have been fit in older versions (#39488)RefBundles (#39085)local_uri to all non-Parquet data sources (#38719)ctx parameter to Datasource.write (#38688)map_batches over empty blocks (#38161)ActorPool map_batches (#38110)tif file extension to ImageDatasource (#38129)_block_udf from FileBasedDatasource reads (#38111)📖Documentation:
🤝 API Changes
train.Checkpoint class that unifies interaction with remote storage such as S3, GS, and HDFS. The changes follow the proposal in [REP35] Consolidated persistence API for Ray Train/Tune (#38452, #38481, #38581, #38626, #38864, #38844)preprocessor arg to Trainer (#38640)Result.log_dir (#38794)💫Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
📖Documentation:
🤝 API Changes
train.Checkpoint class that unifies interaction with remote storage such as S3, GS, and HDFS. The changes follow the proposal in [REP35] Consolidated persistence API for Ray Train/Tune (#38452, #38481, #38581, #38626, #38864, #38844)Result.log_dir (#38794)💫Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
🎉 New Features:
DeploymentHandle API that will replace the existing RayServeHandle and RayServeSyncHandle APIs in a future release. You are encouraged to migrate to the new API to avoid breakages in the future. To opt in, either use handle.options(use_new_handle_api=True) or set the global environment variable export RAY_SERVE_ENABLE_NEW_HANDLE_API=1. See https://docs.ray.io/en/latest/serve/model_composition.html for more details.get_app_handle that gets a handle used to send requests to an application. The API uses the new DeploymentHandle API.get_deployment_handle that gets a handle that can be used to send requests to any deployment in any application.serve.status which can be used to get the status of proxies and Serve applications (and their deployments and replicas). This is the pythonic equivalent of the CLI serve status.--reload option has been added to the serve run CLI.💫Enhancements:
serve.start and serve.run have a few small changes and deprecations in preparation for this, see https://docs.ray.io/en/latest/serve/api/index.html for details.ray_serve_num_ongoing_http_requests) to track the number of ongoing requests in each proxyRAY_SERVE_MULTIPLEXED_MODEL_ID_MATCHING_TIMEOUT_S flag to wait until the model matching.🔨 Fixes:
asyncio.Events not being removed in the long poll host: https://github.com/ray-project/ray/pull/38516.ray_serve_deployment_queued_queries wouldn’t decrement when clients disconnected: https://github.com/ray-project/ray/pull/37965.📖Documentation:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
num_returns="dynamic" generator. The API could be used by specifying num_returns="streaming". The API has been used for Ray data and Ray serve to support streaming use cases. See the test script to learn how to use the API. The documentation will be available in a few days.💫Enhancements:
pip install ray doesn't require the Python grpcio dependency anymore.ray job submit now exits with 1 if the job fails instead of 0. To get the old behavior back, you may use ray job submit ... || true . (#38390)get_assigned_resources in pg will return the name of the original resources instead of formatted name (#37421)${ENV_VAR} now can be replaced. Previous versions only supported limited number of env vars. (#36187)🔨 Fixes:
ray start --node-ip-address=..., the driver also had to specify ray.init(_node_ip_address). Now Ray finds the node ip address automatically. (#37644)ray.init: https://github.com/ray-project/ray/issues/26019💫Enhancements:
📖Documentation:
Thanks
Many thanks to all those who contributed to this release!
@simran-2797, @can-anyscale, @akshay-anyscale, @c21, @EdwardCuiPeacock, @rynewang, @volks73, @sven1977, @alexeykudinkin, @mattip, @Rohan138, @larrylian, @DavidYoonsik, @scv119, @alpozcan, @JalinWang, @peterghaddad, @rkooo567, @avnishn, @JoshKarpel, @tekumara, @zcin, @jiwq, @nikosavola, @seokjin1013, @shrekris-anyscale, @ericl, @yuxiaoba, @vymao, @architkulkarni, @rickyyx, @bveeramani, @SongGuyang, @jjyao, @sihanwang41, @kevin85421, @ArturNiederfahrenhorst, @justinvyu, @pleaseupgradegrpcio, @aslonnie, @kukushking, @94929, @jrosti, @MattiasDC, @edoakes, @PRESIDENT810, @cadedaniel, @ddelange, @alanwguo, @noahjax, @matthewdeng, @pcmoritz, @richardliaw, @vitsai, @Michaelvll, @tanmaychimurkar, @smiraldr, @wfangchi, @amogkam, @crypdick, @WeichenXu123, @darthhexx, @angelinalg, @chaowanggg, @GeneDer, @xwjiang2010, @peytondmurray, @z4y1b2, @scottsun94, @chappidim, @jovany-wang, @jaidisido, @krfricke, @woshiyyya, @Shubhamurkade, @ijrsvt, @scottjlee, @kouroshHakha, @allenwang28, @raulchen, @stephanie-wang, @iycheng
Nothing published for this version
The Ray 2.6.3 patch release contains fixes for Ray Serve, and Ray Core streaming generators.
The Ray 2.6.3 patch release contains fixes for Ray Serve, and Ray Core streaming generators.
🔨 Fixes:
🔨 Fixes:
serve run help message (#37859) (#38018)ray_serve_deployment_queued_queries when client disconnects (#37965) (#38020)📖 Documentation:
The Ray 2.6.2 patch release contains a critical fix for ray's logging setup, as well fixes for Ray Serve, Ray Data, and Ray Job.
The Ray 2.6.2 patch release contains a critical fix for ray's logging setup, as well fixes for Ray Serve, Ray Data, and Ray Job.
🔨 Fixes:
🔨 Fixes:
request_timeout_s from Serve config to the cluster (#37884) (#37903)🔨 Fixes:
[air][doc] Update docs to reflect head node syncing deprecation #37475
The Ray 2.6.1 patch release contains a critical fix for cluster launcher, and compatibility update for Ray Serve protobuf definition with python 3.11, as well doc improvements.
⚠️ Cluster launcher in Ray 2.6.0 fails to start multi-node clusters. Please update to 2.6.1 if you plan to use 2.6.0 cluster launcher.
🔨 Fixes:
🔨 Fixes:
📖Documentation:
The DatasetPipeline API is also being deprecated in favor of Dataset with streaming execution.
@serve.batch-decorated methods can stream responses.🎉 New Features:
💫 Enhancements:
🔨 Fixes:
pg.ready() task for pending trials that end up reusing an actor (#35748)Dict[str, np.array] batches in DummyTrainer read bytes calculation (#36484)📖 Documentation:
dreambooth example (#37102)🏗 Architecture refactoring:
🎉 New Features:
Dataset.unique() (#36655, #36802)DataIterator.iter_batches() (#36842) (#37260)DataIterator.iter_batches() (#36686)ray.data.range_arrow() (#35756)💫 Enhancements:
Dataset.write_datasource() (#36134)Dataset.schema() with new execution plan optimizer (#36740)Dataset.streaming_split() (#36908)🔨 Fixes:
Dataset.streaming_split() operatorDataset.streaming_split() (#36039)Dataset.materialize() and Dataset.streaming_split() (#36092)Dataset.streaming_split() (#36919)BlockMetadata (#37119)📖 Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
code-block to testcode. (#36483)🏗 Architecture refactoring:
BatchPredictor (#36947, #37178)🔨 Fixes:
PENDING trials (#35338)📖 Documentation:
🏗 Architecture refactoring:
tune/automl (#35557)ray.tune.integration (#35160)💫 Enhancements:
@serve.batch-decorated methods can stream responses.@serve.batch settings can be reconfigured dynamically.max_concurrent_queries and tail latencies under load.🔨 Fixes:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
📖 Documentation:
Many thanks to all those who contributed to this release!
@ericl, @ArturNiederfahrenhorst, @sihanwang41, @scv119, @aslonnie, @bluecoconut, @alanwguo, @krfricke, @frazierprime, @vitsai, @amogkam, @GeneDer, @jovany-wang, @gjoliver, @simran-2797, @rkooo567, @shrekris-anyscale, @kevin85421, @angelinalg, @maxpumperla, @kouroshHakha, @Yard1, @chaowanggg, @justinvyu, @fantow, @Catch-Bull, @cadedaniel, @ckw017, @hora-anyscale, @rickyyx, @scottsun94, @XiaodongLv, @SongGuyang, @RocketRider, @stephanie-wang, @inpefess, @peytondmurray, @sven1977, @matthewdeng, @ijrsvt, @MattiasDC, @richardliaw, @bveeramani, @rynewang, @woshiyyya, @can-anyscale, @omus, @eax-anyscale, @raulchen, @larrylian, @Deegue, @Rohan138, @jjyao, @iycheng, @akshay-anyscale, @edoakes, @zcin, @dmatrix, @bryant1410, @WanNJ, @architkulkarni, @scottjlee, @JungeAlexander, @avnishn, @harisankar95, @pcmoritz, @wuisawesome, @mattip
The Ray 2.5.1 patch release adds wheels for MacOS for Python 3.11. It also contains fixes for multiple components, along with fixes for our documentat
The Ray 2.5.1 patch release adds wheels for MacOS for Python 3.11. It also contains fixes for multiple components, along with fixes for our documentation.
🔨 Fixes:
🎉 New Features:
🔨 Fixes:
Replace deprecated usage of get_runtime_context().node_id
The Ray 2.5 release features focus on a number of enhancements and improvements across the Ray ecosystem, including:
💫Enhancements:
air_verbosity against None. (#33871)RunConfig.storage_path to replace SyncConfig.upload_dir and RunConfig.local_dir. (#33463)🔨 Fixes:
test_tune_torch_get_device_gpu race condition (#35004)📖Documentation:
convert_torch_code_to_ray_air (#35224)🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
torch.save() (#35615) (#35790)📖Documentation:
🏗 Architecture refactoring:
ray.train HuggingFace modules (#35270) (#35488)🎉 New Features:
💫Enhancements:
tune.ExperimentAnalysis to pull experiment checkpoint files from the cloud if needed (#34461)🔨 Fixes:
test_tune_torch_get_device_gpu race condition (#35004)tune/execution/checkpoint_manager state serialization. (#34368)--smoke-test. (#34167)📖Documentation:
🏗 Architecture refactoring:
tabulate package (#34789)🎉 New Features:
💫Enhancements:
LongPoll updates (#34675)ClassNode and FunctionNode with Application in top-level Serve APIs (#34627)🔨 Fixes:
app_msg to empty string by default (#35646)📖Documentation:
RayServeHandle and RayServeSyncHandle docstrings & typing (#34714)🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
💫Enhancements:
example-full.yaml (#34487)📖Documentation:
pip and conda requirements files (#34071)💫Enhancements:
--err flag to query stderr logs from worker/actors instead of --suffix=err (#34300)is_head_node to state API and GcsNodeInfo (#34299)Many thanks to all those who contributed to this release!
@vitsai, @XiaodongLv, @justinvyu, @Dan-Yeh, @dependabot[bot], @alanwguo, @grimreaper, @yiwei00000, @pomcho555, @ArturNiederfahrenhorst, @maxpumperla, @jjyao, @ijrsvt, @sven1977, @Yard1, @pcmoritz, @c21, @architkulkarni, @jbedorf, @amogkam, @ericl, @jiafuzha, @clarng, @shrekris-anyscale, @matthewdeng, @gjoliver, @jcoffi, @edoakes, @ethanabrooks, @iycheng, @Rohan138, @angelinalg, @Linniem, @aslonnie, @zcin, @wuisawesome, @Catch-Bull, @woshiyyya, @avnishn, @jjyyxx, @jianoaix, @bveeramani, @sihanwang41, @scottjlee, @YQ-Wang, @mattip, @can-anyscale, @xwjiang2010, @fedassembly, @joncarter1, @robin-anyscale, @rkooo567, @DACUS1995, @simran-2797, @ProjectsByJackHe, @zen-xu, @ashahab, @larrylian, @kouroshHakha, @raulchen, @sofianhnaide, @scv119, @nathan-az, @kevin85421, @rickyyx, @Sahar-E, @krfricke, @chaowanggg, @peytondmurray, @cadedaniel
Make Keras Callback raise DeprecationWarning
Over the last few months, we have seen a flurry of innovative activity around generative AI models and large language models (LLM). To continue our effort to ensure Ray provides a pivotal compute substrate for generative AI workloads and addresses the challenges (as explained in our blog series), we have invested engineering efforts in this release to ensure that these open source LLM models and workloads are accessible to the open source community and performant with Ray.
This release includes new examples for training, batch inference, and serving with your own LLM.
ray.data.DatasetContext.get_current().execution_options.preserve_order = True.💫Enhancements:
TorchDetectionPredictor (#32199)artifact_location, run_name to MLFlow integration (#33641)*path properties to Result and ResultGrid (#33410)Preprocessor.transform lazy by default (#32872)BatchPredictor lazy (#32510, #32796)TempFileLock util (#32862)collate_fn to iter_torch_batches (#32412)Callable[[torch.Tensor], torch.Tensor] to TorchVisionTransform (#32383)DatasetIterator torch tensors to correct device (#31753)🔨 Fixes:
use_gpu with HuggingFacePredictor (#32333)Callback raise DeprecationWarning (#33775)Checkpoint.from_checkpoint as developer API (#33094)DatasetIterator backwards compability (#32526)CountVectorizer failing with big data (#32351)from_uri. (#32386)dtype type hint in DLPredictor methods (#32198)set_preprocessor (#33088)📖Documentation:
BatchPredictor.from_checkpoint to docs (#32877)🏗 Architecture refactoring:
TensorflowCheckpoint.get_model model_definition parameter (#33776)🎉 New Features:
collate_fn to Dataset.iter_torch_batches() (#32412)ignore_missing_paths in reading Datasource (#33126)💫Enhancements:
tf_schema parameter in read_tfrecords() and write_tfrecords() (#32857)TorchVisionTransform (#32383)ArrowTensorArray and ArrowVariableShapedTensorArray (#32143)🔨 Fixes:
📖Documentation:
🎉 New Features:
AccelerateTrainer (#33269)Trainer.restore API for train experiment-level fault tolerance (#31920)💫Enhancements:
Trainer.restore on errors raised by trainer.fit() (#33610)CUDA_VISIBLE_DEVICES (#33159)train.torch.get_device() (#32893)torch.distributed env vars (#32450)🔨 Fixes:
DatasetIterator, handle device_map (#32955)test_torch_trainer (#32963)test_gpu by sorting the devices (#33002)📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
OrderedDict import. (#33709)experimental/output.py (#33767)💫Enhancements:
Tuner.restore (#32317)Tuner.can_restore(path) utility for checking if an experiment exists at a path/uri (#32003)Tuner.restore usage to prepare for trainable becoming a required arg (#32912)on_experiment_end hook for the final wait of SyncCallback sync processes (#33390)remote_checkpoint_dir upon actor reuse (#32420)use_threads=False in pyarrow syncing (#32256)WandbLoggerCallback actors to finish uploading to wandb on experiment end (#33174)🔨 Fixes:
ray.data.Dataset w/o lineage captured in trial config (#33565)trial.__getstate__ (#32624)📖Documentation:
tune.run API in logging messages when using the Tuner (#33642)log_to_file doc. (#32128)🏗 Architecture refactoring:
🎉 New Features:
💫Enhancements:
log_to_stderr option to logger and improve internal logging (#33597)🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
💫Enhancements:
🎉 New Features:
🔨 Fixes:
Many thanks to all those who contributed to this release!
@zjf2012, @christy, @fyrestone, @avnishn, @scottjlee, @sijieamoy, @jjyao, @sven1977, @jamesclark-Zapata, @cadedaniel, @jovany-wang, @pcmoritz, @MaskRay, @csivanich, @augray, @wuisawesome, @Wendi-anyscale, @maxpumperla, @shawnpanda, @DmitriGekhtman, @yuduber, @gjoliver, @ju2ez, @clarkzinzow, @brycehuang30, @iycheng, @justinvyu, @dmatrix, @edoakes, @tmbdev, @scottsun94, @jianoaix, @cool-RR, @prrajput1199, @amogkam, @ckw017, @alanwguo, @architkulkarni, @chaowanggg, @AmeerHajAli, @stephanie-wang, @bewestphal, @matthew29tang, @dbczumar, @sihanwang41, @ericl, @soumitrak, @matthewdeng, @Catch-Bull, @peytondmurray, @XiaodongLv, @bveeramani, @YQ-Wang, @Linniem, @ProjectsByJackHe, @woshiyyya, @c21, @shrekris-anyscale, @zcin, @Yard1, @can-anyscale, @kouroshHakha, @robertnishihara, @richardliaw, @krfricke, @shomilj, @ArturNiederfahrenhorst, @ijrsvt, @GokuMohandas, @jbedorf, @xwjiang2010, @anydayeol, @clarng, @davidxia, @rickyyx, @Siraj-Qazi, @kira-lin, @scv119, @chengscott, @angelinalg, @rkooo567, @rshin, @deanwampler, @gramhagen, @larrylian, @WeichenXu123, @simonsays1980
The Ray 2.3.1 patch release contains fixes for multiple components:
The Ray 2.3.1 patch release contains fixes for multiple components:
zip() (https://github.com/ray-project/ray/pull/32795)serve run to use Ray Client instead of Ray Jobs (https://github.com/ray-project/ray/pull/32976)max_concurrent_queries being ignored when autoscaling (https://github.com/ray-project/ray/pull/32772 and https://github.com/ray-project/ray/pull/33022)--block (https://github.com/ray-project/ray/pull/32961)Deprecate MlflowTrainableMixin in favor of setup_mlflow() function
💫Enhancements:
set_preprocessor method to Checkpoint (#31721)save_checkpoints to upload_checkpoints (#31582)WandbLoggerCallback example (#31625)DLPredictor.call_model tensor parameter to inputs (#30574)use_gpu to HuggingFacePredictor (#30945)Checkpoint improvements (#30948)TensorflowCheckpoint.get_model (#31203)🔨 Fixes:
📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫Enhancements:
ds.map_batches() (#30000)🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
NCCL_SOCKET_IFNAME to blacklist veth (#31824)RunConfig is used when there are multiple places to specify it (#31959)ScalingConfig to be optional for DataParallelTrainers if already in Tuner param_space (#30920)🔨 Fixes:
Preprocessor configs when using stream API. (#31725)fail_fast="raise" (#30817)SklearnTrainer (#30593)📖Documentation:
🏗 Architecture refactoring:
💫Enhancements:
validate_upload_dir to Syncer (#30869)🔨 Fixes:
AxSearch save and nan/inf result handling (#31147)AxSearch search space conversion for fixed list hyperparameters (#31088)Tuner.restore (#30893)sort_by_metric with nested metrics (#30906)fail_fast="raise" (#30817)📖Documentation:
🏗 Architecture refactoring:
overwrite_trainable argument in Tuner restore to trainable (#32059)🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
experimental_relax_shapes (but reduce_retracing instead). (#29214)__str__() method to PolicyMap. (#31098)contrib folder. (#30992)AlgorithmConfig.overrides() to replace multiagent->policies->config and evaluation_config dicts. (#30879)deprecation_warning(.., error=True) should raise ValueError, not DeprecationWarning. (#30255)gym.spaces.Text serialization. (#30794)MultiAgentBatch to SampleBatch in offline_rl.py. (#30668)Algorithm.train() return Tune-style config dict (instead of AlgorithmConfig object). (#30591)🔨 Fixes:
try_import_..(). (#31332)tensorflow_probability imports. (#31331)PolicyMap.__del__() to also remove a deleted policy ID from the internal deque. (#31388)get_model_v2() instead of get_model() with MADDPG. (#30905)📖Documentation:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
ray status and autoscaler (#32337)🔨 Fixes:
📖Documentation:
🎉 New Features:
📖Documentation:
Many thanks to all those who contributed to this release!
@minerharry, @scottsun94, @iycheng, @DmitriGekhtman, @jbedorf, @krfricke, @simonsays1980, @eltociear, @xwjiang2010, @ArturNiederfahrenhorst, @richardliaw, @avnishn, @WeichenXu123, @Capiru, @davidxia, @andreapiso, @amogkam, @sven1977, @scottjlee, @kylehh, @yhna940, @rickyyx, @sihanwang41, @n30111, @Yard1, @sriram-anyscale, @Emiyalzn, @simran-2797, @cadedaniel, @harelwa, @ijrsvt, @clarng, @pabloem, @bveeramani, @lukehsiao, @angelinalg, @dmatrix, @sijieamoy, @simon-mo, @jbesomi, @YQ-Wang, @larrylian, @c21, @AndreKuu, @maxpumperla, @architkulkarni, @wuisawesome, @justinvyu, @zhe-thoughts, @matthewdeng, @peytondmurray, @kevin85421, @tianyicui-tsy, @cassidylaidlaw, @gvspraveen, @scv119, @kyuyeonpooh, @Siraj-Qazi, @jovany-wang, @ericl, @shrekris-anyscale, @Catch-Bull, @jianoaix, @christy, @MisterLin1995, @kouroshHakha, @pcmoritz, @csko, @gjoliver, @clarkzinzow, @SongGuyang, @ckw017, @ddelange, @alanwguo, @Dhul-Husni, @Rohan138, @rkooo567, @fzyzcjy, @chaokunyang, @0x2b3bfa0, @zoltan-fedor, @Chong-Li, @crypdick, @jjyao, @emmyscode, @stephanie-wang, @starpit, @smorad, @nikitavemuri, @zcin, @tbukic, @ayushthe1, @mattip
Nothing published for this version
Deprecate Checkpoint.to_object_ref and Checkpoint.from_object_ref
Ray 2.2 is a stability-focused release, featuring stability improvements across many Ray components.
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
select_columns() to select a subset of columns (#29081)write_tfrecords() to write TFRecord files (#29448)from_torch() to create dataset from Torch dataset (#29588)from_tf() to create dataset from TensorFlow dataset (#29591)batch_size in BatchMapper (#29193)💫Enhancements:
include_paths in read_images() to return image file path (#30007)to_pandas() and to_dask() (#29417)read_tfrecords() output from Pandas to Arrow format (#30390)str exclude in Concatenator (#29443)🔨 Fixes:
random_shuffle() (#29276)random_shuffle_each_window() (#29482)iter_batches() to not return empty batch (#29638)map_batches() to fetch input blocks on-demand (#29289)take_all() to not accept limit argument (#29746)map_groups() (#30172)stats() call causing Dataset schema to be unset (#29635)batch_format is not specified for BatchMapper (#30366)📖Documentation:
map_batches() documentation about execution model and UDF pickle-ability requirement (#29233)to_tf() docstring (#29464)🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
Tuner.restore work with relative experiment paths (#30363)Tuner.restore from a local directory that has moved (#29920)💫Enhancements:
with_resources takes in a ScalingConfig (#30259)with_resources in with_parameters (#29740)trial_name_creator and trial_dirname_creator to TuneConfig (#30123)BaseTrainer to Trainable once in the Tuner (#30355)remote_checkpoint_dir work with query strings (#30125)🔨 Fixes:
ResourceChangingScheduler dropping PGF args (#30304)Tuner (#29956)TUNE_ORIG_WORKING_DIR env variable (#30134)📖Documentation:
ResultGrid and Result) (#29072)🏗 Architecture refactoring:
setup_wandb() function (#29828)🎉 New Features:
💫Enhancements:
🔨 Fixes:
🎉 New Features:
💫Enhancements:
from_checkpoint()) for directly instantiating instances from a checkpoint directory w/o knowing the original configuration used or any other information (having the checkpoint is sufficient). For a detailed overview, see here. (#28812, #29772, #29370, #29520, #29328)🏗 Architecture refactoring:
🔨 Fixes:
📖Documentation:
🎉 New Features:
💫Enhancements:
entrypoint_num_cpus, entrypoint_num_gpus, or entrypoint_resources. (#28564, #28203)🔨 Fixes:
num_cpus required by task/actors by default (#30496)📖Documentation:
💫Enhancements:
🎉 New Features:
ray list cluster-events.🔨 Fixes:
💫Enhancements:
Many thanks to all those who contributed to this release!
@shrekris-anyscale, @rickyyx, @scottjlee, @shogohida, @liuyang-my, @matthewdeng, @wjrforcyber, @linusbiostat, @clarkzinzow, @justinvyu, @zygi, @christy, @amogkam, @cool-RR, @jiaodong, @EvgeniiTitov, @jjyao, @ilee300a, @jianoaix, @rkooo567, @mattip, @maxpumperla, @ericl, @cadedaniel, @bveeramani, @rueian, @stephanie-wang, @lcipolina, @bparaj, @JoonHong-Kim, @avnishn, @tomsunelite, @larrylian, @alanwguo, @VishDev12, @c21, @dmatrix, @xwjiang2010, @thomasdesr, @tiangolo, @sokratisvas, @heyitsmui, @scv119, @pcmoritz, @bhavika, @yzs981130, @andraxin, @Chong-Li, @clarng, @acxz, @ckw017, @krfricke, @kouroshHakha, @sijieamoy, @iycheng, @gjoliver, @peytondmurray, @xcharleslin, @DmitriGekhtman, @andreichalapco, @vitrioil, @architkulkarni, @simon-mo, @ArturNiederfahrenhorst, @sihanwang41, @pabloem, @sven1977, @avivhaber, @wuisawesome, @jovany-wang, @Yard1
Deprecate Checkpoint.to_object_ref and Checkpoint.from_object_ref
read_images() API for loading data.read_tfrecords() API to read TFRecord files.on_episode_created().💫Enhancements:
🔨 Fixes:
📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
BatchMapper (#28418)💫Enhancements:
Dataset.to_dask() (#28625)ds.limit() (#27343)🔨 Fixes:
📖Documentation:
limit() and take() docstrings (#27367)🎉 New Features:
💫Enhancements:
🔨 Fixes:
train.torch.get_device() (#28659)📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
Tuner.get_results() to retrieve results after restore (#29083)💫Enhancements:
🔨 Fixes:
📖Documentation:
🏗 Architecture refactoring:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
📖Documentation:
🎉 New Features:
on_episode_created(). (#28600)💫Enhancements:
🔨 Fixes:
📖Documentation:
🔨 Fixes:
🎉 New Features:
💫Enhancements:
🔨 Fixes:
run_function_on_all_workers as deprecated until we get rid of this (#29062)📖Documentation:
💫Enhancements:
📖Documentation:
🎉 New Features:
🔨 Fixes:
📖Documentation:
Many thanks to all those who contributed to this release!
@sihanwang41, @simon-mo, @avnishn, @MyeongKim, @markrogersjr, @christy, @xwjiang2010, @kouroshHakha, @zoltan-fedor, @wumuzi520, @alanwguo, @Yard1, @liuyang-my, @charlesjsun, @DevJake, @matteobettini, @jonathan-conder-sm, @mgerstgrasser, @guidj, @JiahaoYao, @Zyiqin-Miranda, @jvanheugten, @aallahyar, @SongGuyang, @clarng, @architkulkarni, @Rohan138, @heyitsmui, @mattip, @ArturNiederfahrenhorst, @maxpumperla, @vale981, @krfricke, @DmitriGekhtman, @amogkam, @richardliaw, @maldil, @zcin, @jianoaix, @cool-RR, @kira-lin, @gramhagen, @c21, @jiaodong, @sijieamoy, @tupui, @ericl, @anabranch, @se4ml, @suquark, @dmatrix, @jjyao, @clarkzinzow, @smorad, @rkooo567, @jovany-wang, @edoakes, @XiaodongLv, @klieret, @rozsasarpi, @scottsun94, @ijrsvt, @bveeramani, @chengscott, @jbedorf, @kevin85421, @nikitavemuri, @sven1977, @acxz, @stephanie-wang, @PaulFenton, @WangTaoTheTonic, @cadedaniel, @nthai, @wuisawesome, @rickyyx, @artemisart, @peytondmurray, @pingsutw, @olipinski, @davidxia, @stestagg, @yaxife, @scv119, @mwtian, @yuanchi2807, @ntlm1686, @shrekris-anyscale, @cassidylaidlaw, @gjoliver, @ckw017, @hakeemta, @ilee300a, @avivhaber, @matthewdeng, @afarid, @pcmoritz, @Chong-Li, @Catch-Bull, @justinvyu, @iycheng
[Workflows] Replace deprecated name option with task_id
The Ray 2.0.1 patch release contains dependency upgrades and fixes for multiple components:
python -m (#28140)host and port in Serve config (#27026)name option with task_id (#28151)The Trainer API is now deprecated for the new Ray AIR Trainers API. Trainers for Pytorch, Tensorflow, Horovod, XGBoost, and LightGBM are now in Beta.
Ray 2.0 is an exciting release with enhancements to all libraries in the Ray ecosystem. With this major release, we take strides towards our goal of making distributed computing scalable, unified, and open.
Towards these goals, Ray 2.0 features new capabilities for unifying the machine learning (ML) ecosystem, improving Ray's production support, and making it easier than ever for ML practitioners to use Ray's libraries.
Highlights:
A migration guide for all the different libraries can be found here: Ray 2.0 Migration Guide.
Ray AIR is now in beta. Ray AIR builds upon Ray’s libraries to enable end-to-end machine learning workflows and applications on Ray. You can install all dependencies needed for Ray AIR via pip install -u "ray[air]".
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
KerasCallback to work with TensorflowPredictor (#26089)predict_pandas implementation (#25534)_predict_arrow interface for Predictor (#25579)call_model API for unsupported output types (#26845)🎉 New Features:
💫 Enhancements:
🔨 Fixes:
Ray Train has received a major expansion of scope with Ray 2.0.
In particular, the Ray Train module now contains:
for common different ML frameworks including Pytorch, Tensorflow, XGBoost, LightGBM, HuggingFace, and Scikit-Learn. These API help provide end-to-end usage of Ray libraries in Ray AIR workflows.
🎉 New Features:
ray.train namespace. This provides streamlined API for offline and online inference of Pytorch, Tensorflow, XGBoost models and more. (#25769 #26215, #26251, #26451, #26531, #26600, #26603, #26616, #26845)💫 Enhancements:
📖 Documentation:
🏗 Architecture refactoring:
🔨 Fixes:
__getstate__ method (#25335)🎉 New Features:
get_dataframe() method to result grid, fix config flattening (#24686)💫 Enhancements:
TempFileLock (#25408)📖 Documentation:
🏗 Architecture refactoring:
🔨 Fixes:
dataset_tune (#25402)set_tune_experiment (#26298)🎉 New Features:
💫 Enhancements:
🎉 New Features:
💫 Enhancements:
evaluation_duration. (#26000)🔨 Fixes:
self._local_worker is None (e.g. in evaluation worker sets)”. (#25332) (#25493)target_network_update_freq for R2D2. (#25510)input_dict arg). (#25877)async_parallel_requests utility. (#26117)torch_utils.py::convert_to_torch_tensor. (#26863)🎉 New Features:
🔨 Fixes:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🏗 Architecture refactoring:
🎉 New Features:
💫 Enhancements:
🔨 Fixes:
head_node, worker_nodes, head_node_type, default_worker_node_type, autoscaling_mode, target_utilization_fraction are removed. Check out the migration guide to learn how to migrate to the new versions.🎉 New Features:
💫 Enhancements:
🔨 Fixes:
🎉 New Features:
Breaking changes:
🔨 Fixes:
Many thanks to all those who contributed to this release!
@ujvl, @xwjiang2010, @EricCousineau-TRI, @ijrsvt, @waleedkadous, @captain-pool, @olipinski, @danielwen002, @amogkam, @bveeramani, @kouroshHakha, @jjyao, @larrylian, @goswamig, @hanming-lu, @edoakes, @nikitavemuri, @enori, @grechaw, @truelegion47, @alanwguo, @sychen52, @ArturNiederfahrenhorst, @pcmoritz, @mwtian, @vakker, @c21, @rberenguel, @mattip, @robertnishihara, @cool-RR, @iamhatesz, @ofey404, @raulchen, @nmatare, @peterghaddad, @n30111, @fkaleo, @Riatre, @zhe-thoughts, @lchu-ibm, @YoelShoshan, @Catch-Bull, @matthewdeng, @VishDev12, @valtab, @maxpumperla, @tomsunelite, @fwitter, @liuyang-my, @peytondmurray, @clarkzinzow, @VeronikaPolakova, @sven1977, @stephanie-wang, @emjames, @Nintorac, @suquark, @javi-redondo, @xiurobert, @smorad, @brucez-anyscale, @pdames, @jjyyxx, @dmatrix, @nakamasato, @richardliaw, @juliusfrost, @anabranch, @christy, @Rohan138, @cadedaniel, @simon-mo, @mavroudisv, @guidj, @rkooo567, @orcahmlee, @lixin-wei, @neigh80, @yuduber, @JiahaoYao, @simonsays1980, @gjoliver, @jimthompson5802, @lucasalavapena, @zcin, @clarng, @jbn, @DmitriGekhtman, @timgates42, @charlesjsun, @Yard1, @mgelbart, @wumuzi520, @sihanwang41, @ghost, @jovany-wang, @siavash119, @yuanchi2807, @tupui, @jianoaix, @sumanthratna, @code-review-doctor, @Chong-Li, @FedericoGarza, @ckw017, @Makan-Ar, @kfstorm, @flanaman, @WangTaoTheTonic, @franklsf95, @scv119, @kvaithin, @wuisawesome, @jiaodong, @mgerstgrasser, @tiangolo, @architkulkarni, @MyeongKim, @ericl, @SongGuyang, @avnishn, @chengscott, @shrekris-anyscale, @Alyetama, @iycheng, @rickyyx, @krfricke, @sijieamoy, @kimikuri, @czgdp1807, @michalsustr
One column per quarter.