NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning
Last release 24 days ago
10 Sep 2026
Ships fairly regularly
a new release about every 2 months
Nearly every release is documented
notes for 28 of 29 stable releases
Nothing withdrawn
no release was ever pulled
4 years old
35 releases · first in 2022
One column per quarter.
[Quality] Deprecate .ipynb tutos by @vmoens in https://github.com/pytorch/rl/pull/710
__repr__ tests by @sladebot in https://github.com/pytorch/rl/pull/435_inplace_update cls parameter passing in __new__ by @nicolas-dufour in https://github.com/pytorch/rl/pull/464device_safe() with device by @ordinskiy in https://github.com/pytorch/rl/pull/485TensorDictPrimer transform by @nicolas-dufour in https://github.com/pytorch/rl/pull/456erase() method for torchrl.timeit by @nicolas-dufour in https://github.com/pytorch/rl/pull/480passing_devices to None by @himjohntang in https://github.com/pytorch/rl/pull/477passing_devices to None" by @vmoens in https://github.com/pytorch/rl/pull/494passing_devices to None by @vmoens in https://github.com/pytorch/rl/pull/495step_tensordict in step_mdp by @romainjln in https://github.com/pytorch/rl/pull/512device argument for modules.models by @yushiyangk in https://github.com/pytorch/rl/pull/524"_" out_keys in tensordictmodel by @jlesuffleur in https://github.com/pytorch/rl/pull/589ProbabilisticTensorDictModule keys by @vmoens in https://github.com/pytorch/rl/pull/603dim argument in TensorDict.squeeze by @jgonik in https://github.com/pytorch/rl/pull/608copy_ changes the index if the dest and source memmap tensors share the same file location by @vmoens in https://github.com/pytorch/rl/pull/631TransformedEnv by @alexanderlobov in https://github.com/pytorch/rl/pull/630step_mdp method in data collector by @adityagandhamal in https://github.com/pytorch/rl/pull/637implement_for decorator by @ordinskiy in https://github.com/pytorch/rl/pull/618deepcopy in transforms.py by @romainjln in https://github.com/pytorch/rl/pull/625standard_normal for RewardScaling by @adityagandhamal in https://github.com/pytorch/rl/pull/682tensordict.nn.TensorDictModule by @tcbegley in https://github.com/pytorch/rl/pull/700speed branch merge on tensordict by @vmoens in https://github.com/pytorch/rl/pull/755common.py by @matteobettini in https://github.com/pytorch/rl/pull/769_set_seed abstract by @matteobettini in https://github.com/pytorch/rl/pull/770ParallelEnv handling of done flag by @matteobettini in https://github.com/pytorch/rl/pull/788HabitatEnv entry in docs by @matteobettini in https://github.com/pytorch/rl/pull/798torchrl.record by @vmoens in https://github.com/pytorch/rl/pull/854Full Changelog: https://github.com/pytorch/rl/compare/v0.0.2a...0.0.4a
The main changes introduced by this release are:
The main changes introduced by this release are:
permute(...).to_tensordict() by @vmoens in https://github.com/pytorch/rl/pull/260torch.stack with destination by @khmigor in https://github.com/pytorch/rl/pull/245BinarizeReward by @srikanthmg85 in https://github.com/pytorch/rl/pull/302Compose.insert and TransformedEnv.insert_transform by @rmartimov in https://github.com/pytorch/rl/pull/304TensorDict.view to remove unnecessary ViewedTensorDict object creation by @bamaxw in https://github.com/pytorch/rl/pull/319__setitem__ for SubTensorDict by @vmoens in https://github.com/pytorch/rl/pull/369ProbabilisticTensorDictModule dist key mapping support by @nicolas-dufour in https://github.com/pytorch/rl/pull/376share_memory_() by @fdabek1 in https://github.com/pytorch/rl/pull/412biased_softplus semantic to allow for minimum scale setting by @nicolas-dufour in https://github.com/pytorch/rl/pull/428set*() methods for TensorDictBase class by @zeenolife in https://github.com/pytorch/rl/pull/438next_ to the out_key by @ggimler3 in https://github.com/pytorch/rl/pull/449device_safe in replay buffer code by @vmoens in https://github.com/pytorch/rl/pull/454batch_lock attribute in EnvBase by @nicolas-dufour in https://github.com/pytorch/rl/pull/399__repr__ tests by @sladebot in https://github.com/pytorch/rl/pull/435_inplace_update cls parameter passing in __new__ by @nicolas-dufour in https://github.com/pytorch/rl/pull/464device_safe() with device by @ordinskiy in https://github.com/pytorch/rl/pull/485TensorDictPrimer transform by @nicolas-dufour in https://github.com/pytorch/rl/pull/456erase() method for torchrl.timeit by @nicolas-dufour in https://github.com/pytorch/rl/pull/480passing_devices to None by @himjohntang in https://github.com/pytorch/rl/pull/477passing_devices to None" by @vmoens in https://github.com/pytorch/rl/pull/494passing_devices to None by @vmoens in https://github.com/pytorch/rl/pull/495step_tensordict in step_mdp by @romainjln in https://github.com/pytorch/rl/pull/512device argument for modules.models by @yushiyangk in https://github.com/pytorch/rl/pull/524"_" out_keys in tensordictmodel by @jlesuffleur in https://github.com/pytorch/rl/pull/589ProbabilisticTensorDictModule keys by @vmoens in https://github.com/pytorch/rl/pull/603dim argument in TensorDict.squeeze by @jgonik in https://github.com/pytorch/rl/pull/608copy_ changes the index if the dest and source memmap tensors share the same file location by @vmoens in https://github.com/pytorch/rl/pull/631TransformedEnv by @alexanderlobov in https://github.com/pytorch/rl/pull/630step_mdp method in data collector by @adityagandhamal in https://github.com/pytorch/rl/pull/637implement_for decorator by @ordinskiy in https://github.com/pytorch/rl/pull/618deepcopy in transforms.py by @romainjln in https://github.com/pytorch/rl/pull/625standard_normal for RewardScaling by @adityagandhamal in https://github.com/pytorch/rl/pull/682Full Changelog: https://github.com/pytorch/rl/compare/v0.0.1...0.0.3
[BugFix] Fixed compose which ignored inv_transforms of child by @nicolas-dufour in https://github.com/facebookresearch/rl/pull/328
__setitem__ for SubTensorDict by @vmoens in https://github.com/facebookresearch/rl/pull/369ProbabilisticTensorDictModule dist key mapping support by @nicolas-dufour in https://github.com/facebookresearch/rl/pull/376share_memory_() by @fdabek1 in https://github.com/facebookresearch/rl/pull/412biased_softplus semantic to allow for minimum scale setting by @nicolas-dufour in https://github.com/facebookresearch/rl/pull/428set*() methods for TensorDictBase class by @zeenolife in https://github.com/facebookresearch/rl/pull/438next_ to the out_key by @ggimler3 in https://github.com/facebookresearch/rl/pull/449device_safe in replay buffer code by @vmoens in https://github.com/facebookresearch/rl/pull/454batch_lock attribute in EnvBase by @nicolas-dufour in https://github.com/facebookresearch/rl/pull/399Full Changelog: https://github.com/facebookresearch/rl/compare/v0.0.1c...v0.0.2a
Adding additional checks to TensorDict.view to remove unnecessary ViewedTensorDict object creation by @bamaxw in https://github.com/facebookresearch/r
TensorDict.view to remove unnecessary ViewedTensorDict object creation by @bamaxw in https://github.com/facebookresearch/rl/pull/319Full Changelog: https://github.com/facebookresearch/rl/compare/v0.0.1b...v0.0.1c
[Feature] Nested tensordicts by @vmoens in https://github.com/facebookresearch/rl/pull/256
Supports nested tensordicts:
Padding for tensordicts:
Speed improvements:
Logging capabilities:
Doc
permute(...).to_tensordict() by @vmoens in https://github.com/facebookresearch/rl/pull/260torch.stack with destination by @khmigor in https://github.com/facebookresearch/rl/pull/245BinarizeReward by @srikanthmg85 in https://github.com/facebookresearch/rl/pull/302Compose.insert and TransformedEnv.insert_transform by @rmartimov in https://github.com/facebookresearch/rl/pull/304Full Changelog: https://github.com/facebookresearch/rl/compare/v0.0.1...v0.0.1b
Nothing published for this version
Your coding agent can read these notes before it upgrades. Set up the MCP server →