Issues: pytorch/rl
[QUESTION] Using LSTMs with vectorized envs without ParallelEnv
#1493
opened Sep 5, 2023 by
ADebor
Open
7
Issues list
[BUG] SyncDataCollector Crashes with Resources Leak During Data Collection
bug
Something isn't working
#2644
opened Dec 11, 2024 by
AlexandreBrown
3 tasks done
[BUG] The class MultiOneHot(OneHot) uses the "to_numpy" method from the OneHot class which do not support multionehot vectors.
bug
Something isn't working
#2633
opened Dec 5, 2024 by
morales0021
[Feature Request] Provide documentation on how to use CatFrames with a data collector and replay buffer for images
enhancement
New feature or request
#2618
opened Nov 29, 2024 by
AlexandreBrown
1 task done
[BUG] SyncDataCollector Not Working With ParallelEnv when Built with Replay Buffer
bug
Something isn't working
#2617
opened Nov 29, 2024 by
AlexandreBrown
3 tasks done
[Feature Request] ActionDiscretizer scalar integration
enhancement
New feature or request
#2615
opened Nov 28, 2024 by
oslumbers
1 task done
[BUG] MultiaSyncDataCollector crashes when passing Replay Buffer to constructor
bug
Something isn't working
#2614
opened Nov 28, 2024 by
AlexandreBrown
3 tasks done
[Feature Request] Rename Recorder and LogReward
enhancement
New feature or request
#2610
opened Nov 26, 2024 by
jannessm
1 task done
[Feature Request] ActionDiscretizer custom sampler
enhancement
New feature or request
#2608
opened Nov 25, 2024 by
oslumbers
1 task done
[BUG] Something isn't working
Transform._call is not called from reset
bug
#2595
opened Nov 22, 2024 by
codingWhale13
[BUG] Something isn't working
torchrl.objectives.SACLoss is broken when there is more than one qvalue_network
bug
#2589
opened Nov 20, 2024 by
fmeirinhos
3 tasks done
[BUG] SliceSampler should return unique IDs when sampling multiple times from the same trajectory
bug
Something isn't working
#2588
opened Nov 20, 2024 by
dmelcer9
3 tasks done
[BUG] Vmap call in value estimate not compatible with torch_geometric radius graph
bug
Something isn't working
#2537
opened Nov 5, 2024 by
matteobettini
[Feature Request] Include group-level done fields in the VMAS environment
enhancement
New feature or request
#2536
opened Nov 5, 2024 by
thomasbbrunner
1 task done
[Feature Request] TorchRL for Python 3.13t
enhancement
New feature or request
#2535
opened Nov 4, 2024 by
patchmeifyoucan
[BUG] SyncDataCollector Crashes when init_random_frames=0 with a policy that is NOT random
bug
Something isn't working
#2534
opened Nov 4, 2024 by
AlexandreBrown
3 tasks done
[BUG] RuntimeError: Setting 'advantage' via the constructor is deprecated, use .set_keys(<key>='some_key') instead .
bug
Something isn't working
#2528
opened Oct 30, 2024 by
jianzhnie
[BUG] Something isn't working
target_value_network_params initialization bug in convert_to_functional()
bug
#2523
opened Oct 28, 2024 by
matinmoezzi
3 tasks done
[BUG] info['_weight'] device for Importance Sampling in PER
bug
Something isn't working
#2518
opened Oct 26, 2024 by
EladSharony
3 tasks done
[Feature Request] Loss New feature or request
make_value_estimator takes a ValueEstimatorBase class as argument
enhancement
#2503
opened Oct 18, 2024 by
louisfaury
1 task done
[Feature Request] Support compiling New feature or request
ReplayBuffer.extend/sample without recompile
enhancement
#2501
opened Oct 18, 2024 by
kurtamohler
1 task done
[BUG]ClipPPOLoss encounters an bug when calculating the loss in a composite action space scenario, failing to produce the correct result.
bug
Something isn't working
#2487
opened Oct 10, 2024 by
Sui-Xing
[BUG] Problems with multidimensional Something isn't working
nvec in MultiCategorical
bug
#2486
opened Oct 10, 2024 by
matteobettini
[BUG] Something isn't working
MaskedCategorical missing mode and deterministic_sample properties.
bug
#2479
opened Oct 9, 2024 by
MorganeAyle
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.