Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add RTX Lidar Sensor #1372

Open
wants to merge 20 commits into
base: main
Choose a base branch
from
Open

Add RTX Lidar Sensor #1372

wants to merge 20 commits into from

Conversation

jtigue-bdai
Copy link
Collaborator

@jtigue-bdai jtigue-bdai commented Nov 4, 2024

Description

This PR creates a sensor based on the RTX Lidar:
Fixes #865

Type of change

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Screenshots

Please attach before and after screenshots of the change if applicable.

Checklist

  • I have run the pre-commit checks with ./isaaclab.sh --format
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the changelog and the corresponding version in the extension's config/extension.toml file
  • I have added my name to the CONTRIBUTORS.md or my name already exists there

@jtigue-bdai jtigue-bdai self-assigned this Nov 4, 2024
@jtigue-bdai jtigue-bdai changed the title Jat/feat/rtx lidar Add RTX Lidar Sensor Nov 7, 2024
@jtigue-bdai jtigue-bdai added enhancement New feature or request dev team Issue or pull request created by the dev team labels Nov 7, 2024
@jtigue-bdai
Copy link
Collaborator Author

@Dhoeller19

@jtigue-bdai jtigue-bdai mentioned this pull request Nov 22, 2024
6 tasks
# lazy allocation of data dictionary
# since the size of the output data is not known in advance, we leave it as None
# the memory will be allocated when the buffer() function is called for the first time.
self._data.output = TensorDict({}, batch_size=self._view.count, device=self.device)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is TensorDict necessary here? we had a change that went in to remove TensorDict from the tiled camera class because it was causing performance issues

Copy link
Collaborator Author

@jtigue-bdai jtigue-bdai Dec 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I bet we can remove it, just following the camera and tiled_camera patterns.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey I just checked both tiled_camera and camera use TensorDict for data.output. Did the change you mentioned go into the Nvidia internal fork?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm I think it was updated in #1348

class OffsetCfg:
"""The offset pose of the sensor's frame from the sensor's parent frame."""

pos: tuple[float, float, float] = (0.0, 0.0, 1.0)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why (0, 0, 1) instead of (0, 0, 0)?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch I was using that during manual testing

env_ids = self._ALL_INDICES
# reset the data
# note: this recomputation is useful if one performs events such as randomizations on the camera poses.
# self._update_poses(env_ids)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would it still make sense to do this call?

@kellyguo11
Copy link
Contributor

@jtigue-bdai will you get a chance to look into this one today? I can also try to get this one merged in.

@jtigue-bdai
Copy link
Collaborator Author

I don't think I will be able to get to it today.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dev team Issue or pull request created by the dev team enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add RTX Lidar sensor
2 participants