Perception
Turning sensor data into objects, poses and maps.
- OpenCVOpen source
The open-source computer vision library used by nearly every robot.
- SAM 2Open source
Segment Anything in images and videos.
- Open3DOpen source
A modern library for 3D data processing.
- Point Cloud LibraryOpen source
The standard C++ library for 2D/3D image and point cloud processing.
- librealsenseOpen source
Intel RealSense SDK for depth cameras.
- Depth AnythingOpen source
Monocular depth estimation foundation model.
- KalibrOpen source
Camera and IMU calibration toolbox.
- FoundationPose
Unified 6D pose estimation and tracking of novel objects.
- AprilTagOpen source
Visual fiducial system for robust pose estimation.
- Roboflow InferenceOpen source
Deploy vision models (YOLO, SAM, CLIP) on edge devices for robots.
- GraspNet-1Billion
Large-scale benchmark and baseline for general object grasping.
- Grasp Pose Detection
Detects 6-DOF grasps for two-finger grippers in point clouds.
- VelodyneOpen source
The classic spinning LiDAR of autonomous driving research.
- RPLIDAROpen source
The affordable 2D LiDAR found on most ROS mobile robots.
- Contact-GraspNet
Efficient 6-DoF grasp generation in cluttered scenes.
- Ouster LiDAR SDKOpen source
High-resolution digital 3D LiDAR with an open SDK.
- Livox LiDAR SDK
Solid-state 3D LiDAR used by FAST-LIO and many drones.
- ZEDOpen source
Stereo depth cameras with built-in tracking and spatial mapping.
- DAVIS and DVSOpen source
ROS drivers for iniVation event cameras.
- Prophesee event cameras
Open SDK for Metavision event-based vision sensors.
- GelSight MiniOpen source
A camera-based tactile sensor that images contact geometry.
- MicroStrain IMU
Industrial IMU and GNSS/INS units with an official ROS driver.
- ReSpeaker ROSOpen source
ROS driver for ReSpeaker microphone arrays.
