[3D Realsense] ORBBEC 3D Camera | Description of SDK and how to use it

SDK function introduction

  1. OpenNI2 SDK is the basic SDK, based on OpenNI extension to support Orbbec 3D sensing camera. It can be used to read color stream, depth stream, infrared stream, generate point cloud, generate ONI video file and read ONI video file sample code. The provided SDK for different platforms corresponds to the Samples directory.

  2. Orbbec SDK is a new generation of basic development kits. It fully supports UVC, realizes plug-and-play without driver, and provides low-level and high-level concise and easy-to-use APIs to help developers use them flexibly in different scenarios. For OBI Zhongguang structured light, binocular, iToF and other 3D sensing cameras, it provides device parameter configuration, data stream reading and stream processing, cross-platform (Windows, Android, Linux) software development kits, providing functions including :

  • Access and control of hardware devices​
  • Access, control and data acquisition of sensors contained in the device
  • Frame synchronization and alignment control
  • Acquisition of point cloud data
  • Provide algorithm capabilities such as filtering
  • Different systems and Wrapper support.
  1. Through a simple and effective architecture design, Astra SDK has better scalability for access to application algorithms such as skeletons, and supports engines such as Unity3D.

  2. Orbbec Pose SDK is an algorithm SDK, which mainly provides 3D human pose estimation algorithm capabilities.
    Feature points can provide:

  • 21 key bone point coordinates
  • Provides both 2D and 3D bone points
  • Real-time multi-person skeleton point recognition and tracking

Steps to use OpenNI2 SDK&Astra SDK:
The following steps apply to the camera model:

Astra(S)/AstraPro/AstraMini(S)/AstraProPlus/
DaBaiPro/DaBaiDC1/D1//DaBai/Gemini//Deeyea/Projector/
Petrel A/Petrel B/Petrel Pro B/Petrel Pro C/Petrel Pro/
Butterfly/Astra NH-GLST/A1/A1 Pro/Atlas/

  1. Download the driver
    Go to the developer center and download the Sensor driver
    https://developer.orbbec.com.cn/download.html?id=32

  2. Install the driver
    Enter the technical library, refer to “Astra Device Driver Installation”
    https://developer.orbbec.com.cn/technical_library.html?id=46&verdict=1

  3. Download OpenNI2 SDK tools
    Go to the developer center and download the OpenNI2 SDK tool
    https://developer.orbbec.com.cn/download.html?id=77

  4. OpenNI2 SDK tool usage tutorial
    Enter the technical library, refer to the “Orbbec Viewer Manual”
    https://developer.orbbec.com.cn/technical_library.html?id=36

  5. Download OpenNI2 SDK
    Enter the developer center and download the OpenNI2 SDK v2.3.0.81 software
    https://developer.orbbec.com.cn/download.html?id=65

  6. OpenNI2 SDK usage tutorial
    Enter the technical library, refer to “OpenNI2 SDK Usage Tutorial”
    https://developer.orbbec.com.cn/technical_library.html?id=29

  7. Download Astra SDK
    Enter the developer center and download the Astra SDK software
    https://developer.orbbec.com.cn/download.html?id=56

  8. Astra SDK usage tutorial
    Enter the technical library, refer to “Astra SDK Usage Tutorial”
    https://developer.orbbec.com.cn/technical_library.html?id=21

Steps to use Orbbec SDK:
The following steps apply to the camera model:
Astra+
Femto(W)

  1. Download Orbbec SDK and tools
    Go to the developer center and download the Orbbec SDK and tools
    https://developer.orbbec.com.cn/download.html?id=78

  2. Orbbec SDK usage tutorial
    Enter the technical library, refer to “Orbbec SDK Usage Tutorial”
    https://developer.orbbec.com.cn/technical_library.html?id=39

  3. Download Orbbec SDK (OpenNI2)
    Go to the developer center and download the Orbbec SDK (OpenNI2)
    https://developer.orbbec.com.cn/download.html?id=79

  4. Orbbec SDK (OpenNI2) tutorial
    Enter the technical library, refer to “Orbbec SDK (OpenNI2) User Manual”
    https://developer.orbbec.com.cn/technical_library.html?id=47

  5. Download Orbbec SDK (ROS)
    Go to the developer center and download the Orbbec SDK (ROS)
    https://developer.orbbec.com.cn/download.html?id=76

  6. Orbbec SDK (ROS) tutorial
    Enter the technical library, refer to “Orbbec SDK (ROS) Usage Tutorial”
    https://developer.orbbec.com.cn/technical_library.html?id=45

three. Steps to use Orbbec Pose SDK:
The following steps apply to the camera model:
Astra Plus/Astra Mini/Femto(W)/Astra+

  1. Download Orbbec Pose SDK and tools
    Go to the developer center and download the Orbbec Pose SDK

  2. Orbbec Pose SDK usage tutorial
    Enter the technical library, refer to “Orbbec Pose SDK User Tutorial”
    https://developer.orbbec.com.cn/technical_library/pose/overview.html?id=pose/overview

The above process and file path will be adjusted in real time according to the actual situation!

Astra series : GitHub - orbbec/ros_astra_camera: ROS wrapper for Astra camera