Luxonis OAK-D series 2 USB and PoE cameras integrate 3D depth and AI for robotics applications

Luxonis OAK-D Series 2 are the second-generation of USB or PoE cameras with 3D depth and a built-in AI accelerator mostly used for computer vision in robotics applications.

We first wrote about Luxonis’ DepthAI module for Raspberry Pi based on the Intel Myriad X AI accelerator in 2019, and later found the module integrated into OpenCV AI Kit Lite, aka OAK-D Lite camera. The second-generation OAK-D cameras replace the module with a Robotics Vision Core 2 (RVC2) “chip-down design” equipped an SoC and Myriad X AI accelerator for up to 4 TOPS of processing power, including 1.4 TOPS for AI inference.

Luxonis OAK-D Series 2 specifications and features:

• Robotics Vision Core 2 based on Myriad X AI accelerator
  • 4 TOPS of processing power (1.4 TOPS for AI)
  • Video encoding – H.264, H.265, MJPEG @ 4Kp3, 1080p60
  • Computer vision – Warp/dewarp, resize, crop via ImageManip node, edge detection, feature tracking, custom CV functions
  • Run any AI model, even custom ones
  • Stereo depth perception with filtering, post-processing, RGB-depth alignment, and high configurability
  • Object tracking – 2D and 3D tracking with ObjectTracker node
• Cameras
  • Color camera based on IMX378 12MP (4032×3040) sensor with rolling shutter  (two options)
    • Autofocus
      • FOV (D/H/V) – 78°/66°/54°
      • Focus – 8cm – ∞
      • Lens size – 1/2.3 inch
    • Fixed focus with wide FoV lens
      • FOV (D/H/V) – 81°/69°/55°
      • Focus – 50cm – ∞
      • Lens size – 1/2.3 inch
  • Stereo pair
    • OV9282 sensor
    • Global shutter
    • FOV (D/H/V) – 89.5°/80°/55°
    • 1MP (1280×800) resolution
    • Focus – Fixed focus: 19.6cm – ∞
    • Pixel size – 3µm x 3µm
    • Lens size – 1/4 inch
• Pro models only – IR laser dot projector (active stereo) and IR illumination LED (for night vision)
• Host and power interface (one of the other)
  • 1x USB Type-C port up to 10Gbps
  • Gigabit Ethernet M12 connector with PoE
• Dimensions & weight
  • USB models – 97 x 29.5 x 23.1 mm, about 91 grams
  • PoE models – 111 x 40 x 31.3mm, about 184 grams
• IP Rating – IP67 for the PoE models only

With the combination of USB or PoE, Pro or non-Pro model, and the fixed-focus wide FoV option, we end up with eight different models namely: OAK-D S2,  OAK-D W, OAK-D Pro, OAK-D Pro W, OAK-D S2 PoE, OAK-D W PoE, OAK-D Pro PoE, and OAK-D Pro W PoE.

 

Luxonis OAK-D Series 2 camera work with the DepthAI SDK offering Python and C++ APIs, and includes demos for human pose estimation, road segmentation, people counting, and more.  You’ll find the full hardware and software details on the documentation website. The DepthAI SDK is officially supported on Windows, Ubuntu, macOS, Raspberry Pi OS, and Jetson Nano/Xavier platforms, but more operating systems are also supported with the help of the community.

The first generation OAK-D cameras were used in various projects notably newborn monitoring and smart agriculture to monitor the health of plants, detect pests, and so on with the help of drones and four-wheeled robots

Pre-orders have opened with shipping scheduled to start at the end of the month. Prices start at $199 for the OAK-D S2 model and go up to $399 for the OAK-D Pro PoE variant. You’ll find them all on the Luxonis shop.

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress