Occipital Structure Core (depth camera) hardware support with Matlab

I am using the structure core camera for my drone. My objective with the drone is to implement a modified version of the PX4 obstacle avoidance algorithm. How do I interface my camera (hardware) to Matlab and Simulink? I did not find the structure core camera's support on Matlab- https://www.mathworks.com/hardware-support/home.html. How do I use the camera for my tasks? As of now I can only use the Coreplayground and take snapshots. But I don't know how to use the camera's data via Matlab.

To be a bit more specific, I want to get a point cloud (depth map) from the stereo camera. I will then be using this depth map for my obstacle avoidance algorithm. So how do I get my depth map or point cloud from the camera?

Please share any documentation or related resources that can help me out.

P.S. I have thought of using Intel Realsense D435 camera instead now due to lack of documentation for the strcutre core camera.

Answer 1

[Akash]

Hi Kevin,

For the Intel RealSense D435 camera, it's important to note that while it is not directly supported by the Image Processing and Computer Vision toolbox, you have the option to write your own custom adaptors in MATLAB. This could involve writing custom code in MATLAB to communicate with the camera and retrieve the necessary data, such as the point cloud or depth map.

The process of creating a custom adaptor can be divided into several smaller tasks, or stages, which can help manage the development effectively.

You can find more information on creating custom adaptors and the staged development model at the following links:-

https://www.mathworks.com/help/imaq/creating-custom-adaptors.html

https://www.mathworks.com/help/imaq/adaptorkit/creating-an-adaptor.html

These resources should guide you through the process of developing an adaptor that can interface with the Intel RealSense D435 camera.